pue is just the beginning -...

PUE IS JUST THE BEGINNING

October 23rd, 2012

SERENA DEVITO

ADVANCED DATA CENTER ENGINEERING

PUE is just the beginning 2

Marketplaces Payments

Ecommerce

Platform &

Developer

Networks

Our Portfolio


The Future of Commerce

2008 = $325B 2013=$10T

Yesterday Tomorrow

Online

6%

Web-

influenced

offline 37%

Online

+

Offline Offline

Today

Online

4%

Offline

96%

Source: Forrester Source: Forrester, Euromonitor and Economist

Intelligence Unit

Source: Economist Intelligence Unit


The eBay marketplace alone has more

than 100 million active users

Topaz Data Center, South Jordan, Utah

These transactions are

powered by the

most efficient

and innovative

data centers in

the world

Downloads of eBay mobile apps

have topped 100 million

Phoenix-1 Best Practices

• Best practices reduce operating expenses

• Blanking panel program

• Return air management

• Hot/cold aisle containment

• Operational best practices

• UPS module rotation

• Lowering cooling tower setpoint

• Lighting control

• Result: 19% PUE reduction

• $300,000 rebate awarded 11/2010 by APS for efficiency projects

• Achieved during 50% IT growth


Phoenix-1 Hartman loop

• Hartman Loop

• Install Variable Frequency Drives on the primary chilled water and condenser water

pumps, and additional monitoring on secondary pumps and cooling tower fans.

• Install Hartman loop controller (provided by Armstrong) and integrate into the existing

BMS system.


Phoenix-1 Hartman loop

• The Hartman loop controller analyzes data received from the BMS, then sends the BMS

suggested operating conditions which the BMS implements.

• Number of chillers to operate

• Pump speeds

• Project cost

• $724,950 ($246,815 w/rebate)

• Est. ROI 2.5 years (0.8 w/rebate)

• Results

• Chiller system load decrease 232kW

• PUE decrease from av. 1.629 to 1.576

• Expected savings

• 4,784,274 kWh Annual (+-5%)

• 0.31 kW/Ton (0.83 to 0.52)

• $310,978 Annual cost savings


1.5

1.52

1.54

1.56

1.58

1.6

1.62

1.64

1.66

1.68

6700

6800

6900

7000

7100

7200

7300

7400

7500

7600

1/1

5/20

12 0

:01:

00 A

M

1/1

5/20

12 3

:00:

00 A

M

1/1

5/20

12 6

:00:

00 A

M

1/1

5/20

12 9

:00:

00 A

M

1/1

5/20

12 1

2:00

:00

PM

1/1

5/20

12 3

:00:

00 P

M

1/1

5/20

12 6

:00:

00 P

M

1/1

5/20

12 9

:00:

00 P

M

1/1

6/20

12 0

:01:

00 A

M

1/1

6/20

12 3

:00:

00 A

M

1/1

6/20

12 6

:00:

00 A

M

1/1

6/20

12 9

:00:

00 A

M

1/1

6/20

12 1

2:00

:00

PM

1/1

6/20

12 3

:00:

00 P

M

1/1

6/20

12 6

:00:

00 P

M

1/1

6/20

12 9

:00:

00 P

M

1/1

7/20

12 0

:01:

00 A

M

1/1

7/20

12 3

:00:

00 A

M

1/1

9/20

12 9

:00:

00 P

M

1/2

0/20

12 0

:01:

00 A

M

1/2

0/20

12 3

:00:

00 A

M

1/2

0/20

12 6

:00:

00 A

M

1/2

0/20

12 9

:00:

00 A

M

1/2

0/20

12 1

2:00

:00

PM

1/2

0/20

12 3

:00:

00 P

M

1/2

0/20

12 6

:00:

00 P

M

1/2

0/20

12 9

:00:

00 P

M

1/2

1/20

12 0

:01:

00 A

M

1/2

1/20

12 3

:00:

00 A

M

1/2

1/20

12 6

:00:

00 A

M

1/2

1/20

12 9

:00:

00 A

M

1/2

1/20

12 1

2:00

:00

PM

1/2

1/20

12 3

:00:

00 P

M

1/2

1/20

12 6

:00:

00 P

M

1/2

1/20

12 9

:00:

00 P

M

kW

Total Load vs. PUE

Total Load (kW)

PUE

IT Rack density

• Rack level

• eBay rack design 30” wide, 48U high with 6 x 2U cut

outs on the side, supports up to 3500lbs

• Optimized power strips 2-4 (208V, 400V) supporting

17kW to 28kW

• Real time wireless monitoring outlets, assets and

environmentals

• Hardware level

• TCO density cost analysis: 28kW racks more efficient

than 14kW racks

• Hadoop: 48 servers, 24TB per node, up to 16kW

• Everything else: 96 servers, up to 28kW

• Time to deploy

• Rack and roll allows hardware cache on demand

• Containerized delivery allows 20 rack deployments


Phoenix Project Mercury

• Concurrently maintainable Tier 2+

• 8000 ft2 first floor white space

• 8000 ft2 roof IT containers

• Dual loop water

• 55°F chilled water loop

• 87°F hot water loop

• IT density scalable to 40kW

• IT capacity expandable to 12 MW

• 4MW day one, then 2MW

increments

• UPS / Generator on one power path,

straight utility on the other


White space

• In Row cooling units and rear door

coolers provide up to 40kW rack

density

• Under floor piping to racks:

• 55°F chilled water loop

• 87°F hot water loop

• Gordon grid hot aisle containment

• 400V bus duct


Roof top containers

• Roof rated to 1,000,000 lbs

• Weeks to connect and commission

• Space to support up to 11 containers

• Power to support up to 6MW


HP PODs

DELL MDCs

August 2011

January 2012 August 2012

Site

• No Measurements

Site

• PUE (L3, HC) = 1.26 (min)

• PUE (L3, HC) = 1.35 (avg)

Site

• PUE (L3, HC) = 1.12 (min)

• PUE (L3, HC) = 1.534 (avg)

Dell MDC

• pPUE (L3, HC) = 1.040 (min)

• pPUE (L3, HC) = 1.043 (avg)

• pPUE (L3, HC) = 1.044 (max)

Dell MDC

• pPUE (L3, HC) = 1.018 (min)

• pPUE (L3, HC) = 1.039 (avg)

Dell and HP Containers

• pPUE (L3, HC) = 1.016-1.027 (min)

• pPUE (L3, HC) = 1.034-1.128 (avg)

White space

• pPUE (L3, HC) = 1.349 (min)

• pPUE (L3, HC) = 1.417 (avg)

1920 servers, 20 racks, 520kW

max 119°F outdoor high

30-35% site load, 3 containers,

<80°F outdoor high

40-50% site load, 4 containers,

max 113° outdoor high

Phoenix-2 PUE


http://www.thegreengrid.org/en/Global/Content/white-papers/WP45-CaseStudyBreakingNewGroundonDataCenterEfficiency

What’s next?

Project Quicksilver


South Jordan

Utah

pue is just the beginning -...

Documents