data_centers - design consideration(1).pdf

John Jones, M.B.A. Vice President for Information Technology

Indiana Wesleyan University

Design Considerations When Planning a New Data Center

Eric Sank, P.E., RCDD Design Collaborative, Inc.

•History of the IWU Data Center •Challenges •Charge •Frustration •Partnership

Data Center Design – a Case Study.

Understand your needs.

•Present Equipment + Growth •Racks •Layout •Misc. Equipment

Location, location, location...

•Security •Access to fiber/copper •Accessibility •No Foreign Services •Visibility

Reliability

•How Critical are Processes •Uptime Institute

•www.uptimeinstitute.org •Tier Classification

Tier 1 •Single Path cooling & electrical

•No redundancy

•99.671% availability (28 hours/year)

Reliability – Tier Classification


Tier 2 •Single Path cooling & electrical

•Redundant capacity, single path

•Raised floor, UPS, engine generator

•99.741% availability (22 hours/year)


Tier 3 •Active & Passive delivery paths

•Redundant Capacity

•Concurrently maintainable9

•99.982% availability (1.6 hours/year)


Tier 4 •Dual active delivery paths

•N+1 redundancy

•Concurrently maintainable

•99.995% availability (.4 hours/year)

•Clean out your desk!

Power Distribution

•Design Considerations •Rules of Thumb

Power Distribution

Design Considerations •Does electrical service have adequate capacity?

•Need at least one feed from building utility

service.

•Distribution type panel on output of transfer

switch

Rules of Thumb •200-400 watts/sq f.t total electrical load for

data center including A/C

•Cost is dependent on distance from service.

Power Distribution

Emergency Generator


Emergency Generator

Design Considerations •Powers A/C, UPS, lights & other critical equip.

•Fuel choice – natural gas vs. diesel

•Transfer switch – programmed transition

•Indoor vs. Outdoor

•Accessories – heater, charger, etc

Emergency Generator

Rules of Thumb •Size the generator 2-3 times the KW of

UPS/equipment load.

•Estimate $250-$300/KW for installed price

UPS (Uninterruptible Power Supply)

...brown can’t do this for you.

...brown can’t do this for you.

UPS (Uninterruptible Power Supply)


UPS

Design Considerations •Required watts.

•Actual vs. rated loads

•Availability – N, N+1, 2N

•Single Unit vs multiple, rack mounted UPS

•Dual Conversion vs. standby

•Location

•Battery type, time, weight

•Bypass – static and wrap-around

•Flywheel Technology

•Limit battery recharge when on generator

UPS

Rules of Thumb •70-100 watts/s.f. for standard equipment

layout. Can go up to 200-300 watts/s.f.

•5-7 years life for maintenance –free batteries

and 10-14 years for lead-acid batteries.

•$500-$800 per KW.

•3 ft. maintenance clearance required in front

and possibly on the sides

Air Conditioning


Air Conditioning

Design Considerations •Sawcut for Drains

•Redundancy – N+1, 2N

•Clearance Around Units (maintenance)

•Outdoor Condensing Units

•Humidity concerns

•Refrigerant preferred over chilled water

Air Conditioning

Rules of Thumb •$800-1000 per KW of electric load. ($1600-2000 for 2N redundancy)

•Footprint up to 20 s.f. each for up to approximately 100 kw.

•18” is minimum preferred height for raised flooring.

Fire Detection


Fire Detection

Design Considerations

•Standard smoke detectors vs. VESDA

•Smoke detectors not required beneath raised floor

Rules of Thumb

•Approx. $150 per device for standard fire alarm system

•Approx. $5/s.f. for VESDA

Fire Suppression


Fire Suppression


•Wet system acceptable – no piping in data center

•FM200 has replaced Halon as agent

Rules of Thumb

•Cost - $35,000 for 1,000 s.f. and $10,000 for each additional 1,000 s.f.

•Need space for control panel and tanks. Plan on 4 s.f. for the tank per 1,000 s.f. of data center.

Security


Security

Design Considerations/Rules of Thumb •Security/Card Access

•Approximately $2,500 per door, including card reader, headend/controller, and door hardware.

Racks


Rack - Enclosures

Design Considerations •Hot aisle – cold aisle lay out

•3’ min. working clearance on both front and back

•Include cable management – vertical /horizontal

•Avoid heat dams caused by cabling in rear of rack

Rack-Enclosures

Rules of Thumb •Costs – Up to $3,500 for specialized racks

•Can include UPS, A/C, and monitoring

•Sizes – 24-32” widths, 30-44” depths

•Cable management can help air flow

Branch Circuits, PDU’s, Strips



Design Considerations •# of servers/circuit/rack – ensure plug strips have enough plugs

•Is monitoring of load on each circuit required? Can be accomplished at panel or at plugstrip. Access info via local readout or by web server

•Branch circuit wiring typically run beneath raised floor.

•Power distribution can be built-in in some racks.

•Blade servers will require a 208 volt feed instead of 120v.

•Dual corded loads and 2N redundancy


Rules of Thumb •Approx. 4-6 1U servers for each 20 amp circuit

•Approx. $350 per 20 amp circuit run from panelboard to rack

•Approx. $300 each for vertical plug strips in rack.

Cable Trays


Cable Trays


•Data cabling overhead – power wiring below

•Wire basket type tray or traditional steel/aluminum ladder type.

•Cabling can be integrated into racks

Rules of Thumb

•$20-$30 per lin. foot cost for basket tray (8”×4”)

•$40-$60 per lin. foot for ladder type tray.

Monitoring

•Design Considerations

Monitoring

Design Considerations •Provide for monitoring/annunciators on critical systems like UPS, generator, fire alarm, fire suppression, air conditioning, and batteries.

•Control panel on equipment is most cost-effective and is typically included with equipment.

•SNMP available for most equipment.

•HTML available for monitoring of most equipment

•Often the first item cut for cost savings.

Raised Floor


Raised Floor

Design Considerations •Adequate space for wiring and air flow. 18” is minimum

•Include grounding of pedestals.

•Ramp will be required for ADA. 1:12 slope means an 18’ ramp is required for 18” raised floor

•Consider depressed slab so ramp is not required

•NEC requires removal of abandoned cable when doing any renovations.

•Include 20% perforated tiles for air distribution in front of racks.

Raised Floor

Rules of Thumb •Approx. $25/s.f. + $5-$10,000 for ramp

General Construction

•Design Considerations •Rules of Thumb •Fees/Permits/Gen. Items


Rules of Thumb •Data center should a have vapor barrier for humidity control.

•What level of security is needed? CMU vs. Stud/Drywall

•Ancillary Spaces Needed? •Staff workstations

•Storage

•Rooms for UPS, Fire suppression, etc


Rules of Thumb •Approximately $150 per s.f. for new construction of the ancillary spaces (outside of data center)

•Approximately $40-$80 s.f. for remodeling existing spaces – new floors, ceilings, lights, etc


Fees/Permits/General Items •If replacing an existing data center, include costs for move/changeover to new location

•Arch/Engr fees – 8-12% of construction costs.

•General Conditions: Mobilization, fees, permits, utilities – by general contractor – 5-10% of construction costs.

•Contingency: include costs for unforeseen conditions. 10% for cost estimates and 3-5% after bidding.

Bidding – A Case Study

•Existing conditions •Program •Location •Costs

Bidding - Costs

- Total Costs

Bidding - Costs

- Total Costs

Electrical Costs

•200 KW Generator $48,000

•Data center PDU’s, branch circuits $ 5,650

•Cable Tray $ 1,300

•Misc. elect costs – lights, outlets, fire alarm $27,350

•80 KW UPS (alternate) $40,600

•Total Electrical $82,300

•$/sq ft Data Center $137/sq ft

•$/sq ft Entire Project $ 62/sq ft.

Bidding - Costs

- Total Costs

Mechanical Costs

•(2) A/C units, 77 KW capacity each - $128,000

•Sprinklers - $ 3,000

•Misc. piping, - $ 9,500

•Total Mechanical - $132,260

•$/sq ft Data Center - $220 /sq ft.

•$/sq ft Entire Project - $ 99 /sq ft.

Bidding - Costs

- Total Costs

General Construction Costs

•Raised floor – 600 sq ft. $21,000

•Walls, doors, flooring, ceilings - $23,000

•Total General Trades - $44,000

•$ /sq ft Data Center - $73 /sq ft

•$ /sq ft Entire Project - $33 /sq ft

Bidding - Costs

- Total Costs

Miscellaneous Costs

•Equipment Racks - $5,000.00 allowance to be purchased direct by IWU.

•Card Access - $2,500.00 allowance for 1 card reader to be purchased direct by owner

Bidding - Costs

- Total Costs

Overhead/Fees/Contingency Costs

•Construction management fees - $21,500

•A/E Design Fees - $28,500

•Contingency - $ 5,800

•Printing, State Fees - $ 1,250

•Total Indirect Costs - $57,050

•$ /sq ft Data Center - $95 /sq ft

•$/sq ft Entire Project - $43 /sq ft.

Bidding - Costs

- Total Costs

Total Construction Costs

•Electrical $ 83,000

•Mechanical $132,260

•General Construction $ 44,000

•Misc. Equipment $ 7,500

•Overhead/Fees/Contingency $ 57,050

•Total $323,810

•$/sq ft data center $540 /sq ft

•$/sq ft total project $243 /sq ft

Thank you!

data_centers - design consideration(1).pdf

Documents