Data Center Planning

1
Data Center Planning

• Space
• Power
• Cooling
• Data Connections Capacity

Density

Redundancy
2
Typical Space Usage
40 Equipment
60 Support
3
Our Space Usage (A100)
4
How can we make more space?

• Curtail current usage
• Shrink bulky systems, for example
• Converting Unix timesharing machines to blades
  makes room for 40 new 2U servers
• SAN-itizing storage makes room for 75 new 2U
  servers
• Relocate non-critical and development equipment
  to A82 or B7
• Relocate UPS, HVAC equipment
• Create more space
• Add more racks
• Utilize idle, underused space in A100 (ACIS area,
  tape library)
• Rearrange existing functions
• Printing
• Repair/Staging
• Colocation
• Build out B level -- Probably cost-prohibitive at
  1,000/sq ft.

5
Power

• Watts (single phase)
• W Volts x Amps
• Apparent Power (3 phase)
• kVA V x Avg Amps x v3
• Real Power (3 phase)
• kW kVA x Power factor ( lt 1)

6
Power Density
7
Watts/Sq Ft Of Server Floor Space
8
Other trends in computer technology

• Disks migration to 2.5 form factor
• Greater manufacturer focus on heat
• Multi-core processor chips
• On-chip power management
• More exotic heat sinks, airflow
• Water cooling
• Denser blade servers (16 blades/2U today)
• More composite hosts (clusters/grids)

9
(No Transcript)
10
CYH Data Center Demand Densities (A100A84)
Device Anything that consumes rack space and
power (Computer, disk, switch, UPS)
11
(No Transcript)
12
Power Density
13
(No Transcript)
14
(No Transcript)
15
CYH Emergency Electrical Power Budget
Estimated normal load 500 550 kVA
Generator capacity 625 kVA (500 kW)
16
Capacity How much power?
17
Redundancy How much?
Multiplier depends on topology
18
(No Transcript)
19
A100 Power Distribution
20
How can we add more power capacity?

• No upgrade to building transformer
• Emergency (Generator UPS)
• Increase UPS, PDU capacities
• Increase generator capacity
• Increase panel sizes, feeder capacity
• Strategies
• Separate computer, HVAC loads for power quality
• Begin removing non-critical equipment from
  emergency power to manage emergency capacity
• Install pathway for future growth
• Replacing distribution infrastructure is costly
  and disruptive

21
Emergency Cooling

• Actual Loads
• Servers
• Disks
• Networking equipment
• Water pumps
• HVAC (chillers, Edpacs)
• Humidifiers
• Emergency lighting
• Life safety equipment
• Sunlight
• Power distribution (PDU, UPS)
• Equipment inefficiencies
• People

• Supply Dependencies
• Chiller capacity
• Generator capacity
• Pipe diameter
• Chilled water temperature
• Circulating pump gpm
• Chilled water pressure
• Fan cfm

Power In (kW) Heat Out (BTUs) 1 kW 3,412
BTUs 1 kW requires 160 cfm for 20 ?T 1 Ton
requires 3 gpm of chilled water
22
How can we add more cooling capacity?

• Emergency chiller and generator must be upgraded
  together as critical load increases
• Options for upgrading HVAC capacity
• As needed, per rack, using Lieberts Xtreme
  Density supplemental cooling products more
• As needed, per pair of rows, using APCs
  NetworkAIR IR products more
• Entire room capacity may be upgraded by adding
  additional CRAC units, up to 60 T each
• All options supplement existing HVAC
• All options can be added incrementally, by
  rack(s)
• One high-density project does not break entire
  room

23
(No Transcript)
24
Data Connections

• How many systems?
• Types of network connections
• Primary
• Redundant
• Storage
• Cluster heartbeat
• Management
• Console
• Other?

25
(No Transcript)
26
(No Transcript)
27
Data Center Projections(A100 A84)