Advanced

Power and Datacenter Constraints

The binding constraint on new GPU capacity in 2026 is not chips or capital but megawatts: an H100 node draws about 10 kW, a GB200 NVL72 rack about 120 kW, and a 100,000-GPU cluster needs on the order of 150 MW with cooling. This page converts GPU counts to power, power to cooling and facility requirements, and both to cost, so a candidate can size a training hall from a power budget and explain why liquid cooling, PUE and the local grid decide where the next cluster goes.

Unlock the full curriculum — ₹2,000 / $25every concept + every answer · 6 months · no auto-renew

RELATED CONCEPTS

TCO: Buy vs Rent Capacity Planning and Utilization GPU Generations: A100 to Blackwell Thermal, Power and Cooling Events Training Cluster Design at 10k GPUs NVLink, NVSwitch and PCIe

PRACTICE THIS IN REAL QUESTIONS

Napkin Math, Cost & CapacityWhat is the power budget for a cluster of 1,024 H100s?→Hardware, Cabling & Cluster Build-OutHow much power does a 512-GPU cluster actually draw, end to end?→Hardware, Cabling & Cluster Build-OutLeadership bought GB300 NVL72 racks. Your datacenter is built for 15 kW cabinets. What do you tell them?→GPU Fleet Reliability & ObservabilityCoolant flow to a rack stops. What happens in the next sixty seconds, and what has to be automatic because a human cannot act in time?→Hardware, Cabling & Cluster Build-OutYour next hardware generation doubles power per rack. Plan the hall's upgrade.→Hardware, Cabling & Cluster Build-OutDesign the cooling for a 40-rack hall of liquid-cooled GPU racks.→