Nvidia to boost AI server racks to megawatt scale, increasing power
Nvidia is developing a new power infrastructure called the 800V HVDC architecture to deliver the power requirements of 1 MW server racks and more, with plans to deploy it by 2027.
The 800V HVDC can deliver 1 MW to a server rack. Nvidia is developing a new power infrastructure called the 800V HVDC architecture to deliver the power requirements of 1 MW server racks and more, with plans to deploy it by 2027.
Cooling systems aren't the only thing that needs to change to enable 1 MW racks. Power supply systems are another critical component. Flex is currently working on 400 volt (V) direct current (DC) systems, and Butler said it's already eyeing 800V DC and even 1500V DC for the future.
When Flex President Chris Butler started talking about the imminent reality of 1 megawatt (MW) racks in an interview this week, it sounded like an echo. That's because just two days before LiquidStack's Head of Strategy Angela Taylor mentioned the same thing. According to Butler, they're coming soon.
While the power consumption of a typical datacenter rack might fall somewhere between 5 kW to about 30 kW, the explosion in the use of servers stuffed with power-hungry GPU accelerators has seen this figure rise to 100 kW or more, with Nvidia's DGX GB200 NVL72 system pushing 120 kW.
.PDF includes complete article with source references.
Download UPS datasheets, battery sizing guides, and power redundancy white papers.
Via Monte Rosa, 91
20149 Milan, Italy
Italy (Sales): +39 06 8745 3292
Italy (Support): +39 335 729 8537
Mon-Fri: 9:00 AM – 6:00 PM (CET)