← Previous · All Episodes · Next →
Unleashing the Powerhouse Inside Your Rack with Supermicro's GB300 NVL72 Episode

Unleashing the Powerhouse Inside Your Rack with Supermicro's GB300 NVL72

· 01:20

|

Hello and welcome to today’s one-minute tech briefing. If you’ve ever wondered just how many GPUs you can cram into a standard server rack, look no further than Supermicro’s GB300 NVL72. This hyper-dense 4U chassis holds eight NVIDIA H100 SXM5 accelerators with full NVLink connectivity, delivering a staggering 4 petaFLOPS of FP8 performance per unit. Stack ten of these 4U servers in a 42U rack and you end up with 80 GPUs, all cooled and powered within a single footprint. As Craft Computing puts it, “this is as dense as you can get with current-generation GPUs,” packing over 600 kilowatts of power and custom liquid cooling into that one rack. Whether you’re training massive AI models or running large-scale inference fleets, the GB300 NVL72 shows you can truly push a rack to the limit—80 H100s, over 30 terabytes of HBM3 memory, and more compute than many entire data centers used to offer.
Link to Article


Subscribe

Listen to jawbreaker.io using one of many popular podcasting apps or directories.

Apple Podcasts Spotify Overcast Pocket Casts Amazon Music
← Previous · All Episodes · Next →