Hello and welcome to today’s one-minute tech briefing. If you’ve ever wondered just how many GPUs you can cram into a standard server rack, look no further than Supermicro’s GB300 NVL72. This hyper-dense 4U chassis holds eight NVIDIA H100 SXM5 accelerators with full NVLink connectivity, delivering a staggering 4 petaFLOPS of FP8 performance per unit. Stack ten of these 4U servers in a 42U rack and you end up with 80 GPUs, all cooled and powered within a single footprint. As Craft Computing puts it, “this is as dense as you can get with current-generation GPUs,” packing over 600 kilowatts of power and custom liquid cooling into that one rack. Whether you’re training massive AI models or running large-scale inference fleets, the GB300 NVL72 shows you can truly push a rack to the limit—80 H100s, over 30 terabytes of HBM3 memory, and more compute than many entire data centers used to offer.
Link to Article