Microsoft Azure has pushed the limits of cloud inference performance: Microsoft reports an aggregated throughput of 1.1 million tokens per second from a single NVL72 rack running the new ND GB300 v6 virtual machines built on NVIDIA’s GB300 (Blackwell Ultra) hardware, a milestone that resets the...