tilert

TileRT’s latest NVIDIA B200 results make a narrow but important claim: an eight-GPU B200 server can deliver as much as 494.2 tokens per second to one GLM-5.1 user in SemiAnalysis’ 1,000-token prompt/1,000-token response test, or 340 tokens per second in its 8,000/1,000 scenario. Those are...