datacentres

Cheaper inference is changing how organisations build AI systems, but it is not yet evidence that hyperscale datacentre GPUs are headed for an absolute decline. Smaller models, task-aware routing, specialised inference chips and on-device execution can all reduce the compute needed for an...