on-device llms

On-device LLMs are small language models designed to run AI workloads locally on Windows 11 PCs, using CPUs, GPUs, and NPUs without relying on cloud servers. Microsoft's Aion 1.0 Instruct and Aion 1.0 Plan, announced at Build 2026, exemplify this approach, enabling tasks like instruction following and planning directly on the device. This shift aims to make Windows a platform for local AI infrastructure, enhancing privacy and reducing latency. Discussions on WindowsForum cover the implications for enterprise IT, security, and developer APIs, focusing on how on-device LLMs integrate with Windows 11 to support agent-era applications while keeping data processing on the PC.