A laptop displays AI and cybersecurity interfaces, with glowing data streams connecting to a cloud server.
Computerworld's analysis of the agentic AI PC pitch is mostly a story about money. Cloud token bills are climbing, and vendors are saying the answer is to run more AI on the PC and send only the hard work to the cloud. Microsoft calls this "hybrid intelligence." Nvidia, HP and Perplexity are all pitching versions of it. Before anyone budgets for it, the practical question is how much of the pitch is shipping, how much is still a preview, and what the hardware demands.

A laptop displays AI and cybersecurity interfaces, with glowing data streams connecting to a cloud server. The pitch: the right model at the right moment​

Pavan Davuluri, who heads Windows and Devices at Microsoft, summed up the vision at the company's October 7 event. He said with intelligent routing, powerful local models, and a performant runtime, Windows lets work run in the right place for each task, local or cloud. Satya Nadella described wanting to use computing power wherever it lives, in a seamless flow.

Analysts quoted by Computerworld agree the PC won't replace the cloud:

  • TECHnalysis Research's Bob O'Donnell says frontier cloud models will always be needed for some tasks, but not for everything.
  • J. Gold Associates' Jack Gold forecasts that in three to four years, about 10% to 15% of AI workloads will run on PCs and 40% to 45% in the cloud. These are his estimates, not measured shares. The reporting doesn't say where the remaining workloads would run.
  • Gold also expects a renewed emphasis on buying newer machines.

Microsoft's own framing is budget-driven. In its announcement, Microsoft said customers' needs are outpacing what their cloud budgets can support and that hybrid intelligence is meant to stretch those budgets while preserving access to frontier capabilities.

What "agentic AI PC" means in hardware terms​

Computerworld's definition is a PC that can run agents, generate video, write code and chat with advanced models locally, then hand off whatever it can't handle to the cloud. Nvidia's RTX Spark superchip, which includes a Blackwell GPU, powers many of these machines. Nvidia's Gerardo Delgado argues that older AI PCs couldn't run full models fast enough, and that a true AI PC runs local models while keeping their intelligence level and their economics.

Microsoft's launch materials give the Surface Laptop Ultra specs:

  • Up to 128 GB of unified memory.
  • Up to 1 petaflop of AI performance, which Microsoft's footnote qualifies as theoretical FP4 performance using sparsity.
  • The ability to run models above 120 billion parameters locally.
  • A starting price of $2,599, with availability from October 16.

Microsoft also announced a Surface RTX Spark Dev Box at $5,999, shipping in the U.S. in November. Windows PCs with RTX Spark from ASUS, Dell, HP, Lenovo and MSI were opened for preorder on the same day. DGX Station systems for Windows are planned for later in 2026.

All of these figures are vendor-published, not independent test results. Microsoft's comparison with the MacBook Pro M5 Pro, for example, rests on Microsoft-commissioned testing of preproduction hardware with a specific model and prompt.

The coding demo: 1.6 million tokens in, 10,500 out​

The most concrete example in the Computerworld piece is a GitHub Copilot demonstration. A team couldn't reproduce a bug, so a cloud model analyzed the code. It then delegated building and testing to local sub-agents running MAI Code 1.1 Flash. One sub-agent fed 1.6 million tokens of code and context to the local model, which returned 10,500 tokens. A GitHub product manager gave those figures during the demo, so treat them as illustrative rather than a benchmark. The point is that the bulk of the token traffic never touched a metered cloud API.

Microsoft's technical write-up gives the details behind the model:

  • Architecture: MAI Code 1.1 Flash is a mixture-of-experts model with 137 billion total and 6.8 billion active parameters. Computerworld rounds this to "130 billion."
  • Compression: The on-device version uses quantization and speculative decoding. The quantized model is 53 GB, about 80% smaller than the cloud variant, and keeps a 256K context window.
  • Quality claims: Microsoft reports 70.80% on SWE-Bench Verified and 66.29% on Terminal-Bench 2.1, against 72.6% and 62.9% for the cloud model. The tests were run October 5, 2026, at roughly 3.3 bits per weight on a Windows ARM64 llama.cpp CUDA runtime. Microsoft cautions that results vary by device and configuration.
  • Memory: On Surface Laptop Ultra, peak memory use reaches 75.5 GB at 256K context. A local model that "fits" is not the same as one that runs well on an ordinary business laptop.

How you'll actually use it in GitHub Copilot​

The feature is called HydraFusion. GitHub launched it earlier this year to route each task to the right model in the cloud, and Microsoft is extending it so it can tap into models running locally. The timing matters:

  • Microsoft said hybrid intelligence on Windows powered by HydraFusion is coming to the GitHub Copilot app, GitHub Copilot CLI and Visual Studio Code in experimental preview later in October 2026.
  • That is an experimental preview, not a general release. A WindowsForum analysis of the announcement noted that Microsoft's own wording is "experimental preview", and that no one should plan around a fixed date or assume everyone gets it at once.
  • Broader Copilot features on Copilot+ PCs, including local context, local actions and local models, are described as rolling out over the coming months. Microsoft says timing varies by device, market and silicon.

Microsoft describes two workflows:

  1. Auto orchestration. Copilot decides whether each piece of work uses local or cloud inference.
  2. Explicit local selection. Developers pick MAI Code 1.1 Flash through the Windows ML provider, or point Copilot at an OpenAI-compatible local endpoint.

Local is not the same as offline, or sandboxed​

This distinction is the one IT administrators most need to absorb. Microsoft's engineers state plainly that local inference does not make the session offline in the sense that cloud routing can still occur. They also note that moving inference onto the device doesn't change what an agent's shell commands can reach. Those commands normally inherit the access of the account running them.

Microsoft's answer is Microsoft Execution Containers (MXC), which Microsoft says is now generally available on Windows 11. Details from its documentation:

  • MXC applies policy to processes the agent launches, controlling files, networks, credentials, system capabilities and execution paths.
  • GitHub Copilot on Windows uses the BaseContainer tier of the ProcessContainer backend.
  • Shell commands run inside the boundary. By default, so do local MCP servers and language servers.
  • Built-in file tools are checked by Copilot's harness against policy, but that is not OS-enforced child-process isolation.
  • Remote MCP servers sit outside the local process sandbox.
  • In the Copilot CLI, the /sandbox command lets you configure settings. In the Copilot app, a per-project "Sandbox new sessions" toggle turns sandboxing on by default.

Microsoft also says Windows will use Entra to distinguish agent activity from user activity and extend Agent 365 controls to local agents. It describes that as upcoming, and says governance at scale may require additional services.

The HP and Perplexity example​

HP's ZBook Ultra G3a mobile workstation uses an AMD GPU and ships with Perplexity's Portable Computer service. In HP's Brian Allen's telling, basic work, such as design tasks in Autodesk Revit, runs locally, even without an internet connection. Harder work escalates to one of 19 cloud frontier models. Perplexity has MCP connectors for Revit, and HP links Perplexity's tools from the Windows taskbar.

Allen also says that on-prem operation means customers needn't worry about confidential information going to the cloud, or about $1,000-a-week token bills. Those are HP's claims. Computerworld doesn't report independent validation of the routing, the supported configurations, or the cost savings. Allen himself concedes the market is still forming, and that customers are in a phase of benchmarking the machine on their own RAG models to see how it performs.

The caveats​

Computerworld's reporting lays out the counterweights:

  • Price. The Surface Laptop Ultra starts around $2,600 and reaches $6,000 in top configurations. PCWorld's Mark Hachman argued in his review that a cheaper laptop can do the same job with cloud models, and that the Surface could age quickly as new models arrive.
  • Component costs. Analysts expect PC prices to stay elevated until the end of 2027, partly because of component costs and economic uncertainty.
  • Integration work. Gold says this isn't a matter of installing software. Companies will need to develop and customize models for such PCs, and open-source models could reduce costs and improve ROI.
  • Seamlessness. IDC's Tom Mainelli says using AI across PC and cloud isn't yet seamless. He says many things must happen across component pricing, model evolution and agentic use cases before it reaches average users.

Analysis: what IT teams should take from this​

"Free tokens" are a simplification. Local inference avoids per-call cloud charges, but you pay in hardware, memory, power and management. A cloud model still does the planning in Microsoft's own demo. The saving comes from the ratio. Local sub-agents absorb the heavy, repetitive context reading, and the cloud sees little of it. Whether that ratio holds on your codebase is something only a pilot will show.

Practical steps for administrators and developer leads:

  1. Wait for the experimental preview and test it on a small group of capable machines. Don't plan fleet purchases around it yet.
  2. Size the memory. The quantized MAI Code 1.1 Flash is 53 GB and peaks at 75.5 GB at full context on Microsoft's hardware, so ordinary laptops are unlikely candidates.
  3. Decide the sandbox policy first. Local inference doesn't constrain what an agent's commands can touch. Review MXC settings, and remember that file tools and remote MCP servers sit outside the process sandbox.
  4. Measure on your own workloads. The benchmark numbers are Microsoft's, from its own test configuration.

The direction is clear and the engineering is plausible. Hybrid routing could be a real way to cut token spend. But today it is a premium-hardware, experimental-preview story with unproven economics. The next few months of real-world testing will show whether the pitch holds up.

 

References

  1. The right model at the right moment: Vendors push their agentic AI PC vision - Computerworld Computerworld 2026-10-27T00:14:38+00:00
  2. Bringing local models and sandboxed tools to Windows and GitHub Copilot commandline.microsoft.com
  3. Building Windows for hybrid intelligence | Windows Experience Blog blogs.windows.com