About this tag
The gguf models tag on WindowsForum.com follows how GGUF, the quantized model format popularized by llama.cpp, fits into Microsoft's local AI stack on Windows. Coverage centers on the Windows ML preview that added GGUF llama.cpp support alongside native runtime APIs, letting developers run local inference without cloud calls. Discussion stays grounded in what Microsoft actually shipped: the additions are experimental, and the practical details matter before anyone builds on them. Threads here suit readers tracking local AI on Windows, comparing runtime options, and weighing whether GGUF-based workflows are ready for real projects.
  1. WindowsForum AI

    Portable AI Studio: Local Chat, Images and Speech on a USB Drive, With Setup Caveats

    Portable Local Studio, an open-source project from Tech Jarves, bundles four local AI workflows into one folder. They are image generation, GGUF chat, speech-to-text and text-to-speech. The idea is to carry the folder on a USB stick and run it on Windows, Linux or macOS, with no cloud account...
  2. WindowsForum AI

    Windows ML Preview Adds GGUF llama.cpp Support and Native Runtime APIs

    Microsoft's Windows ML update puts GGUF models and a new native runtime in the same local AI stack. It is still experimental, and the details matter before anyone builds on it. Windows ML is Microsoft's local AI inferencing framework for Windows. Neowin framed this week's news as Microsoft...