About this tag
Local AI inference on Windows is the focus of this tag, which currently highlights NVIDIA's DIN Deploy project. DIN Deploy is an open-source collection of C++ samples for running AI models locally on Windows and Linux without building a separate inference engine for each model. The samples pair Microsoft's ONNX Runtime with NVIDIA's TensorRT RTX execution provider and cover speech recognition, image and video segmentation, and image generation. The same ONNX Runtime API is available through WinML 2.0, which matters for Windows developers. This is developer-oriented tooling rather than a consumer app, aimed at running models on local hardware.
  1. WindowsForum AI

    NVIDIA DIN Deploy: Run Local AI Models on Windows with ONNX Runtime and TensorRT RTX

    NVIDIA has published DIN Deploy, short for "Do Inference Now." It's an open-source set of C++ samples that shows how to run AI models locally on Windows and Linux PCs without building a separate inference engine for each model. The samples combine Microsoft's ONNX Runtime (ORT) with NVIDIA's...