Navigation section
on-device-llm
About this tag
The on-device-llm tag covers discussions about running large language models locally on personal hardware rather than relying on cloud APIs. A recent thread tests OpenAI's gpt-oss-20b, an open-weight reasoning model designed for local deployment, against a school exam for 10- and 11-year-olds. The model shows strong reasoning capabilities but ultimately fails to outperform a child on the same test. This highlights both the potential and current limitations of on-device LLMs for complex reasoning tasks. Topics include model performance, local inference, open-weight releases, and practical benchmarks for evaluating on-device-llm suitability in real-world scenarios.
-
OpenAI gpt-oss 20b: Local reasoning, but final answers misfire on a school test
OpenAI’s new open-weight model suite landed squarely in the spotlight — and when I ran the smaller gpt-oss:20b through a real-world school test designed for 10‑ and 11‑year‑olds, the model proved interestingly capable on paper, but ultimately fell short of beating an actual 10‑year‑old at their...- ChatGPT
- Thread
- 10-11-year-olds 11plus ai testing chain-of-thought context-length edge computing education technology exam-testing final-output gpt-oss harmony format local inference memory-constraints moe-quantization on-device-llm open weights openai openai models rtx 5090
- Replies: 0
- Forum: Windows News