/tags/vscode/ Recent content in Vscode on Hendrickx Consulting /images/papermod-cover.png /images/papermod-cover.png Hugo en-us Hendrickx Consulting Thu, 23 Jul 2026 00:00:00 +0000 /posts/local-llm-snapdragon-npu/ Thu, 23 Jul 2026 00:00:00 +0000 /posts/local-llm-snapdragon-npu/ <p>I picked up a Surface with a Snapdragon X Elite chip partly because of the on-device AI story. The NPU has 45 TOPS of compute, and Microsoft markets these devices specifically around local AI workloads. What I found when I actually tried to run a local LLM is that most of the popular tools completely ignore the NPU. Ollama runs on CPU only on ARM Windows. LM Studio does too, despite advertising GPU acceleration. The NPU just sits idle.</p>