Npu

I picked up a Surface with a Snapdragon X Elite chip partly because of the on-device AI story. The NPU has 45 TOPS of compute, and Microsoft markets these devices specifically around local AI workloads. What I found when I actually tried to run a local LLM is that most of the popular tools completely ignore the NPU. Ollama runs on CPU only on ARM Windows. LM Studio does too, despite advertising GPU acceleration. The NPU just sits idle. ...