#local llm

3 articles found

Sep 19, 2026

Prism: Fixing Foundry Local and Unifying ONNX & Ollama on Linux & WSL2

Foundry Local promised high-speed ONNX inference, but the official CLI was an unusable minefield on WSL2. I built Prism — an open-source, multi-engine local AI CLI and OpenAI server that unifies ONNX Runtime GenAI and Ollama.

#AI #Foundry #Ollama #local llm +7

Sep 19, 2026

Ollama vs MS Foundry Local: Benchmarking Local LLMs on an RTX 5070

Following up on Foundry Local in VS Code, I wanted hard numbers. I built Ollama BenchRig to benchmark llama.cpp against ONNX Runtime GenAI on real developer workloads.

#AI #Foundry #Ollama #local llm +6

Aug 20, 2026

Foundry Local Chat — bringing local models into VS Code's chat picker

I run Foundry Local for the obvious reasons: no cloud round-trip, no API key, no per-token bill. What I didn't have was a way to use those downloaded models fro

#AI #Foundry #local llm #LLM +2