Local LLMs on Strix Halo: new models, same limits
Updated local LLM benchmarks on my Framework Desktop. Useful speeds, but quantized models on a desktop are still far from frontier capabilities.
October 28, 202611 min read AI
local AI
Strix Halo
GPUs
infrastructure
benchmarks
Valérian de Thézan de Gaussan
