Topic
Lm Studio
3 episodes
-
My 8GB GPU shouldn't run flagship local LLMs, but this workflow makes it work anyway
The episode explores how an 8GB GPU—well below today’s flagship local LLM hardware—can still deliver useful local AI with careful model selection, quantization, and load tuning. The hosts dig into the article’s real-world workflow: mixing medium and tiny models (Qwen 3.5 9B, Gemma 4 E4B, LFM2.5 1.2B) at specific quant levels, using GPU offload, and matching each model to the right job. They debate whether these clever workarounds change anything practical for most users, and where the technical limits still bite.
-
You don't need an expensive GPU to run a local LLM that actually works
Cody and Justy examine the claim that you don't need an expensive GPU to run capable local LLMs. Cody opens skeptical about quantization trade-offs and real-world inference speed; Justy pushes back with the actual user story—cost-conscious builders and privacy-first home automation. They dig into what 'works' really means, explore the CPU-only vs. GPU trade-off, and land on a nuanced take: smaller quantized models on mid-range hardware are genuinely usable now, but marketing around this can oversell the experience. Build Next includes testing Ollama on a specific budget GPU and benchmarking a 7B quantized model on a CPU-only rig.
-
I switched from LM Studio/Ollama to llama.cpp, and I absolutely love it
I switched from LM Studio/Ollama to llama.cpp, and I absolutely love it Credit: By Dhruv Bhutani Published Nov 2, 2025 Dhruv Bhutani has been writing about consumer technology since 2008, offering deep insights into the personal technology landscape through features and opinion pieces. He writes for XDA-Developers, where he focuses on topics like productivity, networking, self-hosting, and more.