For those who want a GUI, LM Studio does this too (with llama.cpp as the backend...

reverius42 64 days ago | parent | context | favorite | on: Running local models on an M4 with 24GB memory

For those who want a GUI, LM Studio does this too (with llama.cpp as the backend I think). I'm getting great (albeit slow) results with Qwen3.6-35B MoE on 8GB GPU RAM, 40GB system RAM.