User seeks advice on adding second cheap GPU to run larger local models
A Reddit user running Gemma 4 26B-A4B at 12-15 t/s on an RTX 3060 (12 GB) finds the model insufficiently intelligent and wants to upgrade to a 31B model, which runs at only 1.5 t/s. They ask the community about the benefits of adding a second cheap GPU to improve performance for local LLM inference.
Entities
Related
User seeks advice on upgrading dual 3090 setup to run 100-110GB models like DeepSeek V4 Flash
A Reddit user with a dual RTX 3090 setup is looking to upgrade to run larger models (100-110GB+), specifically a usable quant of DeepSeek V4 Flash. They are considering modded 48GB RTX 4090s, RTX A6000s, or RTX 5090s, and want to add to their existing 3090s rather than replace them. The post seeks community input on hybrid GPU configurations.
Community shares budget local LLM build guide for ~$3K total
A Reddit user posted a detailed guide for building a local LLM rig for about $3,000, recommending ~$2K in GPUs and ~$1K for the rest of the system. The post, written without LLM assistance, argues this offers the best price-to-performance for running models locally in mid-2026.
Community shares llama-server configs for 24GB GPUs
A Reddit thread collects proven llama-server startup configurations for 24GB VRAM GPUs (RTX 3090, 7900XTX, RTX 4090). Users are asked to share commands that maximize VRAM usage and provide at least 200,000 tokens KV cache, along with system RAM, OS, and CPU details.
User reports issues loading large MoE models after adding second RTX 3060
A user with dual RTX 3060 GPUs found that large MoE models like Qwen3.5-122B-A10B fail to load, while dense models work. After troubleshooting, they discovered that limiting VRAM usage to 12 layers allows the 122B model to load, and a PC restart plus GPU priority adjustment fixed the 35B model.
Community discusses VRAM requirements and next upgrade from Qwen 3.6 27B
A Reddit user asks how much VRAM is needed and which model is the next major upgrade from Qwen 3.6 27B as of July 2026. The post reflects ongoing community interest in balancing model quality with hardware constraints.