User seeks advice on upgrading dual 3090 setup to run 100-110GB models like DeepSeek V4 Flash
A Reddit user with a dual RTX 3090 setup is looking to upgrade to run larger models (100-110GB+), specifically a usable quant of DeepSeek V4 Flash. They are considering modded 48GB RTX 4090s, RTX A6000s, or RTX 5090s, and want to add to their existing 3090s rather than replace them. The post seeks community input on hybrid GPU configurations.
Entities
Related
User seeks advice on adding second cheap GPU to run larger local models
A Reddit user running Gemma 4 26B-A4B at 12-15 t/s on an RTX 3060 (12 GB) finds the model insufficiently intelligent and wants to upgrade to a 31B model, which runs at only 1.5 t/s. They ask the community about the benefits of adding a second cheap GPU to improve performance for local LLM inference.
Community discusses VRAM requirements and next upgrade from Qwen 3.6 27B
A Reddit user asks how much VRAM is needed and which model is the next major upgrade from Qwen 3.6 27B as of July 2026. The post reflects ongoing community interest in balancing model quality with hardware constraints.
Community shares llama-server configs for 24GB GPUs
A Reddit thread collects proven llama-server startup configurations for 24GB VRAM GPUs (RTX 3090, 7900XTX, RTX 4090). Users are asked to share commands that maximize VRAM usage and provide at least 200,000 tokens KV cache, along with system RAM, OS, and CPU details.
User reports issues loading large MoE models after adding second RTX 3060
A user with dual RTX 3060 GPUs found that large MoE models like Qwen3.5-122B-A10B fail to load, while dense models work. After troubleshooting, they discovered that limiting VRAM usage to 12 layers allows the 122B model to load, and a PC restart plus GPU priority adjustment fixed the 35B model.
Hobbyist builds 1TB VRAM cluster using X99-E-WS motherboard and PEX8749 switch
A hobbyist is assembling a multi-machine GPU cluster using an old X99-E-WS motherboard with seven PCIe x16 slots, aiming for 1TB of total VRAM across three machines. By placing a PEX8749 PCIe switch card in the primary x16 slot, they can run four AMD MI50 GPUs on that switch while freeing three slots for additional cards, achieving an x16/x8/x8/x8/x8/x8/x8 lane configuration.
