Hobbyist builds 1TB VRAM cluster using X99-E-WS motherboard and PEX8749 switch
A hobbyist is assembling a multi-machine GPU cluster using an old X99-E-WS motherboard with seven PCIe x16 slots, aiming for 1TB of total VRAM across three machines. By placing a PEX8749 PCIe switch card in the primary x16 slot, they can run four AMD MI50 GPUs on that switch while freeing three slots for additional cards, achieving an x16/x8/x8/x8/x8/x8/x8 lane configuration.
Entities
Related
Community shares llama-server configs for 24GB GPUs
A Reddit thread collects proven llama-server startup configurations for 24GB VRAM GPUs (RTX 3090, 7900XTX, RTX 4090). Users are asked to share commands that maximize VRAM usage and provide at least 200,000 tokens KV cache, along with system RAM, OS, and CPU details.
User seeks advice on upgrading dual 3090 setup to run 100-110GB models like DeepSeek V4 Flash
A Reddit user with a dual RTX 3090 setup is looking to upgrade to run larger models (100-110GB+), specifically a usable quant of DeepSeek V4 Flash. They are considering modded 48GB RTX 4090s, RTX A6000s, or RTX 5090s, and want to add to their existing 3090s rather than replace them. The post seeks community input on hybrid GPU configurations.
User benchmarks AMD EPYC 9374F for LLM inference, finds 48-thread sweet spot
A user replaced their EPYC 9135 with a cheap 9374F (8 CCDs) for LLM inference. Initial benchmarks showed no decoding advantage until they used 48 threads; 64 or 32 threads performed worse than the 9135 in some scenarios. The 9374F is worse for gaming.
User tests LLMs on Intel 285HX CPU-only mini-PC, finds Llama-Swap incompatible with SYCL
A user set up a homelab server on an MS-02 mini-PC with an Intel Core Ultra 285HX and 64GB RAM, testing Qwen3, Qwen3.6, and Gemma4 via Llama.cpp. They found Llama-Swap's quick swapping helpful but incompatible with SYCL, complicating testing. The post shares early impressions of running LLMs on a CPU-only system.
User seeks advice on adding second cheap GPU to run larger local models
A Reddit user running Gemma 4 26B-A4B at 12-15 t/s on an RTX 3060 (12 GB) finds the model insufficiently intelligent and wants to upgrade to a 31B model, which runs at only 1.5 t/s. They ask the community about the benefits of adding a second cheap GPU to improve performance for local LLM inference.