Tencent Hy Team releases Hy3, a 295B-parameter MoE model
Tencent's Hy Team released Hy3, a 295-billion-parameter Mixture-of-Experts (MoE) language model with 21B active parameters and a 3.8B MTP layer. The model outperforms similar-sized models and rivals open-source models with 2-5x parameters. It is available on Hugging Face in full (598GB) and FP8 quantized (300GB) versions.
Entities
Related
Xiaomi quietly uploads MiMo-V2.5-DFlash weights to Hugging Face
Xiaomi has uploaded the official DFlash weights for MiMo-V2.5-DFlash to Hugging Face. The model has 300B+ parameters and runs at 8-10 tokens/second on 2x24GB cards with offloading; DFlash could double that speed. The MTP head was shared but does not work yet.
Community debate: MoE vs dense models — Qwen 3.5 122B example
A Reddit post challenges the common sentiment that a 122B MoE model with 10B active parameters is equivalent to a dense 10B model, arguing that router effectiveness makes MoE more capable. The post questions why providers would release MoE models if they offered no advantage over dense models.
New model with 500K-token context and $2/$6 pricing shifts cost calculus
A model offering a 500,000-token context window at $2 per million input tokens and $6 per million output tokens has been released, drawing attention for its cost-effectiveness. The pricing and context length are seen as significant for applications requiring long-context processing, potentially changing the competitive landscape before benchmark comparisons are even made.
Developer compresses GLM-5.2 MoE to run on single RTX 3090 via 79 experiments
A developer conducted 79 experiments to compress GLM-5.2, a 337 GB MoE model with 75 sparse layers and 256 routed experts, to fit on a 24 GB RTX 3090. The approach uses per-expert codecs, a batch pipeline over all MoE layers, and a patched llama.cpp runtime that loads codec-native expert binaries at inference time. The MIT-licensed repository documents the method and findings on expert similarity.
Community member extends Gemma 4 to 40.5B parameters via layer insertion
A Reddit user, TOTORONG, successfully extended Google's Gemma 4 31B model to 40.5B parameters by inserting additional layers, releasing the result as extGemma4-40_5B on Hugging Face. The project builds on previous attempts documented in earlier posts, overcoming challenges where new inserted layers initially degraded performance. This demonstrates community-driven model customization and fine-tuning techniques.
