Colibrì 744B-Parameter Model Runs on a Laptop
A new 744-billion-parameter model named Colibrì has been released, capable of running on a laptop. The model's name and parameter count suggest a focus on efficiency despite its large size.
Entities
Related
User runs 100B+ MoE LLMs on low-end laptop using NVMe swap and Q3 quantization
A Reddit user with a low-spec laptop (i7-8750H, 20GB RAM, GTX 1050 4GB) reports successfully running 100B+ parameter MoE models by offloading parameters to a Samsung NVMe SSD via mmap, using Q3 quantization and quantized KV cache (Q4_0). They note that dense models are unusable on their hardware, but MoE models work with experts offloaded to CPU.
User tests GLM 5.2 on consumer hardware, finds performance comparable to Claude and GPT
A user tested GLM 5.2 on a standard computer and was impressed by its capabilities and security, finding them similar to Claude or GPT. They began converting the model to int4 and exploring MTP usage to avoid out-of-memory errors.
Conw.ai: lightweight self-learning AI with personality
Conw.ai is a 500M parameter AI model that runs locally on an iMac. It features self-learning capabilities and a distinct personality, aiming to provide a conversational AI that can adapt and engage users in a more natural way.
LLM hardware recipe database with filters and community usage tracking
A community-driven database that lists which LLM models run on which hardware, with performance details. Users can filter by hardware, submit new recipes, and mark which recipes they actively use to show popularity. It solves the problem of finding compatible model-hardware combinations for LLM deployment.
Hobbyist game designer shares impressions of 5.6 Sol model
A hobbyist game designer reports using the 5.6 Sol model as the primary driver for co-developing a mobile game alongside GPT, Claude, and Gemini. They were 25% through development when 5.6 Sol released and found its coding, idea generation, and reasoning impressive.