Developer trains 113M-parameter earthquake LLM from scratch
A developer trained a 113M-parameter language model specifically for earthquake-related text, building it from scratch. The project, shared on GitHub, demonstrates a focused application of LLMs in geoscience.
Entities
Related
Software engineer publishes final part of LLM-from-scratch series covering inference and decoding
A software engineer published the fourth and final part of a blog series explaining LLMs from the ground up, focusing on token-by-token generation, KV cache, and decoding strategies (temperature, top-k, top-p). The series aims to help other software engineers understand the internals of LLMs.
Text LLM training from scratch with PyTorch
A clean, readable codebase that implements the full LLM training pipeline (pretraining, SFT, DPO, GRPO/RL) using only PyTorch primitives, avoiding high-level abstractions. It helps developers understand the underlying math and mechanics of LLM training.
Interactive app teaching LLM pipeline from pattern matching to transformer training
An interactive web app that walks through every stage of the LLM pipeline, from basic pattern matching to training a transformer from scratch. It includes working code that users can run locally, making it an educational tool for developers and learners.
Developer seeks feedback on fine-tuning LoRA for conversation state extraction in long LLM chats
A developer is working on a side project to improve AI conversation continuity by training a small model to extract structured conversation state from chat chunks, rather than relying on summarization. They are seeking feedback on their approach involving fine-tuning a LoRA, dataset design, and long-context systems.
Article explains how LLMs trigger real-world actions despite being next-token predictors
An article published on July 11, 2026, explains how large language models, which are fundamentally next-token predictors, can trigger real-world actions like fetching weather, running calculators, or searching the web. It addresses the common confusion about how a model trained only to predict the next word can perform tasks it has no direct ability to do.