Prompt-pruning layer for long-running LLM conversations released on GitHub
A deterministic, zero-dependency prompt-pruning layer for long-running LLM conversations has been released on GitHub. It expires stale tool state, collapses duplicate context, and provably never drops a fact a later turn still depends on.
Entities
Related
ContextOps: open-source tool to audit and optimize LLM prompt context
ContextOps is an open-source tool that analyzes LLM prompts to detect token waste such as duplicated retrieval chunks, bloated system prompts, oversized conversation history, and repeated tool outputs. It helps developers reduce costs and improve model consistency by auditing what goes into the prompt before inference.
Shared Selective Persistent Memory Architecture Proposed for Agentic LLMs
A new arxiv paper introduces shared selective persistent memory, an architecture that identifies and retains four categories of reusable context (task specifications, data schemas, tool configurations, and tool-use patterns) for agentic LLM systems. This approach aims to solve the context problem where each session starts from zero, while avoiding token-inefficient naive persistence of entire conversation histories. The work is relevant to developers building multi-turn code generation agents.
Show HN: Latent-free ternary LLM training
A GitHub project introduces a method for training ternary LLMs without latent states, potentially reducing memory and computation. The approach is shared on Hacker News for community feedback.
Two papers propose token-adaptive KV cache compression for long-context LLMs
Two arXiv papers from July 7, 2026 introduce token-adaptive KV cache compression methods for long-context LLM inference. DepthWeave-KV factorizes key/value states across neighboring layers using shared low-rank bases with token-specific residuals. FreqDepthKV uses shared low-frequency depth components and sparse high-frequency residuals, with an online probe assigning attention heads to different cache modes. Both aim to reduce memory bandwidth while preserving retrieval and reasoning quality.
Show HN: UATC-Closed-loop VRAM control and dynamic data pruning for LLM training
A GitHub project introduces UATC, a closed-loop VRAM control and dynamic data pruning system for LLM training. The tool aims to optimize memory usage and training efficiency by dynamically adjusting VRAM allocation and pruning data during training.