llm-kb
← Back to research
Paper

Anthropic reveals J-space inside Claude Opus 4.6, offering clearest view yet of LLM internal reasoning

Anthropic developed the Jacobian lens (J-lens) to uncover a hidden area called J-space inside Claude Opus 4.6, revealing individual words related to the model's output. Separately, a researcher released the BABEL codec for GPT-2 small, achieving 94.7% behavior reconstruction and enabling bidirectional reading/writing of the model's internal state. These advances give practitioners unprecedented insight into how language models think.

4 engagement·3 sources·Thu, Jul 9, 2026, 08:22 PM
On 6 July 2026, Anthropic published a paper introducing the Jacobian lens (J-lens), a technique that revealed a hidden area called J-space inside Claude Opus 4.6 (released February 2026). J-space contains individual words related to the model's likely output, providing the clearest glimpse yet into LLM internal reasoning. Separately, on 11 July 2026, a researcher released the BABEL codec for GPT-2 small, claiming the first complete, certified decode of everything happening inside a production language model. The codec achieves 94.7% behavior reconstruction at every layer depth and text regime tested, and allows both reading the model's internal state into English and writing English back into the model. All materials are open-source, including paper, lexicon, grammar tables, decoder/encoder weights, reproduction scripts, and a demo. These developments give practitioners concrete tools to understand and potentially control model behavior.

Entities

Anthropic(company)Jacobian lens(tool)J-space(concept)Claude Opus 4.6(model)BABEL codec(tool)GPT-2 small(model)Jacobian lens (J-lens)(tool)

Related

CommunitySun, Jul 12, 2026, 02:22 PM

Community applies Anthropic's J-space lens to open Qwen3-8B for agent guardrails

A Reddit user replicated Anthropic's J-space research on the open-source Qwen3-8B model, using a Jacobian lens to detect silent internal reasoning before tool calls. They then wired this into agent guards to intercept prose drift (e.g., leaning toward natural language instead of JSON), enabling stop/cancel/keep decisions.

14 engagement·1 source·reddit
PaperThu, Jul 9, 2026, 07:07 PM

Anthropic explains LLM's challenge in distinguishing own thoughts from user input

Anthropic published a technical explanation of how LLMs like Claude perceive conversation as a single continuous text stream, making it difficult to distinguish between their own generated text and user input. The post uses a snapshot of Claude's response to illustrate the problem, highlighting the fundamental difference between the structured chat interface users see and the raw token sequence the model processes.

0 engagement·1 source·rss
RSS
Model ReleasefeaturedFri, Jul 10, 2026, 05:25 PM

OpenAI releases GPT-5.6 with Sol model, claims to outperform Claude Fable

OpenAI released GPT-5.6 on July 10, 2026, featuring a new Sol model that reportedly surpasses Anthropic's Claude Fable on benchmarks. The release was covered by Fireship on YouTube, noting the timing and performance claims.

14.2k engagement·1 source·youtube
PaperSun, Jul 12, 2026, 05:06 AM

Community stress-tests Anthropic's J-Space hallucination signal on Qwen3-4B across 7 datasets

A developer mapped Anthropic's J-Space hallucination detection method onto Qwen3-4B, testing it across ~11,400 examples from 7 datasets. The work builds on Anthropic's paper and an open-source implementation by solarkyle, aiming to assess whether internal workspace entropy is a deployable hallucination detector.

↑ Updated Sun, Jul 12, 2026, 05:06 AM Stress-test results across 7 datasets posted on Reddit.

1 engagement·1 source·reddit
CommunitySat, Jul 11, 2026, 11:44 PM

Software engineer publishes final part of LLM-from-scratch series covering inference and decoding

A software engineer published the fourth and final part of a blog series explaining LLMs from the ground up, focusing on token-by-token generation, KV cache, and decoding strategies (temperature, top-k, top-p). The series aims to help other software engineers understand the internals of LLMs.

3 engagement·1 source·reddit