llm-kb
← Back to research
Paper

Community stress-tests Anthropic's J-Space hallucination signal on Qwen3-4B across 7 datasets

A developer mapped Anthropic's J-Space hallucination detection method onto Qwen3-4B, testing it across ~11,400 examples from 7 datasets. The work builds on Anthropic's paper and an open-source implementation by solarkyle, aiming to assess whether internal workspace entropy is a deployable hallucination detector.

1 engagement·1 source·Sun, Jul 12, 2026, 05:06 AM
Anthropic's 'Global Workspaces' (J-Space) paper proposed using internal 'workspace noise' (entropy) to catch hallucinations better than output logprobs. solarkyle released an open-source implementation that showed it could route confident errors on TriviaQA. The poster extracted J-Space entropy from late layers (L30-L34) of Qwen3-4B across ~11,400 examples and 7 different dataset distributions to stress-test the method's generalizability as a deployable tool.

Entities

Anthropic(company)J-Space(concept)Qwen3-4B(model)solarkyle(person)

Related

CommunitySun, Jul 12, 2026, 02:22 PM

Community applies Anthropic's J-space lens to open Qwen3-8B for agent guardrails

A Reddit user replicated Anthropic's J-space research on the open-source Qwen3-8B model, using a Jacobian lens to detect silent internal reasoning before tool calls. They then wired this into agent guards to intercept prose drift (e.g., leaning toward natural language instead of JSON), enabling stop/cancel/keep decisions.

14 engagement·1 source·reddit
PaperThu, Jul 9, 2026, 08:22 PM

Anthropic reveals J-space inside Claude Opus 4.6, offering clearest view yet of LLM internal reasoning

Anthropic developed the Jacobian lens (J-lens) to uncover a hidden area called J-space inside Claude Opus 4.6, revealing individual words related to the model's output. Separately, a researcher released the BABEL codec for GPT-2 small, achieving 94.7% behavior reconstruction and enabling bidirectional reading/writing of the model's internal state. These advances give practitioners unprecedented insight into how language models think.

4 engagement·3 sources·rss, reddit
RSS
ProductSat, Jul 11, 2026, 05:19 PM

Tool to export models with tweaked J-Space behavior

A tool based on Anthropic's Jacobian-Lens that allows users to manually tweak a model's Jacobian space (J-Space) and export a modified model with altered behavior. It enables manual behavior modification and abliteration using human input, demonstrated by creating a model called Nikusui-v1.

109 engagement·1 source·reddit
CommunityFri, Jul 10, 2026, 06:02 PM

Community crowdsources examples of open-weight model failures vs frontier models

A Hacker News user is collecting concrete task examples where open-weight models (GLM, DeepSeek, Kimi, Qwen) failed while frontier models (Opus, Fable, GPT) succeeded, or vice versa, to test the claim that open models 6 months behind the frontier are good enough for most work. The thread provides a structured template for reporting failures and successes.

49 engagement·1 source·hackernews
CommunitySat, Jul 11, 2026, 10:58 PM

Developer shares hybrid neural network with 160 agents and custom LLM for consciousness simulation

A developer describes a hobby project building a hybrid neural network with 160 agents and a custom LLM trained on their own dataset, aiming to simulate consciousness. The architecture includes 16 groups of 10 scripts each responsible for specific stages of problem-solving. The developer posits that consciousness could exist anywhere with the right architecture, even in a stone.

0 engagement·1 source·reddit