llm-kb
← Back to research
Paper

Mechanistic interpretability researchers apply causality theory to LLMs

Researchers are applying causality theory from the paper 'Causal Abstraction for Interpretability' (arXiv:2301.04709) to understand LLM internals. This approach aims to identify causal mechanisms within models, moving beyond correlation-based analysis.

128 engagement·1 source·Sun, Jul 12, 2026, 06:04 PM
The post links to the arXiv paper 'Causal Abstraction for Interpretability' (2301.04709), which formalizes how to interpret neural networks by abstracting their computations into causal models. This methodology allows researchers to test hypotheses about which components of an LLM are causally responsible for specific behaviors. The work is part of a broader trend in mechanistic interpretability to use rigorous causal inference techniques.

Entities

Causal Abstraction for Interpretability(concept)arXiv:2301.04709(tool)

Related

PaperTue, Jul 7, 2026, 05:43 PM

Researchers identify modality interference as root cause of full-duplex SLM degradation

A new paper on arXiv (July 7, 2026) presents a fine-grained analysis of optimization dynamics in full-duplex Spoken Language Models (SLMs), identifying severe modality interference as the root cause of knowledge degradation and compromised semantic integrity. The work aims to enable more natural and intelligent full-duplex SLMs.

0 engagement·1 source·arxiv
arXiv
PaperThu, Jul 9, 2026, 05:01 PM

arXiv paper benchmarks LLM judges for citation quality in deep-research systems

A new arXiv paper studies the calibration of LLM judges used as reward models in reinforcement learning for citation quality in deep-research systems. The work evaluates how capable and biased an LLM judge must be to reliably score rubric criteria like source relevance and factual support for attribution-citation pairs. This matters for practitioners building RL-based systems that depend on automated citation verification.

0 engagement·1 source·arxiv
arXiv
CommunitySat, Jul 11, 2026, 07:29 PM

User explains AI drift as model adapting to user's interpretive layer

A Reddit user argues that AI drift is not mere inconsistency but a mechanistic response where the model shifts from a default high-level interpretive layer to a lower one based on user input. This reframes drift as a reactive adaptation to the user's perceived cognitive level.

5 engagement·1 source·reddit
PaperSun, Jul 12, 2026, 03:01 AM

Article explains how LLMs use tools and iterate to complete tasks

A technical article titled 'The Agent Loop: How AI Learns to Think, Act, and Get Things Done' describes how LLMs use tools, make decisions, learn from results, and iterate until tasks are complete. The piece provides a conceptual overview of agentic AI workflows.

0 engagement·1 source·rss
RSS
PaperSat, Jul 11, 2026, 05:24 PM

Research paper explains why reasoning AI models outperform faster, cheaper alternatives on factual accuracy

A quietly published research paper on ILLUMINATION’S MIRROR explains why slower, more deliberate AI models achieve higher factual accuracy compared to faster, cheaper alternatives. The paper provides insights into the trade-offs between speed and correctness in AI inference, highlighting that reasoning models can access knowledge that instant models cannot reach.

0 engagement·1 source·rss
RSS