LLM-as-judge eval misses 3% of users due to unseen output format
A developer recounts how their CPO mandated LLM eval automation using GPT-4o as a judge with an 8-dimension rubric. After three months of success, a system prompt tweak caused the judge to miss a completely different output format for 3% of users, leading to undetected regressions discovered via support tickets.
Entities
Related
Developer asks community for agent evaluation practices, cites silent breakage
A developer building AI agents reports that prompt or MCP changes often break silently despite passing manual tests. They ask the community about evaluation methods, including fixed test cases, skill-level vs. end-to-end checks, and tools like DeepEval, LangSmith, and Ragas.
User discovers that describing desired output quality outperforms step-by-step instructions in prompts
A Reddit user reports that shifting from detailed step-by-step instructions to describing the desired outcome (e.g., 'a great version would make a busy person understand the tradeoff in ten seconds') dramatically improves LLM output quality. The post highlights that models are better at navigating to a well-defined finish line than following clumsy instructions.
Developer discovers chatbot quality degrades after 5 turns
A developer reports that their chatbot, which passes quality evals on short interactions, gradually loses context after about 5 turns, forgetting user constraints and contradicting itself. This highlights a common limitation in current conversational AI systems.
arXiv paper benchmarks LLM judges for citation quality in deep-research systems
A new arXiv paper studies the calibration of LLM judges used as reward models in reinforcement learning for citation quality in deep-research systems. The work evaluates how capable and biased an LLM judge must be to reliably score rubric criteria like source relevance and factual support for attribution-citation pairs. This matters for practitioners building RL-based systems that depend on automated citation verification.
OpenAI analysis reveals flaws in SWE-Bench Pro coding benchmark
OpenAI published an analysis uncovering reliability issues in SWE-Bench Pro, a popular benchmark for evaluating AI coding models. The findings raise concerns about the accuracy of benchmark scores, potentially affecting how developers and researchers trust model evaluations.