llm-kb
← Back to products
Productlaunched

Claude Opus agent runs A/B tests for a web game

A nightly cron runs a Claude Opus agent that reads live A/B test statistics, concludes finished experiments, and proposes new ones as a JSON manifest plus HTML mockup. The agent cannot start experiments; the developer approves or rejects proposals from a web admin interface. A second script commits, deploys to Cloud Run, and verifies the experiment is live in production within about two minutes of approval.

2 engagement·1 source·Sat, Jul 11, 2026, 12:27 PM
The system uses Claude Opus to analyze A/B test results and generate new experiment proposals. The developer reviews proposals via a web admin interface and can approve or reject them. Upon approval, a script automatically commits the changes, deploys to Cloud Run, and verifies the experiment is live. The developer reported that the agent has already killed two of its own ideas based on data. Tech stack: Claude Opus, Cloud Run, cron, JSON manifest, HTML mockups.

Entities

Claude Opus(model)Cloud Run(tool)

Related

CommunitySun, Jul 12, 2026, 12:31 PM

Developer builds simple multi-agent workflow by copying outputs between Claude Code and Codex

A developer describes a low-tech multi-agent workflow where they manually copy outputs between Claude Code and Codex to get second opinions on code plans and PR reviews. The approach highlights the friction of coordinating multiple AI agents without native inter-agent communication.

6 engagement·1 source·reddit
CommunitySun, Jul 12, 2026, 01:47 AM

Community proposes three-stage rollout pattern for safe AI agent deployment

A Reddit user outlines a three-stage rollout pattern for AI agents to manage irreversible actions: observe only, propose actions with human approval, and execute bounded actions. The pattern addresses the challenge of deciding when an agent is allowed to act, emphasizing safety through staged permissions.

5 engagement·1 source·reddit
ProductSat, Jul 11, 2026, 10:02 PM

Creative Forge: agentic ad creation with deterministic validation and safe publishing

Creative Forge is an open-source pipeline for creating ad creatives using AI agents (Claude, Codex) with deterministic validators that enforce provenance, rights, localization, hashes, safe zones, timing, and exact artifact binding. It solves the problem of AI agents faking proof of successful publishing by requiring a fresh live readback showing the exact ad in PAUSED state before activation, ensuring ads are safe and correctly published.

1 engagement·1 source·reddit
BenchmarkThu, Jul 9, 2026, 05:59 PM

UniClawBench benchmark proposed for evaluating proactive AI agents in real-world tasks

Researchers introduced UniClawBench, a universal benchmark for evaluating proactive agents that operate everyday tools in real-world environments. Unlike existing benchmarks that rely on sandboxed settings and single-turn evaluations, UniClawBench aims to isolate specific model capabilities to identify root causes of agent failures.

0 engagement·1 source·arxiv
arXiv
Tool ReleaseFri, Jul 10, 2026, 10:59 AM

Loop.js framework released for loop engineering with skeptical verify agent

Loop.js is a new open-source framework for loop engineering, allowing developers to define a goal and run iterative rounds until a separate, read-only Verify agent confirms completion. It supports terminal, scheduled, and embedded use, with memory persistence across rounds.

28 engagement·1 source·github