AI generates playable arcade games as a subjective evaluation benchmark
AI Arcade is a platform where AI models generate playable arcade games, serving as a subjective evaluation benchmark. It tests creative and functional capabilities of LLMs by having them produce complete game experiences. The target audience is AI researchers and developers seeking qualitative assessments of model performance.
Visit project ↗Related
UniClawBench benchmark proposed for evaluating proactive AI agents in real-world tasks
Researchers introduced UniClawBench, a universal benchmark for evaluating proactive agents that operate everyday tools in real-world environments. Unlike existing benchmarks that rely on sandboxed settings and single-turn evaluations, UniClawBench aims to isolate specific model capabilities to identify root causes of agent failures.
Machine Beater: 5-question head-to-head guessing game against LLMs
A game where a human and an LLM each ask 5 yes/no questions to guess a hidden answer, inspired by 20 Questions. The goal is to benchmark reasoning skills not captured by standard benchmarks, with planned model-model and human-model matchups.
Car soccer game built with AI assistance
A car soccer game built using Claude Fable 5, demonstrating AI's ability to rapidly prototype games. The developer created the game in hours and shared the code on GitHub for others to test.
LLM comparison dashboard for quality, latency, and cost
A dashboard that lets users test LLMs on their own data, comparing quality, latency, and cost side by side. It runs on Nebius Serverless and helps developers choose the best model for their specific use case rather than relying on leaderboards.
Eli Felse: a framework for safer autonomous AI assistants
Eli Felse is a framework designed to explore safer ways to create autonomous AI assistants. It uses LLMs to power an AI agent that can play games, chat, browse the web, and perform creative tasks, all while demonstrating safety measures. The framework is aimed at researchers and developers interested in building safer autonomous agents.