Verbatimeter: lightweight tool for measuring verbatim similarity in text
Verbatimeter is a minimalist, lightweight Python tool that measures verbatim similarity between generated text and source documents. It helps developers of LLM and RAG systems detect hallucinations or unfaithful outputs in real-time by checking how grounded the model's responses are in the provided context.
Visit project ↗Entities
Related
ContextOps: open-source tool to audit and optimize LLM prompt context
ContextOps is an open-source tool that analyzes LLM prompts to detect token waste such as duplicated retrieval chunks, bloated system prompts, oversized conversation history, and repeated tool outputs. It helps developers reduce costs and improve model consistency by auditing what goes into the prompt before inference.
Snitch: deterministic claim verifier for AI agent transcripts
Snitch is a tool that watches AI agent transcript files (Cursor, Claude Code, Codex, Pi, OpenCode) and verifies claims made in prose against actual evidence like tool calls, shell output, filesystem changes, git history, and session context. It uses deterministic regex patterns to extract claims and cross-references them, flagging inconsistencies. It helps developers trust their coding agents by catching when an agent's description doesn't match reality.
Agent Legibility Analyzer: test if AI shopping agents can parse your store
A tool that lets e-commerce store owners check whether AI shopping agents can read and understand their product listings. It uses LLMs to simulate how agents interpret store content, helping merchants optimize their sites for agent-driven shopping.
GPAgent - Automated classroom note-taking from lecture recordings
GPAgent is an automated note-taking tool that downloads course recordings from the HKUST-GZ TRMS platform, converts them to audio, transcribes with Whisper, and uses an LLM to generate summaries, knowledge points, self-test questions, and exam information. It outputs structured notes in Markdown, helping students efficiently review lecture content.
AI Business Visibility Scanner: checks if LLMs recommend your local business
A tool that lets local businesses check whether AI assistants like ChatGPT, Perplexity, and Gemini recommend them when asked for the best provider in their category. It solves the problem of businesses being unaware that AI recommendations can drive customers to competitors, and helps them understand their AI visibility.