AI agent that controls PC by watching screen
Rosply is an AI agent that takes over a user's mouse and keyboard by capturing screenshots, sending them to a vision model, and executing actions like clicking, typing, scrolling, and dragging. It works without APIs or browser extensions, enabling tasks such as web browsing, file summarization, and coding in VS Code via voice commands.
Visit project ↗Entities
Related
Open-source private desktop AI overlay with MCP support
Wisp is a desktop overlay that lets you invoke AI from any app via keyboard shortcuts, with context like text, screenshots, or active window. It supports voice queries, dictation, and pasting results directly, keeping data local and private.
StepGrab: Mac app that turns screen recordings into step-by-step guides with AI-written text
StepGrab is a Mac app that records a user's screen task and automatically generates a numbered step-by-step guide with screenshots and written steps. It uses on-device Apple Intelligence to write natural descriptions for each step, solving the problem of creating documentation from screen recordings without manual effort.
Physical desk creature that mirrors AI agent status and accepts approvals via button press
A small hardware device that sits under a monitor and displays the status of AI coding agents (busy, needs approval, idle, celebrating) using colored lights. Users approve or deny agent tool calls by pressing the device, making agent interaction more tangible and engaging.
AI photo editor with text prompt editing
An AI-powered photo editor that lets users perform professional-grade image editing using text prompts. It uses LLMs to interpret natural language instructions and apply edits accordingly, solving the problem of complex manual editing for casual users and professionals alike.
Harness engineer reports easy creation of complex AI agents for multi-step automation
A harness engineer on Reddit describes how they can now create agents in hours that automate long, multi-step workflows, including generating an AI video series where each character is sourced from five different models. The post highlights the growing accessibility of agentic AI for practical automation.