Productbuilding

Open-source phone agent using HDMI capture and USB HID control

Aiden is an open-source hardware project that treats a phone as a black box, capturing screen output via HDMI and sending input back via USB HID. It runs a vision/agent loop on a Luckfox Pico Zero board with Buildroot Linux, enabling automation without installing software on the phone. The project is seeking feedback on this design approach.

open-source usb hid phone automation hdmi capture hardware vision agent

3 engagement·1 source·Sun, Jul 12, 2026, 03:43 PM

The prototype captures phone screen output via HDMI, processes it with a vision/agent loop, and sends input back to the phone via USB HID. It runs on a Luckfox Pico Zero board using Buildroot Linux. The project is open-source and currently in the building phase, with the poster asking for skeptical feedback on the design.

Entities

Aiden(concept)Luckfox Pico Zero(tool)Buildroot Linux(tool)

Tool ReleaseThu, Jul 9, 2026, 06:25 PM

OpenLive launches as open-source live voice and vision AI assistant

OpenLive is an open-source, on-device voice and vision AI assistant that provides real-time speech and sight capabilities. It serves as an open alternative to proprietary services like ElevenLabs, Gemini Live, and OpenAI Realtime, allowing users to bring their own model.

41 engagement·1 source·github

ProductSun, Jul 12, 2026, 12:55 AM

AI agent that controls PC by watching screen

Rosply is an AI agent that takes over a user's mouse and keyboard by capturing screenshots, sending them to a vision model, and executing actions like clicking, typing, scrolling, and dragging. It works without APIs or browser extensions, enabling tasks such as web browsing, file summarization, and coding in VS Code via voice commands.

4 engagement·2 sources·reddit

ProductSun, Jul 12, 2026, 06:47 AM

On-device Android AI agent with MCP server for UI control

Aura is an on-device AI agent for Android that can interact with the phone's UI — tapping, typing, scrolling, launching apps, and navigating — using its own on-device MCP server. It uses LLMs to interpret commands and execute actions via MCP tools. The MCP server is also accessible to external clients like Claude Code, enabling remote control of the Android device. This solves the problem of automating phone tasks without cloud dependency.

0 engagement·1 source·reddit

ProductSat, Jul 11, 2026, 06:55 PM

Luna OS: AI-powered desktop assistant for local use

Luna OS is an AI-powered desktop application that acts as a local assistant. It uses LLMs to provide useful assistance directly on the user's machine, aiming to be a practical alternative to cloud-based assistants. Built for a hackathon, it targets developers and users who want an AI assistant that runs locally.

3 engagement·1 source·reddit

ProductSat, Jul 11, 2026, 08:46 PM

Physical desk creature that mirrors AI agent status and accepts approvals via button press

A small hardware device that sits under a monitor and displays the status of AI coding agents (busy, needs approval, idle, celebrating) using colored lights. Users approve or deny agent tool calls by pressing the device, making agent interaction more tangible and engaging.