AgentHandover: Mac menu bar app that creates agent skills by watching your screen

What AgentHandover does

AgentHandover is an open-source Mac menu bar application that watches your screen through Gemma 4 (running locally via Ollama) and turns your repeated workflows into structured Skill files that any agent can follow. The creator built it to avoid having to explain processes from scratch every time they wanted an agent to handle something, even for daily tasks.

Key features and operation

• Two recording modes: Focus Record for specific tasks and Passive Discovery that runs in the background and starts picking up patterns after seeing you repeat something a few times
• Self-improving skills: Skills get sharper with every observation, updating steps, guardrails, and confidence scores as it learns more
• On-device processing: The entire system is an 11-stage pipeline running fully on-device with nothing leaving your machine and data encrypted at rest
• Agent integration: One-click agent integration through MCP (Model Context Protocol) so Claude Code, Cursor, OpenClaw or anything that speaks MCP can pick up your Skills
• CLI available: Includes a command-line interface for terminal users

Technical details

The application uses Gemma 4 running locally via Ollama for screen understanding. It's licensed under Apache 2.0 and available on GitHub. The creator is seeking feedback on the approach and curious about other local vision or OS models for screen understanding.

This type of tool addresses the challenge of transferring human workflows to AI agents without manual documentation. By observing actual screen interactions, it captures the nuances and variations that might be missed in written instructions.