bad-ass-mcp: Free, Open Source MCP for Native Desktop GUI Control via Accessibility API
bad-ass-mcp is an MCP server that gives AI agents direct control over your desktop using the operating system's native accessibility layer. Unlike Anthropic's Computer Use or OpenAI's Operator, it doesn't rely on screenshot-based look-move-look cycles, and unlike UiPath, it's free and open source.
How it works
Instead of parsing screenshots, bad-ass-mcp uses the same accessibility API that screen readers use. This means it can navigate, point, click, and type faster and more reliably than vision-based approaches. The developer notes that WebView frameworks (Electron, Tauri, etc.) have poor accessibility exposure, but the tool still works — and is faster than taking a screenshot. They are pushing projects to improve accessibility support, which also benefits visually impaired users.
Key capabilities
- Control GUI applications across macOS, Windows, and Linux
- Interact and test GUI apps autonomously
- Streamline workflows across multiple apps and workstations
- Record and save video of its own actions (as shown in the demo video)
Example use cases
The developer plans to demonstrate organizing b-roll by shot type in Adobe Premiere Pro and color grading in DaVinci Resolve. The tool recorded itself and saved the video in a simple demo.
Who it's for
Developers using AI coding agents who need to automate desktop GUI tasks without expensive enterprise tools or slow screenshot-based approaches.
📖 Read the full source: r/ClaudeAI
👀 See Also
Local AI VS Code extension blocks insecure code generation during saves
A developer built a VS Code extension that runs llama3.1:8b-instruct-q4 locally to intercept saves, map source-to-sink execution flows, and block AI-generated insecure code like CWE-117 Log Injection vulnerabilities.
yoyo: Local MCP Server for Grounded Codebase Reads and Guarded Writes with Claude Code
yoyo is an open-source local MCP server that provides coding agents like Claude Code with grounded repository reads and guarded writes across 16 languages, including Rust, Go, Python, and TypeScript. It prevents broken edits from silently landing by returning machine-readable guard_failure output and enabling retry_plan for targeted repairs.
Claude Code fails silently when ANTHROPIC_API_KEY is set in cloud environments
Setting ANTHROPIC_API_KEY in cloud environments causes Claude Code to malfunction and may incur unexpected API usage charges. Users report extra usage and unresponsive behavior.
Traversable Skill Graph for Persistent AI Agent Memory in Codebases
A developer built a three-layer skill graph system that lives inside a codebase, enabling AI coding assistants to maintain persistent memory across sessions. The system uses progressive disclosure with self-directing instructions instead of monolithic context files.