Opendesk: MCP + SOM algorithm for AI desktop control via Claude Code
Opendesk is an open-source MCP server that lets AI agents control your entire desktop — mouse and keyboard included — using a custom Self-Organizing Map (SOM) algorithm for improved accuracy. It integrates with Claude Code or any custom agentic harness, enabling real desktop automation workflows.
Key Features
- Desktop Control: Agents can move the mouse, click, and type to interact with any application or website.
- Learn & Replay: Record a sequence of actions (e.g., logging into a dashboard and exporting a report) and replay it later on command.
- Scheduling: Run computer-use tasks automatically at specific times — for example, every morning at 9am open Gmail and summarize unread emails.
Example Commands
- “Open Spotify and play a lofi playlist”
- “Go to Twitter and like the first 3 posts on my feed”
- “Fill out this form on Chrome”
Integration
Works with Claude Code and any custom agentic harness that supports MCP. The SOM algorithm improves click/target accuracy compared to vanilla computer-use implementations.
Get Started
Source and documentation available on GitHub: github.com/vitalops/opendesk
📖 Read the full source: r/ClaudeAI
👀 See Also
Natural Language Autoencoders: Turning Claude's Internal Representations into Text
Transformer Circuits Thread publishes Natural Language Autoencoders that decode Claude's internal activations into readable text. GitHub repo and interactive demo available.
OpenPlawd: OpenClaw Skill for Automated Plaud Meeting Notes
OpenPlawd is an OpenClaw skill that automatically processes Plaud recordings into structured HTML meeting notes. It polls Plaud accounts hourly, transcribes with Whisper or OpenAI, chunks large files, and generates notes with action items via an OpenClaw agent.
Anthropic's Multi-Agent Harness Design for Improving Claude's Code Quality
Anthropic's blog post details a harness design using multiple agents to address Claude's context anxiety and self-evaluation bias, with specific agent roles and scoring criteria for frontend and full-stack development.
DecisionNode: CLI and MCP Server for Semantic Decision Storage
DecisionNode is a local-only CLI and MCP server that stores structured decisions as JSON, embeds them as vectors for semantic search, and makes them accessible across AI tools via MCP. It's MIT licensed and designed to work with Claude Code, Cursor, Windsurf, Antigravity, and other MCP clients.