Building a Jarvis-Style AI with MCP and Open Models
A developer on r/LocalLLaMA shared a Jarvis-style AI assistant built using the Model Context Protocol (MCP) and open models. The system is still work in progress but already supports several agentic features.
Key Details
- Memory — persistent context across sessions
- Autonomous file editing — the AI can read and write files on its own
- Visible tool-call tracing — users can see each step the AI takes
- Confirmation before dangerous actions — safety guardrails for destructive operations
- Persistent context — maintains state over time
- Hybrid local/cloud inference — can switch between local and cloud models
The primary model is Qwen3-Coder 480B running in the cloud for reasoning and tool usage, because smaller local models hallucinate too much with MCP workflows. The user is now working on Windows UI automation, dynamic skills, and AI-generated skill creation so the assistant can expand its own capabilities. The goal is a practical AI operator that interacts with and automates the user's computer, not just another chatbot.
Who It's For
Developers experimenting with local AI agents, MCP-based tool use, and autonomous computer automation using open-weight models.
📖 Read the full source: r/LocalLLaMA
👀 See Also
OpenClaw Skill Server for Indian Market Analysis and Trading
An open-source trading terminal for Indian markets has been integrated as an OpenClaw skill server, allowing agents to pull market data and run multi-agent analysis via HTTP. The system provides structured trade plans with entry prices, stop-losses, and targets across three risk profiles.
Mind Keg MCP: Persistent Memory for Claude Code and MCP-Compatible Agents
Mind Keg MCP v0.1.1 is an open-source MCP server that provides persistent memory for Claude Code and other MCP-compatible agents. It stores learnings locally via SQLite and retrieves them via semantic search, allowing AI coding assistants to remember context between sessions.
Need MCP Server Provides Semantic Tool Discovery for AI Agents
An MCP server called Need enables semantic search over 10,000+ tools from brew, npm, pip, and cargo. When an agent requests a task like 'compress these PNGs,' it finds pngquant, installs it, runs it, and reports back on success.
CTOP: Terminal UI to Monitor Claude Code Sessions, Zero Deps
CTOP is a zero-dependency Node.js TUI that shows CPU, memory, context window saturation, token breakdown, and cost estimates for all running Claude Code and Codex sessions.