MCP Slim: Local Embedding Search for MCP Tools Reduces Context Bloat
MCP Slim is a proxy tool that addresses MCP's context bloat problem by replacing full tool catalogs with three meta-tools: search, describe, and call. Instead of loading all tool definitions upfront, the LLM searches for what it needs, reducing context window usage by 96%.
Key Details
The tool specifically targets MCP's documented context bloat issue where connecting a few servers can consume 55,000+ tokens on tool definitions before the first message. MCP Slim's main differentiator from other proxies like mcp-compressor and MCProxy is its use of semantic search with a local MiniLM embedding model. This allows it to find relevant tools without keyword overlap - for example, "save a note" can find create_entities.
The tool runs fully offline and requires no API keys. It works with any stdio MCP client including Claude Desktop, Cursor, Cline, Windsurf, and Zed.
Installation and Setup
Installation is done via: npx mcp-slim init
The GitHub repository is available at: https://github.com/dopatools/mcp-slim
The author (/u/OpportunitySpare2441) has offered to answer questions about the architecture or tradeoffs.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Multi-provider LLM fallback chain with Ollama support in production AI IDE
Resonant Genesis AI IDE integrates local LLM support as a first-class provider alongside Groq, OpenAI, Anthropic, and Gemini across 30+ microservices using a shared UnifiedLLMClient library with automatic fallback chain.
Sonicker: Voice Cloning Web App Built with Claude Code in 4 Days
Sonicker is a voice cloning web app that requires only 3 seconds of audio input and supports 10 languages. The developer built it solo in 4 days using Claude Code for the entire frontend, API integration, and deployment.
Open-source MCP suite improves Claude Code generation quality by 15-20%
An open-source MCP suite consisting of three local servers and a prompt skill addresses the 'bad token' problem in AI code generation, with one customer reporting 15-20% quality improvement for Claude Code.
RUNE Protocol: Save AI Session Memory Across Platforms
RUNE (Relational User Notation for Entities) is an open-source protocol that saves your AI relationship to an encrypted .rune file, solving the cold-start problem where AI assistants forget you between sessions. Created with Claude Opus 4.6, it works across Claude and GPT platforms.