Holaboss AI Runtime Moves to TypeScript, Implements Persistent MCP Ports

A Reddit user analyzed the Holaboss AI local agent runtime repository, highlighting two significant engineering improvements for developers working with local LLM stacks like Ollama, llama.cpp, and LM Studio combined with MCP (Model Context Protocol).

TypeScript-Only Packaging

The runtime has been moved entirely to TypeScript. The API layer, runner orchestration, workspace MCP hosting, and packaging now all live in TypeScript. This means the packaged runtime no longer ships Python source code or Python dependencies. For local/self-hosted stacks, this results in a smaller bundle, fewer moving pieces, and less cross-language drift.

Persistent MCP Port Management

The runtime has eliminated hardcoded MCP port math. Instead, ports are now persisted in SQLite with a UNIQUE(port) constraint and (workspace_id, app_id) as the key. The runner merges prepared MCP servers during bootstrap. This approach ensures that local sidecars come back on stable, collision-resistant ports across restarts, replacing the typical "13100 + i guesswork" method.

The analysis suggests that as local models improve, the focus shifts from model quality to harness quality. Packaging, sidecar lifecycle, local service discovery, and runtime state become critical factors in determining whether a local agent stack feels solid in practice.

The repository is available at: https://github.com/holaboss-ai/holaboss-ai