RelayCode VS Code Extension Routes Claude Code Through Sovereign RDUs
OpenGPU has released RelayCode, a VS Code extension that acts as a local proxy for AI coding agents. The tool intercepts requests from Claude Code or GitHub Copilot and routes them through the OpenGPU Relay network to open-weight models running on sovereign infrastructure.
Key Details
The extension provides several specific features and performance characteristics:
- Infrastructure: Workloads are routed through Infercom's reconfigurable dataflow units (RDUs), described as dedicated sovereign compute with no US jurisdiction and GDPR compliance by design.
- Performance: Benchmarks show 250+ tokens per second on DeepSeek-R1 (671B) and 400+ tokens per second on MiniMax M2.5. Model switching is near-instant (milliseconds) due to the dataflow architecture.
- Context Management: The extension automatically manages
CLAUDE_AUTOCOMPACTsettings to keep agents within model context windows without crashing. - Privacy: Code stays on the local machine; only inference requests hit the relay network with no data retention.
- Current Status: The team reports about 23 installs and is seeking feedback on relay latency from the community.
- Access: Promo credits are available for testing RDU speeds for free.
The tool is positioned as a way to reduce Anthropic API costs while maintaining Claude CLI workflows, particularly useful for refactoring work.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Lightning MLX: Fast Local AI Engine for Apple Silicon Agentic Use Delivers 220 tok/s on Qwen 35B-A3B
Lightning MLX claims the fastest local AI inference on Apple Silicon, optimized for coding agents and tool calling. Benchmarks show 40.67 tok/s on Qwen3.6-27B and 220.86 tok/s on Qwen3.6-35B-A3B from a MacBook Max M5 (128GB).
Karpathy's autoresearch project: AI agents run overnight LLM training experiments
Andrej Karpathy released a minimal autoresearch project where an AI agent edits train.py, runs 5-minute nanochat training experiments, checks if val_bpb improved, and repeats overnight on a single GPU.
OpenClaw Implements Agent History Compression to Reduce Context Usage
OpenClaw now compresses agent history by replacing completed subtask logs with structured summaries, reducing ~1M tokens to ~30K. The system uses a 4-pass scanner to identify task lifecycles and generates masked summaries that maintain agent compatibility.
Terrarium: Open-Source Sandbox for Agentic Environments with Time Machine Rewind
A versatile sandboxing solution for running multiple AI agents securely on any VPS or cloud. Features isolated worlds, reverse-proxy management, GUIs, and a time machine to rewind container state.