AIsbf 0.9.8 adds caching, routing improvements, and expanded AI service support
AIsbf (AI Should Be Free) 0.9.8 is an API proxy/router that provides an OpenAI-compatible interface to various AI endpoint services, aiming to make LLM usage more cost-effective. It's multiuser and can scale from small setups to large infrastructure.
Key features in version 0.9.8
- Cache support for Redis, SQLite, MySQL, and file-based storage
- Additional context condensation methods
- Native prompt caching and request caching support
- Faster and improved semantic prompt-based routing for automatic service selection
- Full OAuth2 support for Claude.ai subscribers
- Full OAuth2 support for Amazon Kiro-cli subscribers
- Full OAuth2 support for OpenAI Codex subscribers
- Full support for Kilo.ai subscribers using tokens or OAuth2
- Multiple bug fixes and minor feature additions
This type of tool is useful for developers who work with multiple AI services and want a unified interface while optimizing costs through intelligent routing and caching.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Voxray-AI: Production Go Backend for Real-Time Voice Agent Pipelines
Voxray-AI is a Go backend that chains Whisper → any LLM → TTS into a real-time voice agent pipeline with WebSocket and WebRTC support. It's built for production-grade servers and high-concurrency voice workloads with configurable providers for STT, LLM, and TTS layers.
Claude-switch CLI tool automates switching between Claude Max accounts when hitting usage caps
A developer built claude-switch, a 250-line bash CLI tool that saves and restores Claude Code credentials from macOS Keychain to switch between accounts when one hits usage limits. The tool eliminates browser re-authentication and maintains workflow continuity.
Local Trello-Style Project Manager for OpenClaw Agents
A developer built a local Trello-like project management tool that runs on the same machine as their OpenClaw agent, storing cards as markdown files with YAML frontmatter. The system uses Node.js/Express for the API, React for the UI, and allows the AI agent to read/write files directly on the filesystem.
SkillMesh: MCP-Friendly Router for Large Tool Catalogs Reduces Context Size by 70%
SkillMesh is an MCP-friendly router that retrieves only relevant expert cards for AI agent queries, reducing context size by 70% and improving tool selection. It supports Claude via MCP server, Codex skill bundles, and OpenAI-style function schemas.