Three open-source alternatives to litellm after PyPI supply chain attack
litellm versions 1.82.7 and 1.82.8 on PyPI were compromised with credential-stealing malware in a supply chain attack. For developers using AI coding agents who need to migrate, here are three open-source alternatives mentioned in the source.
Bifrost
Described as the most direct litellm replacement currently available. Written in Go, it claims ~50x faster P99 latency than litellm. Licensed under Apache 2.0 and supports 20+ providers. Migration from litellm requires only a one-line base URL change.
Kosong
An LLM abstraction layer open-sourced by Kimi and used in Kimi CLI. More agent-oriented than litellm, it unifies message structures and provides async tool orchestration with pluggable chat providers. Supports OpenAI, Anthropic, Google Vertex, and other API formats.
Helicone
An AI gateway with strong analytics and debugging capabilities. Supports 100+ providers. Heavier than Bifrost or Kosong but more feature-rich on the observability side.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Configuring OpenClaw for Encrypted LLM Inference Using TEE Enclaves
A developer shares how they configured OpenClaw to use Onera's AMD SEV-SNP trusted execution environments for end-to-end encrypted LLM inference, including configuration examples and technical tradeoffs.
Declawed: An Advanced Community-Driven Malware Scanner for ClawHub SKILL.md Files
Declawed is a security tool for scanning SKILL.md files on ClawHub, detecting prompt injection, malicious content, and info stealers, utilizing community-driven rulesets.
LLMs can identify anonymous forum users with 68% accuracy at 90% precision
Researchers used Gemini and ChatGPT to analyze posts from Hacker News and Reddit, identifying 68% of anonymous users with 90% precision. The models completed in minutes what would take humans hours or be impossible.
Fil-C Makes setjmp/longjmp and ucontext Memory Safe
Fil-C implements setjmp/longjmp and ucontext APIs without stack corruption or dangling pointers, preventing common misuse that leads to crashes or exploits.