rawq: Local CLI Tool for AI Agent Semantic Code Search
What rawq does
rawq is a local CLI tool that helps AI agents find relevant code without reading entire files. It uses semantic search to guide AI agents to specific code parts instead of whole files, letting them use read/grep on the right files. The tool is not RAG nor a replacement for read/grep.
Technical implementation
rawq uses a 33MB local model by default that works via ONNX runtime for semantic search, combined with BM25 lexical search via tantivy. The tool supports tree sitter code chunking for 16 languages and works on any GPU thanks to ONNX with DirectML, CUDA, or CoreML, with automatic CPU fallback.
Performance and features
In testing, AI agents that were using rawq consumed 4x fewer tokens and completed tasks 2x faster compared to blind read/grep tools. rawq also has a map command that shows the structure of a codebase.
Development details
The tool is written in Rust, fully open-source, and released under MIT license. It's available on GitHub at https://github.com/auyelbekov/rawq.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Multi-LLM Paper-Trading Bot with Claude Opus as Lead Engineer and Gemini as Strategist: Architecture Breakdown
A solo builder shares a 4,900-LOC paper-trading bot on Alpaca where Claude Opus 4 (Engineer) has veto power over Gemini Pro (Strategist), with a 270+ entry disagreement log called the Strategist Codex.
Needle: A 26M Parameter Function-Calling Model That Runs at 6000 tok/s on Mobile
Cactus open-sources Needle, a 26M parameter model for single-shot function calling, achieving 6000 tok/s prefill and 1200 tok/s decode on consumer devices. Built with Simple Attention Networks (no FFNs), it beats several larger models on tool-use benchmarks.
Open-source Specialist Dispatch adapter delegates complex tasks to Claude Code
expert-dispatch is a ~500-line bash script that lets a cheap AI assistant delegate complex coding tasks to Claude Code CLI. It uses commands like dispatch-cc run to send tasks and maintains per-project directories with CLAUDE.md for persistent context.
ClawProxy: Self-Hosted AI Routing Proxy with Dashboard
ClawProxy is an open-source, self-hosted proxy that centralizes management of multiple AI API keys and models. It provides a unified endpoint, smart key rotation, provider fallback, and real-time logging via a React dashboard.