rawq: Local CLI Tool for AI Agent Semantic Code Search
What rawq does
rawq is a local CLI tool that helps AI agents find relevant code without reading entire files. It uses semantic search to guide AI agents to specific code parts instead of whole files, letting them use read/grep on the right files. The tool is not RAG nor a replacement for read/grep.
Technical implementation
rawq uses a 33MB local model by default that works via ONNX runtime for semantic search, combined with BM25 lexical search via tantivy. The tool supports tree sitter code chunking for 16 languages and works on any GPU thanks to ONNX with DirectML, CUDA, or CoreML, with automatic CPU fallback.
Performance and features
In testing, AI agents that were using rawq consumed 4x fewer tokens and completed tasks 2x faster compared to blind read/grep tools. rawq also has a map command that shows the structure of a codebase.
Development details
The tool is written in Rust, fully open-source, and released under MIT license. It's available on GitHub at https://github.com/auyelbekov/rawq.
📖 Read the full source: r/LocalLLaMA
👀 See Also
devopsiphai: Open-source Claude Code skill audits operational health across 6 phases
devopsiphai is an open-source Claude Code skill that audits production project operability using a 6-phase process and ARC framework, outputting letter grades and a structured TODO.md with effort-estimated tasks.
OmniCoder-9B fine-tune shows strong performance for agentic coding on 8GB VRAM systems
A Reddit user tested OmniCoder-9B, a fine-tune of Qwen3.5-9B on Opus traces, with OpenCode and reported 40+ tokens per second speeds using Q4_K_M GGUF quantization at 100k context length on an 8GB VRAM system.
Cull: Open-Source Dataset Curation Engine for AI Image Pipelines
Cull scrapes images from 340+ sources including Civitai, X/Twitter, Reddit, Discord, and booru sites, classifies them with a vision-language model via local LM Studio or Groq, and sorts into category folders with SD prompts and audit records.
Bypassing NemoClaw Sandbox Isolation for Local Nemotron 9B Agent
A developer bypassed NemoClaw's sandbox isolation to run a fully local agent using Nemotron 9B with tool calling on a single RTX 5090. The approach involved iptables configuration, a custom TCP relay, and real-time tool call translation.