Kreuzberg v4.7.0 adds code intelligence for 248 languages and improved markdown extraction
Kreuzberg v4.7.0 is now available. This is a Rust-core document intelligence library that works with Python, TypeScript/Node.js, Go, Ruby, Java, C#, PHP, Elixir, R, C, and WASM.
Code Intelligence and Extraction
The main highlight is code intelligence and extraction. Kreuzberg now supports 248 formats through the tree-sitter-language-pack library. This enables efficient code parsing for direct integration as a library for agents and via MCP. Agents can work with code repositories, review pull requests, index codebases, and analyze source files.
Kreuzberg extracts at the AST level:
- Functions
- Classes
- Imports
- Exports
- Symbols
- Docstrings
with code chunking that respects scope boundaries.
Markdown Quality Improvements
Poor document extraction can lead to issues down the pipeline. The team created a benchmark harness using Structural F1 and Text F1 scoring across over 350 documents and 23 formats, then optimized based on that.
Specific improvements:
- LaTeX: improved from 0% to 100% SF1
- XLSX: increased from 30% to 100% SF1
- PDF table SF1: went from 15.5% to 53.7%
All 23 formats are now at over 80% SF1. The output pipelines receive is now structurally correct by default.
Other Key Features
- New markdown rendering layer and new HTML output support
- OpenWebUI integration as a document extraction backend
- Options for docling-serve compatibility or direct connection
- Unified architecture where every extractor creates a standard typed document representation
- TOON wire format - a compact document encoding that reduces LLM prompt token usage by 30 to 50%
- Semantic chunk labeling
- JSON output
- Strict configuration validation
- Improved security
Availability
Kreuzberg is available on GitHub: https://github.com/kreuzberg-dev/kreuzberg
Kreuzberg Cloud will be out soon - a hosted version for teams that want the same extraction quality without managing infrastructure. More information at: https://kreuzberg.dev
Contributions are welcome.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Drop-in OAuth Provider for Personal FastMCP Servers on All Claude Platforms
A developer created a single-file Python OAuth provider that enables personal FastMCP servers to work on Claude.ai web, mobile, and Desktop platforms without requiring external identity services like Auth0 or Google.
Local semantic search for AI conversations with fastembed and LanceDB
A developer indexed 368K AI conversation messages locally using fastembed for CPU-based embeddings and LanceDB as a serverless vector store, achieving 12ms p50 search latency without API keys.
PocketBot: iOS app uses Claude to generate deterministic JavaScript automations from natural language
PocketBot is an iOS mobile automation app that uses Claude via AWS Bedrock to convert plain-language requests into self-contained JavaScript scripts. The LLM writes the code once, then the deterministic scripts run on schedule in a sandboxed runtime without AI involvement.
Claude Ops: Browser Dashboard for Claude Code Live Status and Subagent Tracking
A free, local macOS browser dashboard that tracks Claude Code session live status, current tool, spawned subagents, and sends OS push notifications when input is needed.