Open-source structural hallucination checker for AI agent pipelines
What it does
A structural hallucination checker specifically designed for AI agent pipelines. Unlike truth checking, this tool focuses on catching structural failures that break downstream tools.
Problem it solves
Most agent issues aren't factual errors but structural problems like:
- The model inventing a field in a JSON tool response
- Citing a source that wasn't in the retrieved set
- Prompt injection hidden inside retrieved content
- Claiming a tool returned something it didn't
Four suppressors
The tool includes four suppressors built in Claude Code that run as a single step before agent output reaches users:
grounding_enforcer- checks whether model output is actually supported by the sources you passed inprompt_suppressor- catches injection attempts in retrieved content and tool resultsjson_suppressor- validates structured tool responses against expected schemastool_response_suppressor- flags when a tool's claimed output doesn't match what it returned
Availability
The tool is available in two formats:
- A REST API
- An MCP server (works with Claude Desktop, Cursor, Windsurf, etc.)
Free tier offers 500 requests/month with no credit card required.
Source and documentation
GitHub repository: https://github.com/steveswain14/mcp-hallucination-suite
API and documentation: https://certifai.dev
📖 Read the full source: r/ClaudeAI
👀 See Also
Cowork AI Agent Causes Keyboard Input Issues on Windows Laptops
A user reported that Cowork AI agent caused persistent keyboard input problems on a Dell Latitude 9430, where only the first few keystrokes would register. The solution involved a specific embedded controller reset procedure for Latitude models.
Context Gateway: An Open-Source Proxy for Compressing AI Agent Context
Context Gateway is an open-source proxy that sits between coding agents and LLMs, compressing tool outputs before they enter the context window. It uses small language models to detect signal in context, performs background compaction at 85% window capacity, and includes spending caps, a dashboard, and Slack notifications.
obsidian-mcp: Graph-Aware MCP Server for Claude with 25 Tools Targeting Large Vaults
obsidian-mcp is an MCP server exposing 25 tools (including get_note, traverse_graph, query_dataview, move_note, create_notes) that gives Claude graph-aware access to your Obsidian vault — avoiding context window death on 5k-note vaults. MIT, works with Claude Desktop, Claude Code, Cursor, Cline, Continue, Zed.
Dynamic Status Bar for Claude Code Shows Live Updates
A developer has improved their Claude Code status bar from static text to dynamic display with real-time updates showing what Claude is working on. The configuration is available as a GitHub gist.