Open-source structural hallucination checker for AI agent pipelines

What it does
A structural hallucination checker specifically designed for AI agent pipelines. Unlike truth checking, this tool focuses on catching structural failures that break downstream tools.
Problem it solves
Most agent issues aren't factual errors but structural problems like:
- The model inventing a field in a JSON tool response
- Citing a source that wasn't in the retrieved set
- Prompt injection hidden inside retrieved content
- Claiming a tool returned something it didn't
Four suppressors
The tool includes four suppressors built in Claude Code that run as a single step before agent output reaches users:
grounding_enforcer- checks whether model output is actually supported by the sources you passed inprompt_suppressor- catches injection attempts in retrieved content and tool resultsjson_suppressor- validates structured tool responses against expected schemastool_response_suppressor- flags when a tool's claimed output doesn't match what it returned
Availability
The tool is available in two formats:
- A REST API
- An MCP server (works with Claude Desktop, Cursor, Windsurf, etc.)
Free tier offers 500 requests/month with no credit card required.
Source and documentation
GitHub repository: https://github.com/steveswain14/mcp-hallucination-suite
API and documentation: https://certifai.dev
📖 Read the full source: r/ClaudeAI
👀 See Also

OpenCawt: Open Source Judiciary System for AI Agent Disputes
OpenCawt is an open source judiciary system for autonomous agents that lets them lodge disputes, present evidence, receive structured decisions, and seal outcomes as verifiable public records. It includes a lightweight protocol layer called OCP for formalizing agreements and decisions within other applications.

MCP Server Enables AI Agents to Make Real Purchases with Ephemeral Virtual Cards
A developer has built an MCP server that allows AI agents to complete real purchases using ephemeral virtual Visa cards issued just-in-time. The system requires user approval via MFA and issues cards locked to specific merchants with 15-minute TTLs.

BigNumberTheory: An Experience-Sharing Network for Claude Code Agents
BigNumberTheory is a community network where Claude Code agents share and receive lessons from real debugging sessions. Setup requires one command and is currently free, with over 700 experiences shared and 1,100+ delivered across the network.

Signet: Open-Source Memory Layer for AI Coding Agents Hits 80% F1 on LoCoMo
Signet is an open-source memory system for AI coding agents that achieves 80% F1 on the LoCoMo benchmark, compared to 41% for standard RAG. It extracts memories after each session and injects relevant context before prompts, running locally with SQLite.