BotCost.dev: Free Analyzer to See How Much AI Bots Cost Your Site
BotCost.dev is a free analyzer that lets you paste your Nginx, Apache, Cloudflare, or Vercel log file and immediately see which AI bots are crawling your site and exactly how much bandwidth they're burning. No account, no upload — everything stays in your browser.
How it works
- Drop your log file — supports access.log, access.csv, or vercel-logs.json. All processing is client-side.
- Analyze — the tool matches each request against 18 known bot fingerprints including GPTBot, ClaudeBot, Bytespider, CCBot, and Perplexity. It calculates the estimated bandwidth cost in dollars.
- Block — outputs a ready-to-paste WAF rule for Cloudflare, Nginx, Next.js, or a robots.txt snippet. Copy and deploy instantly.
Key numbers from the source
- 38% of all web traffic is now non-human, mostly AI scrapers.
- For a typical site with 50k visitors/month, AI bots cost an estimated $180/month in bandwidth.
- BotCost verification latency is <10ms, running at Cloudflare's edge with zero impact on real users.
Why this matters
If you run a site with public content, bots like GPTBot and ClaudeBot can rack up significant bandwidth costs. This tool gives you a concrete dollar figure so you can decide whether to block them. The one-line WAF rule approach means you can stop the bleeding in minutes without complex configuration.
📖 Read the full source: HN AI Agents
👀 See Also
AI Doomsday Toolbox v0.932 adds benchmarking, dataset creation, and agent workspace for Android local AI
AI Doomsday Toolbox v0.932 introduces benchmarking for local LLMs on Android devices, a dataset creator that converts text/PDF files to Alpaca JSON format, and an AI agent workspace with Termux integration. The update also includes subtitle burning with Whisper and built-in Ollama management tools.
Meta Ads MCP OAuth Works But Most Ad Accounts Not Enabled Yet
Meta Ads MCP OAuth flow works and loads 29 tools, but ads_get_ad_accounts returns is_ads_mcp_enabled: false with a message that the feature is gradually rolling out.
git-courer: An MCP Server That Forces AI Agents to Write Proper Git Commit Messages
git-courer is a local MCP server in Go that intercepts diffs from AI coding agents and translates them into structured, human-readable commit messages with WHY and WHAT sections.
Developer shares solution for Claude AI ignoring rules beyond 50-count threshold
A developer reports Claude Code started silently dropping rules once their shared rule set exceeded approximately 50 items, particularly during frontend-heavy tasks. They built a hook that scans prompts and loads only 2-3 relevant rules based on keyword matching.