Agent Factory: Autonomous System Builds AI Agents from Online Problem Discussions
Agent Factory is an autonomous system that builds AI agents by identifying real-world problems from online discussions. Inspired by Andrej Karpathy's autoresearch pattern, it applies the same "run experiments overnight, keep what works, throw away what doesn't" approach to idea generation rather than ML optimization.
How It Works
The system scrapes Reddit, Hacker News, GitHub, and Twitter for real problems people discuss online. It scores each potential idea on three criteria: demand, market gap, and feasibility. If an idea clears a quality threshold, the system automatically builds a standalone AI agent, validates it works, and commits it. The threshold ratchets up with each build, requiring progressively better ideas.
Practical Implementation
The project consists of three key files:
program.md- Tells Claude Code where to research and what quality bar to hitseed/- A minimal Next.js template with 7 toolsrun.sh- Launches Claude Code headless and auto-restarts on context limits
The system is built with TypeScript, uses MIT licensing, and runs on either OpenRouter or Ollama. It specifically avoids LangChain and CrewAI frameworks. Each generated agent is standalone and can be cloned and run independently.
Example Output
In its first session, the system generated 20 agents including:
freelancer-deduction-finder- For freelancers asking about missed tax deductionswage-rights-advisor- For people confused about overtime exemptionsdata-broker-opt-out- For people overwhelmed by data broker opt-outs
Quality Verification
The system boots each agent, sends a test prompt, and checks if the output is useful. However, the creator acknowledges these are MVPs and some are rough. The primary purpose is idea generation - the creator reviews the shipped agents each morning and selects the most promising one for further development as a real project.
📖 Read the full source: r/ClaudeAI
👀 See Also
Clawmates: OpenClaw, but for Teams
New project brings multi-user OpenClaw deployment with shared knowledge, cost visibility, and admin controls.
Using /probe to catch AI hallucinations before writing code
A developer shares a technique called /probe that forces AI-generated plans to make numbered claims with expected values, then probes the real system to catch discrepancies. The method caught four factual errors in Claude's description of its own JSONL format that would have caused code bugs.
Applying Claude Code's Architecture to Local 9B Models: Key Findings and Optimizations
A developer extracted architectural patterns from Claude Code's leaked source code and applied 10 optimizations to qwen3.5:9b running locally on an RTX 5070 Ti. The key discovery was that qwen3.5:9b has native structured tool_calls, and the biggest limitation for 9B models is self-discipline in knowing when to stop exploring and start producing output.
CLAUDE.md: Drop-in file reduces Claude output tokens by 63%
CLAUDE.md is a single file that cuts Claude output verbosity by approximately 63% without code changes. It targets sycophancy, verbosity, and formatting noise in Claude's responses.