Scrapling integrated as OpenClaw's scraping backbone
Scrapling, an open-source scraping library, has been integrated into OpenClaw as its core scraping backbone. This addresses common issues with AI agents struggling with real-world web data, broken scrapers, Cloudflare walls, and selectors that fail when sites update.
Key features and capabilities
Unlike most scraping tools that rely on hardcoded selectors that break when websites redesign, Scrapling learns the structure of a page and adjusts automatically when things change without requiring code rewrites.
- 774x faster than BeautifulSoup with Lxml
- Works across HTTP and full browser automation
- Supports CSS, XPath, text, and regex selectors
- Async sessions for parallel scraping
- Includes a CLI so non-developers can use it without writing code
Getting started
Installation is straightforward:
pip install "scrapling[ai]"The library is fully open source under a BSD-3 license and has been gaining traction on GitHub.
📖 Read the full source: r/openclaw
👀 See Also
Docent: An AI Assistant for Paper Analysis Built with Claude Code
A developer created Docent, an AI assistant that reads uploaded papers, presents them, answers questions, and assesses understanding using Claude Code. The project is available on GitHub under MIT License with a demo on Vercel.
Claude Session Tracker: Auto-Save Claude Code Sessions to GitHub Issues
A new tool called claude-session-tracker automatically saves Claude Code sessions to GitHub Issues, logging every prompt and response as comments with timestamps. It creates one GitHub Issue per session linked to a Projects board and works through Claude Code's native hook system without consuming context tokens.
Jan-Code-4B: A Lightweight Code-Tuned Model for Local Development
The Jan team released Jan-Code-4B, a 4B parameter code-tuned model based on Jan-v3-4B-base-instruct. It's designed as a drop-in replacement for Haiku in Claude Code, offering improved coding assistance while running locally.
Multi-Agent Content Pipeline for Claude Code with Quality Gates
A developer built a six-agent content pipeline for Claude Code that separates research, writing, editing, and SEO tasks with quality gates between stages. The system halts for manual approval before publishing and allows individual agent re-runs.