Scrapling integrated as OpenClaw's scraping backbone
Scrapling, an open-source scraping library, has been integrated into OpenClaw as its core scraping backbone. This addresses common issues with AI agents struggling with real-world web data, broken scrapers, Cloudflare walls, and selectors that fail when sites update.
Key features and capabilities
Unlike most scraping tools that rely on hardcoded selectors that break when websites redesign, Scrapling learns the structure of a page and adjusts automatically when things change without requiring code rewrites.
- 774x faster than BeautifulSoup with Lxml
- Works across HTTP and full browser automation
- Supports CSS, XPath, text, and regex selectors
- Async sessions for parallel scraping
- Includes a CLI so non-developers can use it without writing code
Getting started
Installation is straightforward:
pip install "scrapling[ai]"The library is fully open source under a BSD-3 license and has been gaining traction on GitHub.
📖 Read the full source: r/openclaw
👀 See Also
Rowboat: Open-Source AI Coworker with Knowledge Graph Memory
Rowboat is an open-source app that transforms your work into a living knowledge graph, storing data locally as Markdown, and offering AI-driven local assistance.
Nanocode: Training Claude-like coding agents with JAX on TPUs
Nanocode is a JAX library for training Claude-like coding agents end-to-end, using Constitutional AI and TPU optimization. The 1.3B parameter model can be trained in ~9 hours for $200 on TPU v6e-8.
LLM Architecture Gallery: Visual Reference for Model Designs
Sebastian Raschka's LLM Architecture Gallery collects architecture figures and fact sheets from The Big LLM Architecture Comparison and A Dream of Spring for Open-Weight LLMs, with detailed specs for models like Llama 3 8B, DeepSeek V3, and Gemma 3 27B.
Local MCP Memory System with Consolidation for AI Conversations
A developer built an MCP server that provides persistent local memory for AI clients, using Qwen 2.5-7B to consolidate conversations into structured knowledge documents every 6 hours. The system runs entirely on your hardware with semantic dedup, adaptive scoring, and FAISS vector search.