Scrapling Web Scraping
Zero-bot-detection web scraping for OpenClaw. Bypass Cloudflare, handle JavaScript-heavy sites, and adapt to website changes automatically. Use when you need...
Zero-bot-detection web scraping for OpenClaw. Bypass Cloudflare, handle JavaScript-heavy sites, and adapt to website changes automatically. Use when you need...
Real data. Real impact.
Emerging
Developers
Per week
Open source
Skills give you superpowers. Install in 30 seconds.
Zero-bot-detection web scraping for OpenClaw. Bypass Cloudflare, handle JavaScript-heavy sites, and adapt to website changes automatically.
# Install Scrapling pip install "scrapling[all]" scrapling installBasic usage
python3 /root/.openclaw/skills/scrapling-web-scraping/scrapling_tool.py https://example.com
Bypass Cloudflare
python3 /root/.openclaw/skills/scrapling-web-scraping/scrapling_tool.py https://protected-site.com --mode stealth --cloudflare
Extract specific data
python3 /root/.openclaw/skills/scrapling-web-scraping/scrapling_tool.py https://example.com --selector ".product-title"
JavaScript-heavy sites
python3 /root/.openclaw/skills/scrapling-web-scraping/scrapling_tool.py https://spa-app.com --mode dynamic --wait ".content-loaded"
Basic scraping:
"用Scrapling抓取 https://example.com 的标题和所有链接"
Bypass protection:
"用隐身模式抓取 https://protected-site.com,绕过Cloudflare"
Extract data:
"抓取 https://shop.com 的商品名称和价格,CSS选择器是 .product"
Dynamic content:
"抓取 https://spa-app.com,等待 .data-loaded 元素加载完成"
# Basic scraping from scrapling.fetchers import Fetcher page = Fetcher.get('https://example.com') title = page.css('title::text').get()Bypass Cloudflare
from scrapling.fetchers import StealthyFetcher page = StealthyFetcher.fetch('https://protected.com', headless=True, solve_cloudflare=True)
JavaScript sites
from scrapling.fetchers import DynamicFetcher page = DynamicFetcher.fetch('https://spa-app.com', headless=True, network_idle=True)
| Feature | Command | Description |
|---|---|---|
| Basic Scrape | | Fast HTTP requests |
| Stealth Mode | | Bypass Cloudflare/anti-bot |
| Dynamic Mode | | Handle JavaScript sites |
| CSS Selectors | | Extract specific elements |
| JSON Output | | Machine-readable output |
python3 scrapling_tool.py https://quotes.toscrape.com --selector ".quote .text" --json
python3 scrapling_tool.py https://nopecha.com/demo/cloudflare --mode stealth --cloudflare
python3 scrapling_tool.py https://spa-app.com --mode dynamic --wait ".loaded" --json
python3 scrapling_tool.py URL [options]Options: --mode {basic,stealth,dynamic} Scraping mode (default: basic) --selector, -s CSS_SELECTOR Extract specific elements --cloudflare Solve Cloudflare (stealth mode only) --wait SELECTOR Wait for element (dynamic mode only) --json, -j Output as JSON
Create custom scraping scripts in
/root/.openclaw/skills/scrapling-web-scraping/:
from scrapling.fetchers import StealthyFetcherYour custom scraper
def scrape_products(url): page = StealthyFetcher.fetch(url, headless=True) products = [] for item in page.css('.product'): products.append({ 'name': item.css('.name::text').get(), 'price': item.css('.price::text').get(), 'link': item.css('a::attr(href)').get() }) return products
scrapling install to download browsersCreated: 2026-03-05 by 老二 Source: https://github.com/D4Vinci/Scrapling
No automatic installation available. Please visit the source repository for installation instructions.
View Installation Instructions1,500+ AI skills, agents & workflows. Install in 30 seconds. Part of the Torly.ai family.
© 2026 Torly.ai. All rights reserved.