Crawl4AI Web Scraper

Full web page scraping with JavaScript rendering via local Crawl4AI instance, delivering clean markdown or detailed JSON including links and media.

New

Join 0+ developers using this skill

skill

Browser Automation

intermediate

0 installs

View Source

Last updated: April 23, 2026

AI Skill Market Insights

Real data. Real impact.

Popularity

Rising

Emerging

Active Users

Developers

Quick Start

Manual Installation

No automatic installation available. Please visit the source repository for installation instructions.

View Installation Instructions

TEAR & SHARE

3-5hrs/WK

RISING

0.0K+ USING

Crawl4AI Web Scraper

Local Crawl4AI instance for full web page extraction with JavaScript rendering.

Endpoints

Proxy (port 11234) — Clean output, OpenWebUI-compatible

Returns:
```
[{page_content, metadata}]
```
Use for: Simple content extraction

Direct (port 11235) — Full output with all data

Returns:

{results: [{markdown, html, links, media, ...}]}

Use for: When you need links, media, or other metadata

Usage

# Via script
node {baseDir}/scripts/crawl4ai.js "url"
node {baseDir}/scripts/crawl4ai.js "url" --json

Script options:

```
--json
```
— Full JSON response

Output: Clean markdown from the page.

Configuration

Required environment variable:

```
CRAWL4AI_URL
```
— Your Crawl4AI instance URL (e.g.,
```
http://localhost:11235
```
)

Optional:

```
CRAWL4AI_KEY
```
— API key if your instance requires authentication

Features

JavaScript rendering — Handles dynamic content
Unlimited usage — Local instance, no API limits
Full content — HTML, markdown, links, media, tables
Better than Tavily for complex pages with JS

API

Uses your local Crawl4AI instance REST API. Auth header only sent if

CRAWL4AI_KEY

is set.

Crawl4AI Web Scraper

AI Skill Market Insights

Quick Start

Manual Installation

TEAR & SHARE

Tags

AgentGo Cloud Browser

browse

Be Part of the 0+ Developer Community

Crawl4AI Web Scraper

Endpoints

Usage

Configuration

Features

API

Computer Use

Fastest Browser Use

ClearWeb

Channels

Learn

Compare

Company