Deep Scraper

Performs deep scraping of complex sites like YouTube using containerized Crawlee, extracting validated, ad-free transcripts and content as JSON output.

New

Join 0+ developers using this skill

skill

Browser Automation

advanced

0 installs

View Source

Last updated: April 23, 2026

AI Skill Market Insights

Real data. Real impact.

Popularity

Rising

Emerging

Active Users

Developers

Quick Start

Manual Installation

No automatic installation available. Please visit the source repository for installation instructions.

View Installation Instructions

TEAR & SHARE

3-5hrs/WK

RISING

0.0K+ USING

Skill: deep-scraper

Overview

A high-performance engineering tool for deep web scraping. It uses a containerized Docker + Crawlee (Playwright) environment to penetrate protections on complex websites like YouTube and X/Twitter, providing "interception-level" raw data.

Requirements

Docker: Must be installed and running on the host machine.

Image: Build the environment with the tag

clawd-crawlee

Build command:

docker build -t clawd-crawlee skills/deep-scraper/

Integration Guide

Simply copy the

skills/deep-scraper

directory into your

skills/

folder. Ensure the Dockerfile remains within the skill directory for self-contained deployment.

Standard Interface (CLI)

docker run -t --rm -v $(pwd)/skills/deep-scraper/assets:/usr/src/app/assets clawd-crawlee node assets/main_handler.js [TARGET_URL]

Output Specification (JSON)

The scraping results are printed to stdout as a JSON string:

```
status
```
: SUCCESS | PARTIAL | ERROR
```
type
```
: TRANSCRIPT | DESCRIPTION | GENERIC
```
videoId
```
: (For YouTube) The validated Video ID.
```
data
```
: The core text content or transcript.

Core Rules

ID Validation: All YouTube tasks MUST verify the Video ID to prevent cache contamination.
Privacy: Strictly forbidden from scraping password-protected or non-public personal information.
Alpha-Focused: Automatically strips ads and noise, delivering pure data optimized for LLM processing.

Deep Scraper

AI Skill Market Insights

Quick Start

Manual Installation

TEAR & SHARE

Tags

AgentGo Cloud Browser

browse

Be Part of the 0+ Developer Community

Skill: deep-scraper

Overview

Requirements

Integration Guide

Standard Interface (CLI)

Output Specification (JSON)

Core Rules

Computer Use

Fastest Browser Use

ClearWeb

Channels

Learn

Compare

Company