Use an escalating scrape strategy in Claude Code before reaching for browser automation
Start with cheap static fetches, escalate to a browser only when needed, validate findings, and turn the result into a production-ready scraping approach.
What it does
Use an escalating scrape strategy in Claude Code before reaching for browser automation
Start with cheap static fetches, escalate to a browser only when needed, validate findings, and turn the result into a production-ready scraping approach.
Prerequisites
Claude Code, standard web access tools, optional browser automation tooling, optional Apify tooling for productionization
Installation
Requirements and caveats from upstream:
-
"API requires authentication"
Basic usage or getting-started notes:
-
Add this skill to Claude Code by placing this directory in the skills folder.
-
Scenario 1: Scrape a Website
-
User: "Scrape https://example.com"
-
Extracted from upstream docs: https://raw.githubusercontent.com/yfe404/web-scraper/HEAD/README.md
Documentation
Source
Capabilities
Install
Quality
deterministic score 0.45 from registry signals: · indexed on github topic:agent-skills · 8 github stars · SKILL.md body (1,044 chars)