{"id":"a92a0845-6e5b-48b1-a668-c726c0c3dbe9","shortId":"J8htMM","kind":"skill","title":"Crawl4AI Open-Source Web Crawling and Markdown Extraction","tagline":"Crawl4AI is an open source crawler and scraper built for LLM-ready web extraction, with structured markdown output, browser support, and Python package distribution. It has strong adoption, active maintenance, and a dedicated docs site for integration patterns.","description":"# Crawl4AI Open-Source Web Crawling and Markdown Extraction\n\nCrawl4AI is an open source crawler and scraper built for LLM-ready web extraction, with structured markdown output, browser support, and Python package distribution. It has strong adoption, active maintenance, and a dedicated docs site for integration patterns.\n\n## Prerequisites\n\npython, pip, docker, go, rust, java\n\n## Installation\n\nUse the upstream install or setup path that matches your environment:\n- pip install -U crawl4ai\n- pip install crawl4ai --pre\n- Crawl4AI offers flexible installation options to suit various use cases. You can install it as a Python package or use Docker.\n- pip install crawl4ai\n\nRequirements and caveats from upstream:\n- [![Python Version](https://img.shields.io/pypi/pyversions/crawl4ai)](https://pypi.org/project/crawl4ai/)\n- ✨ Previous v0.7.8: Stability & Bug Fix Release! 11 bug fixes addressing Docker API issues, LLM extraction improvements, URL handling fixes, and dependency updates. [Release notes →](https://github.com/unclecode/crawl4...\n- **Deploy anywhere**, zero keys, CLI and Docker, cloud friendly\n\nBasic usage or getting-started notes:\n- I made it open source for **availability**, anyone can use it without a gate. Now I’m building the platform for **affordability**, anyone can run serious crawls without breaking the bank. If that resonates, join in, s...\n- ## 🚀 Quick Start\n- # For pre release versions\n\n- Source: https://github.com/unclecode/crawl4ai\n- Extracted from upstream docs: https://raw.githubusercontent.com/unclecode/crawl4ai/HEAD/README.md\n\n## Documentation\n\n- https://docs.crawl4ai.com/\n\n## Source\n\n- [Agent Skill Exchange](https://agentskillexchange.com/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction/)","tags":["crawl4ai","open","source","web","crawling","and","markdown","extraction","skills","agentskillexchange","agent-skills","ai-agents"],"capabilities":["skill","source-agentskillexchange","skill-crawl4ai-open-source-web-crawling-and-markdown-extraction","topic-agent-skills","topic-ai-agents","topic-ai-tools","topic-awesome-list","topic-claude-code","topic-codex","topic-cursor","topic-llm","topic-mcp","topic-npx-skills","topic-openclaw","topic-skills-catalog"],"categories":["skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/agentskillexchange/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add agentskillexchange/skills","source_repo":"https://github.com/agentskillexchange/skills","install_from":"skills.sh"}},"qualityScore":"0.454","qualityRationale":"deterministic score 0.45 from registry signals: · indexed on github topic:agent-skills · 8 github stars · SKILL.md body (1,751 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-05-18T19:09:59.210Z","embedding":null,"createdAt":"2026-05-18T13:15:55.072Z","updatedAt":"2026-05-18T19:09:59.210Z","lastSeenAt":"2026-05-18T19:09:59.210Z","tsv":"'/pypi/pyversions/crawl4ai)](https://pypi.org/project/crawl4ai/)':157 '/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction/)':263 '/unclecode/crawl4...':184 '/unclecode/crawl4ai':247 '/unclecode/crawl4ai/head/readme.md':254 '11':164 'activ':39,87 'address':167 'adopt':38,86 'afford':222 'agent':258 'agentskillexchange.com':262 'agentskillexchange.com/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction/)':261 'anyon':208,223 'anywher':186 'api':169 'avail':207 'bank':231 'basic':194 'break':229 'browser':29,77 'bug':161,165 'build':218 'built':18,66 'case':133 'caveat':150 'cli':189 'cloud':192 'crawl':6,54,227 'crawl4ai':1,10,49,58,119,122,124,147 'crawler':15,63 'dedic':43,91 'depend':178 'deploy':185 'distribut':34,82 'doc':44,92,251 'docker':100,144,168,191 'docs.crawl4ai.com':256 'document':255 'environ':115 'exchang':260 'extract':9,24,57,72,172,248 'fix':162,166,176 'flexibl':126 'friend':193 'gate':214 'get':198 'getting-start':197 'github.com':183,246 'github.com/unclecode/crawl4...':182 'github.com/unclecode/crawl4ai':245 'go':101 'handl':175 'img.shields.io':156 'img.shields.io/pypi/pyversions/crawl4ai)](https://pypi.org/project/crawl4ai/)':155 'improv':173 'instal':104,108,117,121,127,136,146 'integr':47,95 'issu':170 'java':103 'join':235 'key':188 'llm':21,69,171 'llm-readi':20,68 'm':217 'made':202 'mainten':40,88 'markdown':8,27,56,75 'match':113 'note':181,200 'offer':125 'open':3,13,51,61,204 'open-sourc':2,50 'option':128 'output':28,76 'packag':33,81,141 'path':111 'pattern':48,96 'pip':99,116,120,145 'platform':220 'pre':123,241 'prerequisit':97 'previous':158 'python':32,80,98,140,153 'quick':238 'raw.githubusercontent.com':253 'raw.githubusercontent.com/unclecode/crawl4ai/head/readme.md':252 'readi':22,70 'releas':163,180,242 'requir':148 'reson':234 'run':225 'rust':102 'scraper':17,65 'serious':226 'setup':110 'site':45,93 'skill':259 'skill-crawl4ai-open-source-web-crawling-and-markdown-extraction' 'sourc':4,14,52,62,205,244,257 'source-agentskillexchange' 'stabil':160 'start':199,239 'strong':37,85 'structur':26,74 'suit':130 'support':30,78 'topic-agent-skills' 'topic-ai-agents' 'topic-ai-tools' 'topic-awesome-list' 'topic-claude-code' 'topic-codex' 'topic-cursor' 'topic-llm' 'topic-mcp' 'topic-npx-skills' 'topic-openclaw' 'topic-skills-catalog' 'u':118 'updat':179 'upstream':107,152,250 'url':174 'usag':195 'use':105,132,143,210 'v0.7.8':159 'various':131 'version':154,243 'web':5,23,53,71 'without':212,228 'zero':187","prices":[{"id":"f14a8344-a0a3-48f7-9a74-b2e573d1b2f5","listingId":"a92a0845-6e5b-48b1-a668-c726c0c3dbe9","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"agentskillexchange","category":"skills","install_from":"skills.sh"},"createdAt":"2026-05-18T13:15:55.072Z"}],"sources":[{"listingId":"a92a0845-6e5b-48b1-a668-c726c0c3dbe9","source":"github","sourceId":"agentskillexchange/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction","sourceUrl":"https://github.com/agentskillexchange/skills/tree/main/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction","isPrimary":false,"firstSeenAt":"2026-05-18T13:15:55.072Z","lastSeenAt":"2026-05-18T19:09:59.210Z"}],"details":{"listingId":"a92a0845-6e5b-48b1-a668-c726c0c3dbe9","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"agentskillexchange","slug":"crawl4ai-open-source-web-crawling-and-markdown-extraction","github":{"repo":"agentskillexchange/skills","stars":8,"topics":["agent-skills","ai-agents","ai-tools","awesome-list","claude-code","codex","cursor","llm","mcp","npx-skills","openclaw","skills-catalog"],"license":"mit","html_url":"https://github.com/agentskillexchange/skills","pushed_at":"2026-05-18T19:02:17Z","description":"The open catalog of AI agent skills — 2,000+ security-scanned skills for Claude Code, Cursor, Codex, and more.","skill_md_sha":"4bf3826b828a81a09298ec0ef5613a0a66908ac3","skill_md_path":"skills/crawl4ai-open-source-web-crawling-and-markdown-extraction/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/agentskillexchange/skills/tree/main/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction"},"layout":"multi","source":"github","category":"skills","frontmatter":{"name":"Crawl4AI Open-Source Web Crawling and Markdown Extraction","description":"Crawl4AI is an open source crawler and scraper built for LLM-ready web extraction, with structured markdown output, browser support, and Python package distribution. It has strong adoption, active maintenance, and a dedicated docs site for integration patterns."},"skills_sh_url":"https://skills.sh/agentskillexchange/skills/crawl4ai-open-source-web-crawling-and-markdown-extraction"},"updatedAt":"2026-05-18T19:09:59.210Z"}}