{"id":"fc60f8f5-f8d7-4e66-a85b-1ba64c0e8699","shortId":"gXrkBm","kind":"skill","title":"Apify Actor Web Crawler","tagline":"Deploys custom Apify Actors via the Apify API v2 for large-scale web crawling using CrawleeJS. Leverages Apify dataset storage, RequestQueue, and proxy configuration for distributed scraping at scale.","description":"# Apify Actor Web Crawler\n\nDeploys custom Apify Actors via the Apify API v2 for large-scale web crawling using CrawleeJS. Leverages Apify dataset storage, RequestQueue, and proxy configuration for distributed scraping at scale.\n\n## Installation\n\nUse the upstream install or setup path that matches your environment:\n- npm install apify\n\nRequirements and caveats from upstream:\n- Apify SDK requires [Node.js](https://nodejs.org/en/) 16 or later. Add Apify SDK to any Node.js project by running:\n\nBasic usage or getting-started notes:\n- This short tutorial will set you up to start using Apify SDK in a minute or two.\n- If you want to learn more, proceed to the [Apify Platform](https://docs.apify.com/sdk/js/docs/concepts/actor-lifecycle)\n- guide that will take you step by step through running your Actor on Apify's platform.\n\n- Source: https://github.com/apify/apify-sdk-js\n- Extracted from upstream docs: https://raw.githubusercontent.com/apify/apify-sdk-js/HEAD/README.md\n\n## Source\n\n- [Agent Skill Exchange](https://agentskillexchange.com/skills/apify-actor-web-crawler/)","tags":["apify","actor","web","crawler","skills","agentskillexchange","agent-skills","ai-agents","ai-tools","awesome-list","claude-code","codex"],"capabilities":["skill","source-agentskillexchange","skill-apify-actor-web-crawler","topic-agent-skills","topic-ai-agents","topic-ai-tools","topic-awesome-list","topic-claude-code","topic-codex","topic-cursor","topic-llm","topic-mcp","topic-npx-skills","topic-openclaw","topic-skills-catalog"],"categories":["skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/agentskillexchange/skills/apify-actor-web-crawler","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add agentskillexchange/skills","source_repo":"https://github.com/agentskillexchange/skills","install_from":"skills.sh"}},"qualityScore":"0.454","qualityRationale":"deterministic score 0.45 from registry signals: · indexed on github topic:agent-skills · 8 github stars · SKILL.md body (1,075 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-05-18T19:09:23.866Z","embedding":null,"createdAt":"2026-05-18T13:15:06.918Z","updatedAt":"2026-05-18T19:09:23.866Z","lastSeenAt":"2026-05-18T19:09:23.866Z","tsv":"'/apify/apify-sdk-js':165 '/apify/apify-sdk-js/head/readme.md':172 '/en/)':95 '/sdk/js/docs/concepts/actor-lifecycle)':145 '/skills/apify-actor-web-crawler/)':179 '16':96 'actor':2,8,36,42,157 'add':99 'agent':174 'agentskillexchange.com':178 'agentskillexchange.com/skills/apify-actor-web-crawler/)':177 'api':12,46 'apifi':1,7,11,23,35,41,45,57,83,89,100,125,141,159 'basic':108 'caveat':86 'configur':29,63 'crawl':19,53 'crawleej':21,55 'crawler':4,38 'custom':6,40 'dataset':24,58 'deploy':5,39 'distribut':31,65 'doc':169 'docs.apify.com':144 'docs.apify.com/sdk/js/docs/concepts/actor-lifecycle)':143 'environ':80 'exchang':176 'extract':166 'get':112 'getting-start':111 'github.com':164 'github.com/apify/apify-sdk-js':163 'guid':146 'instal':69,73,82 'larg':16,50 'large-scal':15,49 'later':98 'learn':136 'leverag':22,56 'match':78 'minut':129 'node.js':92,104 'nodejs.org':94 'nodejs.org/en/)':93 'note':114 'npm':81 'path':76 'platform':142,161 'proceed':138 'project':105 'proxi':28,62 'raw.githubusercontent.com':171 'raw.githubusercontent.com/apify/apify-sdk-js/head/readme.md':170 'requestqueu':26,60 'requir':84,91 'run':107,155 'scale':17,34,51,68 'scrape':32,66 'sdk':90,101,126 'set':119 'setup':75 'short':116 'skill':175 'skill-apify-actor-web-crawler' 'sourc':162,173 'source-agentskillexchange' 'start':113,123 'step':151,153 'storag':25,59 'take':149 'topic-agent-skills' 'topic-ai-agents' 'topic-ai-tools' 'topic-awesome-list' 'topic-claude-code' 'topic-codex' 'topic-cursor' 'topic-llm' 'topic-mcp' 'topic-npx-skills' 'topic-openclaw' 'topic-skills-catalog' 'tutori':117 'two':131 'upstream':72,88,168 'usag':109 'use':20,54,70,124 'v2':13,47 'via':9,43 'want':134 'web':3,18,37,52","prices":[{"id":"c8ca4b32-8627-4d40-8543-5a3ffde34102","listingId":"fc60f8f5-f8d7-4e66-a85b-1ba64c0e8699","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"agentskillexchange","category":"skills","install_from":"skills.sh"},"createdAt":"2026-05-18T13:15:06.918Z"}],"sources":[{"listingId":"fc60f8f5-f8d7-4e66-a85b-1ba64c0e8699","source":"github","sourceId":"agentskillexchange/skills/apify-actor-web-crawler","sourceUrl":"https://github.com/agentskillexchange/skills/tree/main/skills/apify-actor-web-crawler","isPrimary":false,"firstSeenAt":"2026-05-18T13:15:06.918Z","lastSeenAt":"2026-05-18T19:09:23.866Z"}],"details":{"listingId":"fc60f8f5-f8d7-4e66-a85b-1ba64c0e8699","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"agentskillexchange","slug":"apify-actor-web-crawler","github":{"repo":"agentskillexchange/skills","stars":8,"topics":["agent-skills","ai-agents","ai-tools","awesome-list","claude-code","codex","cursor","llm","mcp","npx-skills","openclaw","skills-catalog"],"license":"mit","html_url":"https://github.com/agentskillexchange/skills","pushed_at":"2026-05-18T19:02:17Z","description":"The open catalog of AI agent skills — 2,000+ security-scanned skills for Claude Code, Cursor, Codex, and more.","skill_md_sha":"aceb7538f201d8689a59fd7d660c0192f0298875","skill_md_path":"skills/apify-actor-web-crawler/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/agentskillexchange/skills/tree/main/skills/apify-actor-web-crawler"},"layout":"multi","source":"github","category":"skills","frontmatter":{"name":"Apify Actor Web Crawler","description":"Deploys custom Apify Actors via the Apify API v2 for large-scale web crawling using CrawleeJS. Leverages Apify dataset storage, RequestQueue, and proxy configuration for distributed scraping at scale."},"skills_sh_url":"https://skills.sh/agentskillexchange/skills/apify-actor-web-crawler"},"updatedAt":"2026-05-18T19:09:23.866Z"}}