{"id":"77f606da-14ec-4696-93f8-9936e20e55ec","shortId":"6PxPrm","kind":"skill","title":"Colly Golang Web Scraper and Crawler Framework","tagline":"Colly is a fast open-source scraping and crawling framework for Go. It is built for everything from simple page extraction to asynchronous crawlers that process large collections of pages with request callbacks and structured parsing.","description":"# Colly Golang Web Scraper and Crawler Framework\n\nColly is a fast open-source scraping and crawling framework for Go. It is built for everything from simple page extraction to asynchronous crawlers that process large collections of pages with request callbacks and structured parsing.\n\n## Installation\n\nRequirements and caveats from upstream:\n- [docker-slim/docker-slim](https://github.com/docker-slim/docker-slim) Optimize your Docker containers to make them smaller and better.\n\nBasic usage or getting-started notes:\n- ## Example\n- go get github.com/gocolly/colly/v2\n- ## Bugs\n\n- Source: https://github.com/gocolly/colly\n- Extracted from upstream docs: https://raw.githubusercontent.com/gocolly/colly/HEAD/README.md\n\n## Source\n\n- [Agent Skill Exchange](https://agentskillexchange.com/skills/colly-golang-web-scraper-crawler-framework/)","tags":["colly","golang","web","scraper","crawler","framework","skills","agentskillexchange","agent-skills","ai-agents","ai-tools","awesome-list"],"capabilities":["skill","source-agentskillexchange","skill-colly-golang-web-scraper-crawler-framework","topic-agent-skills","topic-ai-agents","topic-ai-tools","topic-awesome-list","topic-claude-code","topic-codex","topic-cursor","topic-llm","topic-mcp","topic-npx-skills","topic-openclaw","topic-skills-catalog"],"categories":["skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/agentskillexchange/skills/colly-golang-web-scraper-crawler-framework","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add agentskillexchange/skills","source_repo":"https://github.com/agentskillexchange/skills","install_from":"skills.sh"}},"qualityScore":"0.454","qualityRationale":"deterministic score 0.45 from registry signals: · indexed on github topic:agent-skills · 8 github stars · SKILL.md body (837 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-05-18T19:09:53.556Z","embedding":null,"createdAt":"2026-05-18T13:15:46.971Z","updatedAt":"2026-05-18T19:09:53.556Z","lastSeenAt":"2026-05-18T19:09:53.556Z","tsv":"'/docker-slim':98 '/docker-slim/docker-slim)':101 '/gocolly/colly':129 '/gocolly/colly/head/readme.md':136 '/gocolly/colly/v2':124 '/skills/colly-golang-web-scraper-crawler-framework/)':143 'agent':138 'agentskillexchange.com':142 'agentskillexchange.com/skills/colly-golang-web-scraper-crawler-framework/)':141 'asynchron':31,75 'basic':112 'better':111 'bug':125 'built':23,67 'callback':41,85 'caveat':92 'collect':36,80 'colli':1,8,45,52 'contain':105 'crawl':17,61 'crawler':6,32,50,76 'doc':133 'docker':96,104 'docker-slim':95 'everyth':25,69 'exampl':119 'exchang':140 'extract':29,73,130 'fast':11,55 'framework':7,18,51,62 'get':116,121 'getting-start':115 'github.com':100,123,128 'github.com/docker-slim/docker-slim)':99 'github.com/gocolly/colly':127 'github.com/gocolly/colly/v2':122 'go':20,64,120 'golang':2,46 'instal':89 'larg':35,79 'make':107 'note':118 'open':13,57 'open-sourc':12,56 'optim':102 'page':28,38,72,82 'pars':44,88 'process':34,78 'raw.githubusercontent.com':135 'raw.githubusercontent.com/gocolly/colly/head/readme.md':134 'request':40,84 'requir':90 'scrape':15,59 'scraper':4,48 'simpl':27,71 'skill':139 'skill-colly-golang-web-scraper-crawler-framework' 'slim':97 'smaller':109 'sourc':14,58,126,137 'source-agentskillexchange' 'start':117 'structur':43,87 'topic-agent-skills' 'topic-ai-agents' 'topic-ai-tools' 'topic-awesome-list' 'topic-claude-code' 'topic-codex' 'topic-cursor' 'topic-llm' 'topic-mcp' 'topic-npx-skills' 'topic-openclaw' 'topic-skills-catalog' 'upstream':94,132 'usag':113 'web':3,47","prices":[{"id":"0bca3a04-2540-4b1b-a47e-9a12b5bd2c2e","listingId":"77f606da-14ec-4696-93f8-9936e20e55ec","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"agentskillexchange","category":"skills","install_from":"skills.sh"},"createdAt":"2026-05-18T13:15:46.971Z"}],"sources":[{"listingId":"77f606da-14ec-4696-93f8-9936e20e55ec","source":"github","sourceId":"agentskillexchange/skills/colly-golang-web-scraper-crawler-framework","sourceUrl":"https://github.com/agentskillexchange/skills/tree/main/skills/colly-golang-web-scraper-crawler-framework","isPrimary":false,"firstSeenAt":"2026-05-18T13:15:46.971Z","lastSeenAt":"2026-05-18T19:09:53.556Z"}],"details":{"listingId":"77f606da-14ec-4696-93f8-9936e20e55ec","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"agentskillexchange","slug":"colly-golang-web-scraper-crawler-framework","github":{"repo":"agentskillexchange/skills","stars":8,"topics":["agent-skills","ai-agents","ai-tools","awesome-list","claude-code","codex","cursor","llm","mcp","npx-skills","openclaw","skills-catalog"],"license":"mit","html_url":"https://github.com/agentskillexchange/skills","pushed_at":"2026-05-18T19:02:17Z","description":"The open catalog of AI agent skills — 2,000+ security-scanned skills for Claude Code, Cursor, Codex, and more.","skill_md_sha":"445b4573b8c059a182ac5a0ca41b621c3e41ecb3","skill_md_path":"skills/colly-golang-web-scraper-crawler-framework/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/agentskillexchange/skills/tree/main/skills/colly-golang-web-scraper-crawler-framework"},"layout":"multi","source":"github","category":"skills","frontmatter":{"name":"Colly Golang Web Scraper and Crawler Framework","description":"Colly is a fast open-source scraping and crawling framework for Go. It is built for everything from simple page extraction to asynchronous crawlers that process large collections of pages with request callbacks and structured parsing."},"skills_sh_url":"https://skills.sh/agentskillexchange/skills/colly-golang-web-scraper-crawler-framework"},"updatedAt":"2026-05-18T19:09:53.556Z"}}