Colly Golang Web Scraper and Crawler Framework

Colly is a fast open-source scraping and crawling framework for Go. It is built for everything from simple page extraction to asynchronous crawlers that process large collections of pages with request callbacks and structured parsing.

Installation

Requirements and caveats from upstream:

• docker-slim/docker-slim Optimize your Docker containers to make them smaller and better.

Basic usage or getting-started notes:

• Example

• go get github.com/gocolly/colly/v2

• Bugs

• Source: https://github.com/gocolly/colly

• Extracted from upstream docs: https://raw.githubusercontent.com/gocolly/colly/HEAD/README.md

Source

• Agent Skill Exchange