Crawl4AI

Integrates with Crawl4AI to provide web crawling, content extraction, screenshot capture, PDF generation, and batch processing capabilities with intelligent content detection for sitemaps and RSS feeds.

TypeScript MCP server that provides web crawling and content extraction capabilities through integration with Crawl4AI, a Python-based web crawling service. The implementation offers 11 specialized tools including basic page crawling with markdown extraction, screenshot capture, PDF generation, JavaScript execution, batch processing, and intelligent content type detection for sitemaps and RSS feeds. Built with comprehensive error handling, flexible filtering options, and advanced features like recursive crawling with depth control and custom header support, it's designed for AI assistants that need to systematically extract and analyze web content at scale, from simple page scraping to complex multi-page site analysis workflows.