{"id":"4e7439d7-5fb0-414f-b09d-0b144fdfe062","shortId":"B9kD5X","kind":"skill","title":"Katana Next-Generation Web Crawling and Spidering Framework","tagline":"Katana by ProjectDiscovery is a fast, configurable web crawling and spidering framework written in Go. It supports standard and headless browser modes, JavaScript parsing, automatic form filling, and structured output for feeding into security and data pipelines.","description":"# Katana Next-Generation Web Crawling and Spidering Framework\n\nKatana by ProjectDiscovery is a fast, configurable web crawling and spidering framework written in Go. It supports standard and headless browser modes, JavaScript parsing, automatic form filling, and structured output for feeding into security and data pipelines.\n\n## Installation\n\nUse the upstream install or setup path that matches your environment:\n- docker pull projectdiscovery/katana:latest\n- docker run projectdiscovery/katana:latest -u https://tesla.com\n- docker run projectdiscovery/katana:latest -u https://tesla.com -system-chrome -headless\n- go install github.com/projectdiscovery/katana/cmd/katana@latest\n\nRequirements and caveats from upstream:\n- katana requires Go 1.25+ to install successfully. If you encounter any installation issues, we recommend trying with the latest available version of Go, as the minimum required version may have changed. Run the comman...\n- <summary>Docker</summary>\n- To install / update docker to latest tag -\n\nBasic usage or getting-started notes:\n- <a href=\"#usage\">Usage</a> •\n- console\n- CGO_ENABLED=1 go install github.com/projectdiscovery/katana/cmd/katana@latest\n\n- Source: https://github.com/projectdiscovery/katana\n- Extracted from upstream docs: https://raw.githubusercontent.com/projectdiscovery/katana/HEAD/README.md\n\n## Source\n\n- [Agent Skill Exchange](https://agentskillexchange.com/skills/katana-web-crawling-spidering-framework/)","tags":["katana","web","crawling","spidering","framework","skills","agentskillexchange","agent-skills","ai-agents","ai-tools","awesome-list","claude-code"],"capabilities":["skill","source-agentskillexchange","skill-katana-web-crawling-spidering-framework","topic-agent-skills","topic-ai-agents","topic-ai-tools","topic-awesome-list","topic-claude-code","topic-codex","topic-cursor","topic-llm","topic-mcp","topic-npx-skills","topic-openclaw","topic-skills-catalog"],"categories":["skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/agentskillexchange/skills/katana-web-crawling-spidering-framework","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add agentskillexchange/skills","source_repo":"https://github.com/agentskillexchange/skills","install_from":"skills.sh"}},"qualityScore":"0.454","qualityRationale":"deterministic score 0.45 from registry signals: · indexed on github topic:agent-skills · 8 github stars · SKILL.md body (1,453 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-05-18T19:11:03.230Z","embedding":null,"createdAt":"2026-05-18T13:17:22.126Z","updatedAt":"2026-05-18T19:11:03.230Z","lastSeenAt":"2026-05-18T19:11:03.230Z","tsv":"'/projectdiscovery/katana':197 '/projectdiscovery/katana/cmd/katana@latest':129,193 '/projectdiscovery/katana/head/readme.md':204 '/skills/katana-web-crawling-spidering-framework/)':211 '1':188 '1.25':138 'agent':206 'agentskillexchange.com':210 'agentskillexchange.com/skills/katana-web-crawling-spidering-framework/)':209 'automat':34,80 'avail':154 'basic':177 'browser':30,76 'caveat':132 'cgo':186 'chang':165 'chrome':123 'comman':168 'configur':16,62 'consol':185 'crawl':6,18,52,64 'data':45,91 'doc':201 'docker':105,109,115,169,173 'enabl':187 'encount':144 'environ':104 'exchang':208 'extract':198 'fast':15,61 'feed':41,87 'fill':36,82 'form':35,81 'framework':9,21,55,67 'generat':4,50 'get':181 'getting-start':180 'github.com':128,192,196 'github.com/projectdiscovery/katana':195 'github.com/projectdiscovery/katana/cmd/katana@latest':127,191 'go':24,70,125,137,157,189 'headless':29,75,124 'instal':93,97,126,140,146,171,190 'issu':147 'javascript':32,78 'katana':1,10,47,56,135 'latest':108,112,118,153,175 'match':102 'may':163 'minimum':160 'mode':31,77 'next':3,49 'next-gener':2,48 'note':183 'output':39,85 'pars':33,79 'path':100 'pipelin':46,92 'projectdiscoveri':12,58 'projectdiscovery/katana':107,111,117 'pull':106 'raw.githubusercontent.com':203 'raw.githubusercontent.com/projectdiscovery/katana/head/readme.md':202 'recommend':149 'requir':130,136,161 'run':110,116,166 'secur':43,89 'setup':99 'skill':207 'skill-katana-web-crawling-spidering-framework' 'sourc':194,205 'source-agentskillexchange' 'spider':8,20,54,66 'standard':27,73 'start':182 'structur':38,84 'success':141 'support':26,72 'system':122 'system-chrom':121 'tag':176 'tesla.com':114,120 'topic-agent-skills' 'topic-ai-agents' 'topic-ai-tools' 'topic-awesome-list' 'topic-claude-code' 'topic-codex' 'topic-cursor' 'topic-llm' 'topic-mcp' 'topic-npx-skills' 'topic-openclaw' 'topic-skills-catalog' 'tri':150 'u':113,119 'updat':172 'upstream':96,134,200 'usag':178,184 'use':94 'version':155,162 'web':5,17,51,63 'written':22,68","prices":[{"id":"13bfee89-8693-4035-bc60-8af36207ca7b","listingId":"4e7439d7-5fb0-414f-b09d-0b144fdfe062","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"agentskillexchange","category":"skills","install_from":"skills.sh"},"createdAt":"2026-05-18T13:17:22.126Z"}],"sources":[{"listingId":"4e7439d7-5fb0-414f-b09d-0b144fdfe062","source":"github","sourceId":"agentskillexchange/skills/katana-web-crawling-spidering-framework","sourceUrl":"https://github.com/agentskillexchange/skills/tree/main/skills/katana-web-crawling-spidering-framework","isPrimary":false,"firstSeenAt":"2026-05-18T13:17:22.126Z","lastSeenAt":"2026-05-18T19:11:03.230Z"}],"details":{"listingId":"4e7439d7-5fb0-414f-b09d-0b144fdfe062","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"agentskillexchange","slug":"katana-web-crawling-spidering-framework","github":{"repo":"agentskillexchange/skills","stars":8,"topics":["agent-skills","ai-agents","ai-tools","awesome-list","claude-code","codex","cursor","llm","mcp","npx-skills","openclaw","skills-catalog"],"license":"mit","html_url":"https://github.com/agentskillexchange/skills","pushed_at":"2026-05-18T19:02:17Z","description":"The open catalog of AI agent skills — 2,000+ security-scanned skills for Claude Code, Cursor, Codex, and more.","skill_md_sha":"690a346d9d34f5ce6a9d200552a1434d2314064c","skill_md_path":"skills/katana-web-crawling-spidering-framework/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/agentskillexchange/skills/tree/main/skills/katana-web-crawling-spidering-framework"},"layout":"multi","source":"github","category":"skills","frontmatter":{"name":"Katana Next-Generation Web Crawling and Spidering Framework","description":"Katana by ProjectDiscovery is a fast, configurable web crawling and spidering framework written in Go. It supports standard and headless browser modes, JavaScript parsing, automatic form filling, and structured output for feeding into security and data pipelines."},"skills_sh_url":"https://skills.sh/agentskillexchange/skills/katana-web-crawling-spidering-framework"},"updatedAt":"2026-05-18T19:11:03.230Z"}}