{"id":"4e3cb36e-6ed8-42e3-82f3-d058c422bb96","shortId":"LnGpzb","kind":"skill","title":"Run high-volume S3 copy, sync, and delete jobs faster than ad hoc aws s3 loops with s5cmd","tagline":"Execute large parallel object-store operations from command files or shell pipelines when agents need speed and repeatability beyond basic aws s3 loops.","description":"# Run high-volume S3 copy, sync, and delete jobs faster than ad hoc aws s3 loops with s5cmd\n\nExecute large parallel object-store operations from command files or shell pipelines when agents need speed and repeatability beyond basic aws s3 loops.\n\n## Prerequisites\n\ns5cmd plus credentials for Amazon S3 or another compatible object store\n\n## Installation\n\nUse the upstream install or setup path that matches your environment:\n- brew install peak/tap/s5cmd\n- conda config --add channels conda-forge\n- conda config --set channel_priority strict\n- conda install s5cmd\n\nRequirements and caveats from upstream:\n- ### Docker\n- s5cmd uses official AWS SDK to access S3. SDK requires credentials to sign\n\nBasic usage or getting-started notes:\n- ![](./doc/usage.png)\n- Command file support to run commands in batches at very high execution speeds\n- Dry run support\n\n- Source: https://github.com/peak/s5cmd\n- Extracted from upstream docs: https://raw.githubusercontent.com/peak/s5cmd/HEAD/README.md\n\n## Documentation\n\n- https://github.com/peak/s5cmd\n\n## Source\n\n- [Agent Skill Exchange](https://agentskillexchange.com/skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd/)","tags":["run","high","volume","copy","sync","and","delete","jobs","faster","than","hoc","aws"],"capabilities":["skill","source-agentskillexchange","skill-run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd","topic-agent-skills","topic-ai-agents","topic-ai-tools","topic-awesome-list","topic-claude-code","topic-codex","topic-cursor","topic-llm","topic-mcp","topic-npx-skills","topic-openclaw","topic-skills-catalog"],"categories":["skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/agentskillexchange/skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add agentskillexchange/skills","source_repo":"https://github.com/agentskillexchange/skills","install_from":"skills.sh"}},"qualityScore":"0.454","qualityRationale":"deterministic score 0.45 from registry signals: · indexed on github topic:agent-skills · 8 github stars · SKILL.md body (1,203 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-05-18T19:12:12.379Z","embedding":null,"createdAt":"2026-05-18T13:18:59.995Z","updatedAt":"2026-05-18T19:12:12.379Z","lastSeenAt":"2026-05-18T19:12:12.379Z","tsv":"'/doc/usage.png':156 '/peak/s5cmd':176,187 '/peak/s5cmd/head/readme.md':183 '/skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd/)':194 'access':142 'ad':13,56 'add':116 'agent':34,77,189 'agentskillexchange.com':193 'agentskillexchange.com/skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd/)':192 'amazon':92 'anoth':95 'aw':15,41,58,84,139 'basic':40,83,149 'batch':164 'beyond':39,82 'brew':111 'caveat':132 'channel':117,124 'command':28,71,157,162 'compat':96 'conda':114,119,121,127 'conda-forg':118 'config':115,122 'copi':6,49 'credenti':90,146 'delet':9,52 'doc':180 'docker':135 'document':184 'dri':170 'environ':110 'exchang':191 'execut':20,63,168 'extract':177 'faster':11,54 'file':29,72,158 'forg':120 'get':153 'getting-start':152 'github.com':175,186 'github.com/peak/s5cmd':174,185 'high':3,46,167 'high-volum':2,45 'hoc':14,57 'instal':99,103,112,128 'job':10,53 'larg':21,64 'loop':17,43,60,86 'match':108 'need':35,78 'note':155 'object':24,67,97 'object-stor':23,66 'offici':138 'oper':26,69 'parallel':22,65 'path':106 'peak/tap/s5cmd':113 'pipelin':32,75 'plus':89 'prerequisit':87 'prioriti':125 'raw.githubusercontent.com':182 'raw.githubusercontent.com/peak/s5cmd/head/readme.md':181 'repeat':38,81 'requir':130,145 'run':1,44,161,171 's3':5,16,42,48,59,85,93,143 's5cmd':19,62,88,129,136 'sdk':140,144 'set':123 'setup':105 'shell':31,74 'sign':148 'skill':190 'skill-run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd' 'sourc':173,188 'source-agentskillexchange' 'speed':36,79,169 'start':154 'store':25,68,98 'strict':126 'support':159,172 'sync':7,50 'topic-agent-skills' 'topic-ai-agents' 'topic-ai-tools' 'topic-awesome-list' 'topic-claude-code' 'topic-codex' 'topic-cursor' 'topic-llm' 'topic-mcp' 'topic-npx-skills' 'topic-openclaw' 'topic-skills-catalog' 'upstream':102,134,179 'usag':150 'use':100,137 'volum':4,47","prices":[{"id":"37f9d343-8d44-49a0-9c44-016a4145f27a","listingId":"4e3cb36e-6ed8-42e3-82f3-d058c422bb96","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"agentskillexchange","category":"skills","install_from":"skills.sh"},"createdAt":"2026-05-18T13:18:59.995Z"}],"sources":[{"listingId":"4e3cb36e-6ed8-42e3-82f3-d058c422bb96","source":"github","sourceId":"agentskillexchange/skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd","sourceUrl":"https://github.com/agentskillexchange/skills/tree/main/skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd","isPrimary":false,"firstSeenAt":"2026-05-18T13:18:59.995Z","lastSeenAt":"2026-05-18T19:12:12.379Z"}],"details":{"listingId":"4e3cb36e-6ed8-42e3-82f3-d058c422bb96","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"agentskillexchange","slug":"run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd","github":{"repo":"agentskillexchange/skills","stars":8,"topics":["agent-skills","ai-agents","ai-tools","awesome-list","claude-code","codex","cursor","llm","mcp","npx-skills","openclaw","skills-catalog"],"license":"mit","html_url":"https://github.com/agentskillexchange/skills","pushed_at":"2026-05-18T19:02:17Z","description":"The open catalog of AI agent skills — 2,000+ security-scanned skills for Claude Code, Cursor, Codex, and more.","skill_md_sha":"18a5406e931df32325237b8a67142f5af2b84959","skill_md_path":"skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/agentskillexchange/skills/tree/main/skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd"},"layout":"multi","source":"github","category":"skills","frontmatter":{"name":"Run high-volume S3 copy, sync, and delete jobs faster than ad hoc aws s3 loops with s5cmd","description":"Execute large parallel object-store operations from command files or shell pipelines when agents need speed and repeatability beyond basic aws s3 loops."},"skills_sh_url":"https://skills.sh/agentskillexchange/skills/run-high-volume-s3-copy-sync-and-delete-jobs-faster-than-ad-hoc-aws-s3-loops-with-s5cmd"},"updatedAt":"2026-05-18T19:12:12.379Z"}}