{"id":"0831c451-9c5e-467d-a577-be6f519f42af","shortId":"U9yFbP","kind":"skill","title":"hugging-face-trackio","tagline":"Track ML experiments with Trackio using Python logging, alerts, and CLI metric retrieval.","description":"# Trackio - Experiment Tracking for ML Training\n\nTrackio is an experiment tracking library for logging and visualizing ML training metrics. It syncs to Hugging Face Spaces for real-time monitoring dashboards.\n\n## Three Interfaces\n\n| Task | Interface | Reference |\n|------|-----------|-----------|\n| **Logging metrics** during training | Python API | [references/logging_metrics.md](references/logging_metrics.md) |\n| **Firing alerts** for training diagnostics | Python API | [references/alerts.md](references/alerts.md) |\n| **Retrieving metrics & alerts** after/during training | CLI | [references/retrieving_metrics.md](references/retrieving_metrics.md) |\n\n## When to Use Each\n\n### Python API → Logging\n\nUse `import trackio` in your training scripts to log metrics:\n\n- Initialize tracking with `trackio.init()`\n- Log metrics with `trackio.log()` or use TRL's `report_to=\"trackio\"`\n- Finalize with `trackio.finish()`\n\n**Key concept**: For remote/cloud training, pass `space_id` — metrics sync to a Space dashboard so they persist after the instance terminates.\n\n→ See [references/logging_metrics.md](references/logging_metrics.md) for setup, TRL integration, and configuration options.\n\n### Python API → Alerts\n\nInsert `trackio.alert()` calls in training code to flag important events — like inserting print statements for debugging, but structured and queryable:\n\n- `trackio.alert(title=\"...\", level=trackio.AlertLevel.WARN)` — fire an alert\n- Three severity levels: `INFO`, `WARN`, `ERROR`\n- Alerts are printed to terminal, stored in the database, shown in the dashboard, and optionally sent to webhooks (Slack/Discord)\n\n**Key concept for LLM agents**: Alerts are the primary mechanism for autonomous experiment iteration. An agent should insert alerts into training code for diagnostic conditions (loss spikes, NaN gradients, low accuracy, training stalls). Since alerts are printed to the terminal, an agent that is watching the training script's output will see them automatically. For background or detached runs, the agent can poll via CLI instead.\n\n→ See [references/alerts.md](references/alerts.md) for the full alerts API, webhook setup, and autonomous agent workflows.\n\n### CLI → Retrieving\n\nUse the `trackio` command to query logged metrics and alerts:\n\n- `trackio list projects/runs/metrics` — discover what's available\n- `trackio get project/run/metric` — retrieve summaries and values\n- `trackio list alerts --project <name> --json` — retrieve alerts\n- `trackio show` — launch the dashboard\n- `trackio sync` — sync to HF Space\n\n**Key concept**: Add `--json` for programmatic output suitable for automation and LLM agents.\n\n→ See [references/retrieving_metrics.md](references/retrieving_metrics.md) for all commands, workflows, and JSON output formats.\n\n## Minimal Logging Setup\n\n```python\nimport trackio\n\ntrackio.init(project=\"my-project\", space_id=\"username/trackio\")\ntrackio.log({\"loss\": 0.1, \"accuracy\": 0.9})\ntrackio.log({\"loss\": 0.09, \"accuracy\": 0.91})\ntrackio.finish()\n```\n\n### Minimal Retrieval\n\n```bash\ntrackio list projects --json\ntrackio get metric --project my-project --run my-run --metric loss --json\n```\n\n## Autonomous ML Experiment Workflow\n\nWhen running experiments autonomously as an LLM agent, the recommended workflow is:\n\n1. **Set up training with alerts** — insert `trackio.alert()` calls for diagnostic conditions\n2. **Launch training** — run the script in the background\n3. **Poll for alerts** — use `trackio list alerts --project <name> --json --since <timestamp>` to check for new alerts\n4. **Read metrics** — use `trackio get metric ...` to inspect specific values\n5. **Iterate** — based on alerts and metrics, stop the run, adjust hyperparameters, and launch a new run\n\n```python\nimport trackio\n\ntrackio.init(project=\"my-project\", config={\"lr\": 1e-4})\n\nfor step in range(num_steps):\n    loss = train_step()\n    trackio.log({\"loss\": loss, \"step\": step})\n\n    if step > 100 and loss > 5.0:\n        trackio.alert(\n            title=\"Loss divergence\",\n            text=f\"Loss {loss:.4f} still high after {step} steps\",\n            level=trackio.AlertLevel.ERROR,\n        )\n    if step > 0 and abs(loss) < 1e-8:\n        trackio.alert(\n            title=\"Vanishing loss\",\n            text=\"Loss near zero — possible gradient collapse\",\n            level=trackio.AlertLevel.WARN,\n        )\n\ntrackio.finish()\n```\n\nThen poll from a separate terminal/process:\n\n```bash\ntrackio list alerts --project my-project --json --since \"2025-01-01T00:00:00\"\n```\n\n## Limitations\n- Use this skill only when the task clearly matches the scope described above.\n- Do not treat the output as a substitute for environment-specific validation, testing, or expert review.\n- Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.","tags":["hugging","face","trackio","antigravity","awesome","skills","sickn33","agent-skills","agentic-skills","ai-agent-skills","ai-agents","ai-coding"],"capabilities":["skill","source-sickn33","skill-hugging-face-trackio","topic-agent-skills","topic-agentic-skills","topic-ai-agent-skills","topic-ai-agents","topic-ai-coding","topic-ai-workflows","topic-antigravity","topic-antigravity-skills","topic-claude-code","topic-claude-code-skills","topic-codex-cli","topic-codex-skills"],"categories":["antigravity-awesome-skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/sickn33/antigravity-awesome-skills/hugging-face-trackio","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add sickn33/antigravity-awesome-skills","source_repo":"https://github.com/sickn33/antigravity-awesome-skills","install_from":"skills.sh"}},"qualityScore":"0.700","qualityRationale":"deterministic score 0.70 from registry signals: · indexed on github topic:agent-skills · 34768 github stars · SKILL.md body (4,802 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-04-23T18:51:30.157Z","embedding":null,"createdAt":"2026-04-18T21:38:50.477Z","updatedAt":"2026-04-23T18:51:30.157Z","lastSeenAt":"2026-04-23T18:51:30.157Z","tsv":"'-01':560,561 '0':524 '0.09':369 '0.1':364 '0.9':366 '0.91':371 '00':563,564 '1':410 '100':502 '1e-4':485 '1e-8':528 '2':422 '2025':559 '3':431 '4':447 '4f':514 '5':458 '5.0':505 'ab':526 'accuraci':230,365,370 'add':326 'adjust':468 'after/during':74 'agent':204,215,241,260,278,336,405 'alert':13,63,73,147,174,181,205,218,234,272,291,308,312,415,434,438,446,462,552 'api':59,68,84,146,273 'ask':598 'autom':333 'automat':253 'autonom':211,277,394,401 'avail':298 'background':255,430 'base':460 'bash':375,549 'boundari':606 'call':150,418 'check':443 'clarif':600 'clear':573 'cli':15,76,264,280 'code':153,221 'collaps':539 'command':285,342 'concept':115,201,325 'condit':224,421 'config':483 'configur':143 'criteria':609 'dashboard':48,127,193,317 'databas':189 'debug':163 'describ':577 'detach':257 'diagnost':66,223,420 'discov':295 'diverg':509 'environ':589 'environment-specif':588 'error':180 'event':157 'experi':7,19,27,212,396,400 'expert':594 'f':511 'face':3,41 'final':111 'fire':62,172 'flag':155 'format':347 'full':271 'get':300,381,452 'gradient':228,538 'hf':322 'high':516 'hug':2,40 'hugging-face-trackio':1 'hyperparamet':469 'id':121,360 'import':87,156,352,476 'info':178 'initi':96 'input':603 'insert':148,159,217,416 'inspect':455 'instanc':133 'instead':265 'integr':141 'interfac':50,52 'iter':213,459 'json':310,327,345,379,393,440,557 'key':114,200,324 'launch':315,423,471 'level':170,177,520,540 'librari':29 'like':158 'limit':565 'list':293,307,377,437,551 'llm':203,335,404 'log':12,31,54,85,94,100,288,349 'loss':225,363,368,392,492,496,497,504,508,512,513,527,532,534 'low':229 'lr':484 'match':574 'mechan':209 'metric':16,36,55,72,95,101,122,289,382,391,449,453,464 'minim':348,373 'miss':611 'ml':6,22,34,395 'monitor':47 'my-project':356,384,480,554 'my-run':388 'nan':227 'near':535 'new':445,473 'num':490 'option':144,195 'output':249,330,346,583 'pass':119 'permiss':604 'persist':130 'poll':262,432,544 'possibl':537 'primari':208 'print':160,183,236 'programmat':329 'project':309,355,358,378,383,386,439,479,482,553,556 'project/run/metric':301 'projects/runs/metrics':294 'python':11,58,67,83,145,351,475 'queri':287 'queryabl':167 'rang':489 'read':448 'real':45 'real-tim':44 'recommend':407 'refer':53 'references/alerts.md':69,70,267,268 'references/logging_metrics.md':60,61,136,137 'references/retrieving_metrics.md':77,78,338,339 'remote/cloud':117 'report':108 'requir':602 'retriev':17,71,281,302,311,374 'review':595 'run':258,387,390,399,425,467,474 'safeti':605 'scope':576 'script':92,247,427 'see':135,251,266,337 'sent':196 'separ':547 'set':411 'setup':139,275,350 'sever':176 'show':314 'shown':190 'sinc':233,441,558 'skill':568 'skill-hugging-face-trackio' 'slack/discord':199 'source-sickn33' 'space':42,120,126,323,359 'specif':456,590 'spike':226 'stall':232 'statement':161 'step':487,491,494,498,499,501,518,519,523 'still':515 'stop':465,596 'store':186 'structur':165 'substitut':586 'success':608 'suitabl':331 'summari':303 'sync':38,123,319,320 't00':562 'task':51,572 'termin':134,185,239 'terminal/process':548 'test':592 'text':510,533 'three':49,175 'time':46 'titl':169,507,530 'topic-agent-skills' 'topic-agentic-skills' 'topic-ai-agent-skills' 'topic-ai-agents' 'topic-ai-coding' 'topic-ai-workflows' 'topic-antigravity' 'topic-antigravity-skills' 'topic-claude-code' 'topic-claude-code-skills' 'topic-codex-cli' 'topic-codex-skills' 'track':5,20,28,97 'trackio':4,9,18,24,88,110,284,292,299,306,313,318,353,376,380,436,451,477,550 'trackio.alert':149,168,417,506,529 'trackio.alertlevel.error':521 'trackio.alertlevel.warn':171,541 'trackio.finish':113,372,542 'trackio.init':99,354,478 'trackio.log':103,362,367,495 'train':23,35,57,65,75,91,118,152,220,231,246,413,424,493 'treat':581 'trl':106,140 'use':10,81,86,105,282,435,450,566 'username/trackio':361 'valid':591 'valu':305,457 'vanish':531 'via':263 'visual':33 'warn':179 'watch':244 'webhook':198,274 'workflow':279,343,397,408 'zero':536","prices":[{"id":"5d73e6dc-926a-4db8-8e51-2b1abe29b395","listingId":"0831c451-9c5e-467d-a577-be6f519f42af","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"sickn33","category":"antigravity-awesome-skills","install_from":"skills.sh"},"createdAt":"2026-04-18T21:38:50.477Z"}],"sources":[{"listingId":"0831c451-9c5e-467d-a577-be6f519f42af","source":"github","sourceId":"sickn33/antigravity-awesome-skills/hugging-face-trackio","sourceUrl":"https://github.com/sickn33/antigravity-awesome-skills/tree/main/skills/hugging-face-trackio","isPrimary":false,"firstSeenAt":"2026-04-18T21:38:50.477Z","lastSeenAt":"2026-04-23T18:51:30.157Z"}],"details":{"listingId":"0831c451-9c5e-467d-a577-be6f519f42af","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"sickn33","slug":"hugging-face-trackio","github":{"repo":"sickn33/antigravity-awesome-skills","stars":34768,"topics":["agent-skills","agentic-skills","ai-agent-skills","ai-agents","ai-coding","ai-workflows","antigravity","antigravity-skills","claude-code","claude-code-skills","codex-cli","codex-skills","cursor","cursor-skills","developer-tools","gemini-cli","gemini-skills","kiro","mcp","skill-library"],"license":"mit","html_url":"https://github.com/sickn33/antigravity-awesome-skills","pushed_at":"2026-04-23T06:41:03Z","description":"Installable GitHub library of 1,400+ agentic skills for Claude Code, Cursor, Codex CLI, Gemini CLI, Antigravity, and more. Includes installer CLI, bundles, workflows, and official/community skill collections.","skill_md_sha":"f121cf31c8ffed09cb648e20fa543b1702eda1d9","skill_md_path":"skills/hugging-face-trackio/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/sickn33/antigravity-awesome-skills/tree/main/skills/hugging-face-trackio"},"layout":"multi","source":"github","category":"antigravity-awesome-skills","frontmatter":{"name":"hugging-face-trackio","description":"Track ML experiments with Trackio using Python logging, alerts, and CLI metric retrieval."},"skills_sh_url":"https://skills.sh/sickn33/antigravity-awesome-skills/hugging-face-trackio"},"updatedAt":"2026-04-23T18:51:30.157Z"}}