{"id":"a0e6735d-bb68-4089-99ce-17ab0cb3b0da","shortId":"ULRDx6","kind":"skill","title":"Score RAG answer quality and retrieval quality before rollout with Ragas","tagline":"Measure whether a RAG change actually improved answers and retrieval, instead of guessing from a few spot checks.","description":"# Score RAG answer quality and retrieval quality before rollout with Ragas\n\nMeasure whether a RAG change actually improved answers and retrieval, instead of guessing from a few spot checks.\n\n## Prerequisites\n\nPython environment, Ragas package, model provider credentials, evaluation dataset or testset generation inputs, access to the target RAG workflow\n\n## Installation\n\nUse the upstream install or setup path that matches your environment:\n- pip install ragas\n- pip install git+https://github.com/vibrantlabsai/ragas\n\nRequirements and caveats from upstream:\n- <a href=\"https://www.python.org/\">\n- <img alt=\"Made with Python\" src=\"https://img.shields.io/badge/Made%20with-Python-1f425f.svg?color=purple\">\n- python\n\nBasic usage or getting-started notes:\n- <a href=\"#fire-quickstart\">Quick start</a> |\n- ### Clone a Complete Example Project\n- ragas comes with pre-built metrics for common evaluation tasks. For example, Aspect Critique evaluates any aspect of your output using DiscreteMetric:\n\n- Source: https://github.com/vibrantlabsai/ragas\n- Extracted from upstream docs: https://raw.githubusercontent.com/vibrantlabsai/ragas/HEAD/README.md\n\n## Documentation\n\n- https://docs.ragas.io/en/stable/\n\n## Source\n\n- [Agent Skill Exchange](https://agentskillexchange.com/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas/)","tags":["score","rag","answer","quality","and","retrieval","before","rollout","with","ragas","skills","agentskillexchange"],"capabilities":["skill","source-agentskillexchange","skill-score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas","topic-agent-skills","topic-ai-agents","topic-ai-tools","topic-awesome-list","topic-claude-code","topic-codex","topic-cursor","topic-llm","topic-mcp","topic-npx-skills","topic-openclaw","topic-skills-catalog"],"categories":["skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/agentskillexchange/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add agentskillexchange/skills","source_repo":"https://github.com/agentskillexchange/skills","install_from":"skills.sh"}},"qualityScore":"0.454","qualityRationale":"deterministic score 0.45 from registry signals: · indexed on github topic:agent-skills · 8 github stars · SKILL.md body (1,348 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-05-18T19:12:19.797Z","embedding":null,"createdAt":"2026-05-18T13:19:11.341Z","updatedAt":"2026-05-18T19:12:19.797Z","lastSeenAt":"2026-05-18T19:12:19.797Z","tsv":"'/en/stable/':157 '/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas/)':164 '/vibrantlabsai/ragas':99,146 '/vibrantlabsai/ragas/head/readme.md':153 'access':73 'actual':17,46 'agent':159 'agentskillexchange.com':163 'agentskillexchange.com/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas/)':162 'answer':3,19,32,48 'aspect':133,137 'basic':106 'built':125 'caveat':102 'chang':16,45 'check':29,58 'clone':115 'come':121 'common':128 'complet':117 'credenti':66 'critiqu':134 'dataset':68 'discretemetr':142 'doc':150 'docs.ragas.io':156 'docs.ragas.io/en/stable/':155 'document':154 'environ':61,90 'evalu':67,129,135 'exampl':118,132 'exchang':161 'extract':147 'generat':71 'get':110 'getting-start':109 'git':96 'github.com':98,145 'github.com/vibrantlabsai/ragas':97,144 'guess':24,53 'improv':18,47 'input':72 'instal':79,83,92,95 'instead':22,51 'match':88 'measur':12,41 'metric':126 'model':64 'note':112 'output':140 'packag':63 'path':86 'pip':91,94 'pre':124 'pre-built':123 'prerequisit':59 'project':119 'provid':65 'python':60,105 'qualiti':4,7,33,36 'quick':113 'rag':2,15,31,44,77 'raga':11,40,62,93,120 'raw.githubusercontent.com':152 'raw.githubusercontent.com/vibrantlabsai/ragas/head/readme.md':151 'requir':100 'retriev':6,21,35,50 'rollout':9,38 'score':1,30 'setup':85 'skill':160 'skill-score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas' 'sourc':143,158 'source-agentskillexchange' 'spot':28,57 'start':111,114 'target':76 'task':130 'testset':70 'topic-agent-skills' 'topic-ai-agents' 'topic-ai-tools' 'topic-awesome-list' 'topic-claude-code' 'topic-codex' 'topic-cursor' 'topic-llm' 'topic-mcp' 'topic-npx-skills' 'topic-openclaw' 'topic-skills-catalog' 'upstream':82,104,149 'usag':107 'use':80,141 'whether':13,42 'workflow':78","prices":[{"id":"a71cfa98-06e3-4687-96ff-991b57efd5b7","listingId":"a0e6735d-bb68-4089-99ce-17ab0cb3b0da","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"agentskillexchange","category":"skills","install_from":"skills.sh"},"createdAt":"2026-05-18T13:19:11.341Z"}],"sources":[{"listingId":"a0e6735d-bb68-4089-99ce-17ab0cb3b0da","source":"github","sourceId":"agentskillexchange/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas","sourceUrl":"https://github.com/agentskillexchange/skills/tree/main/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas","isPrimary":false,"firstSeenAt":"2026-05-18T13:19:11.341Z","lastSeenAt":"2026-05-18T19:12:19.797Z"}],"details":{"listingId":"a0e6735d-bb68-4089-99ce-17ab0cb3b0da","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"agentskillexchange","slug":"score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas","github":{"repo":"agentskillexchange/skills","stars":8,"topics":["agent-skills","ai-agents","ai-tools","awesome-list","claude-code","codex","cursor","llm","mcp","npx-skills","openclaw","skills-catalog"],"license":"mit","html_url":"https://github.com/agentskillexchange/skills","pushed_at":"2026-05-18T19:02:17Z","description":"The open catalog of AI agent skills — 2,000+ security-scanned skills for Claude Code, Cursor, Codex, and more.","skill_md_sha":"582ef858bed88f740a2ddf642dc8bce7666c4c64","skill_md_path":"skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/agentskillexchange/skills/tree/main/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas"},"layout":"multi","source":"github","category":"skills","frontmatter":{"name":"Score RAG answer quality and retrieval quality before rollout with Ragas","description":"Measure whether a RAG change actually improved answers and retrieval, instead of guessing from a few spot checks."},"skills_sh_url":"https://skills.sh/agentskillexchange/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas"},"updatedAt":"2026-05-18T19:12:19.797Z"}}