{"id":"9fdf68be-5cf3-47c1-b67b-9dc2a4f581bc","shortId":"tgqQUE","kind":"skill","title":"LangSmith SDK for LLM Tracing and Evaluation","tagline":"LangSmith provides tracing, evaluation, and debugging workflows for LLM applications. This skill is useful when an agent team needs structured observability around prompts, chains, tool calls, datasets, and eval runs across multiple frameworks.","description":"# LangSmith SDK for LLM Tracing and Evaluation\n\nLangSmith provides tracing, evaluation, and debugging workflows for LLM applications. This skill is useful when an agent team needs structured observability around prompts, chains, tool calls, datasets, and eval runs across multiple frameworks.\n\n## Installation\n\nUse the upstream install or setup path that matches your environment:\n- pip install -U langsmith\n- pnpm add langsmith\n\nRequirements and caveats from upstream:\n- [![Release Notes](https://img.shields.io/github/release/langchain-ai/langsmith-sdk?logo=python)](https://github.com/langchain-ai/langsmith-sdk/releases)\n- [![Python Downloads](https://img.shields.io/pypi/dm/langsmith)](https://pypi.org/project/langsmith/)\n- This repository contains the Python and Javascript SDK's for interacting with the [LangSmith platform](https://smith.langchain.com/). Please see [LangSmith Documentation](https://docs.smith.langchain.com/)\n\nBasic usage or getting-started notes:\n- bash\n- export LANGSMITH_TRACING=true\n- export LANGSMITH_API_KEY=ls_...\n\n- Source: https://github.com/langchain-ai/langsmith-sdk\n- Extracted from upstream docs: https://raw.githubusercontent.com/langchain-ai/langsmith-sdk/HEAD/README.md\n\n## Source\n\n- [Agent Skill Exchange](https://agentskillexchange.com/skills/langsmith-sdk-for-llm-tracing-and-evaluation/)","tags":["langsmith","sdk","for","llm","tracing","and","evaluation","skills","agentskillexchange","agent-skills","ai-agents","ai-tools"],"capabilities":["skill","source-agentskillexchange","skill-langsmith-sdk-for-llm-tracing-and-evaluation","topic-agent-skills","topic-ai-agents","topic-ai-tools","topic-awesome-list","topic-claude-code","topic-codex","topic-cursor","topic-llm","topic-mcp","topic-npx-skills","topic-openclaw","topic-skills-catalog"],"categories":["skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/agentskillexchange/skills/langsmith-sdk-for-llm-tracing-and-evaluation","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add agentskillexchange/skills","source_repo":"https://github.com/agentskillexchange/skills","install_from":"skills.sh"}},"qualityScore":"0.454","qualityRationale":"deterministic score 0.45 from registry signals: · indexed on github topic:agent-skills · 8 github stars · SKILL.md body (1,334 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-05-18T19:11:07.466Z","embedding":null,"createdAt":"2026-05-18T13:17:28.705Z","updatedAt":"2026-05-18T19:11:07.466Z","lastSeenAt":"2026-05-18T19:11:07.466Z","tsv":"'/)':139 '/).':132 '/github/release/langchain-ai/langsmith-sdk?logo=python)](https://github.com/langchain-ai/langsmith-sdk/releases)':109 '/langchain-ai/langsmith-sdk':160 '/langchain-ai/langsmith-sdk/head/readme.md':167 '/pypi/dm/langsmith)](https://pypi.org/project/langsmith/)':114 '/skills/langsmith-sdk-for-llm-tracing-and-evaluation/)':174 'across':38,78 'add':98 'agent':24,64,169 'agentskillexchange.com':173 'agentskillexchange.com/skills/langsmith-sdk-for-llm-tracing-and-evaluation/)':172 'api':154 'applic':17,57 'around':29,69 'bash':147 'basic':140 'call':33,73 'caveat':102 'chain':31,71 'contain':117 'dataset':34,74 'debug':13,53 'doc':164 'docs.smith.langchain.com':138 'docs.smith.langchain.com/)':137 'document':136 'download':111 'environ':92 'eval':36,76 'evalu':7,11,47,51 'exchang':171 'export':148,152 'extract':161 'framework':40,80 'get':144 'getting-start':143 'github.com':159 'github.com/langchain-ai/langsmith-sdk':158 'img.shields.io':108,113 'img.shields.io/github/release/langchain-ai/langsmith-sdk?logo=python)](https://github.com/langchain-ai/langsmith-sdk/releases)':107 'img.shields.io/pypi/dm/langsmith)](https://pypi.org/project/langsmith/)':112 'instal':81,85,94 'interact':125 'javascript':121 'key':155 'langsmith':1,8,41,48,96,99,128,135,149,153 'llm':4,16,44,56 'ls':156 'match':90 'multipl':39,79 'need':26,66 'note':106,146 'observ':28,68 'path':88 'pip':93 'platform':129 'pleas':133 'pnpm':97 'prompt':30,70 'provid':9,49 'python':110,119 'raw.githubusercontent.com':166 'raw.githubusercontent.com/langchain-ai/langsmith-sdk/head/readme.md':165 'releas':105 'repositori':116 'requir':100 'run':37,77 'sdk':2,42,122 'see':134 'setup':87 'skill':19,59,170 'skill-langsmith-sdk-for-llm-tracing-and-evaluation' 'smith.langchain.com':131 'smith.langchain.com/).':130 'sourc':157,168 'source-agentskillexchange' 'start':145 'structur':27,67 'team':25,65 'tool':32,72 'topic-agent-skills' 'topic-ai-agents' 'topic-ai-tools' 'topic-awesome-list' 'topic-claude-code' 'topic-codex' 'topic-cursor' 'topic-llm' 'topic-mcp' 'topic-npx-skills' 'topic-openclaw' 'topic-skills-catalog' 'trace':5,10,45,50,150 'true':151 'u':95 'upstream':84,104,163 'usag':141 'use':21,61,82 'workflow':14,54","prices":[{"id":"f3812171-05e2-4824-9d32-80ad93b972ea","listingId":"9fdf68be-5cf3-47c1-b67b-9dc2a4f581bc","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"agentskillexchange","category":"skills","install_from":"skills.sh"},"createdAt":"2026-05-18T13:17:28.705Z"}],"sources":[{"listingId":"9fdf68be-5cf3-47c1-b67b-9dc2a4f581bc","source":"github","sourceId":"agentskillexchange/skills/langsmith-sdk-for-llm-tracing-and-evaluation","sourceUrl":"https://github.com/agentskillexchange/skills/tree/main/skills/langsmith-sdk-for-llm-tracing-and-evaluation","isPrimary":false,"firstSeenAt":"2026-05-18T13:17:28.705Z","lastSeenAt":"2026-05-18T19:11:07.466Z"}],"details":{"listingId":"9fdf68be-5cf3-47c1-b67b-9dc2a4f581bc","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"agentskillexchange","slug":"langsmith-sdk-for-llm-tracing-and-evaluation","github":{"repo":"agentskillexchange/skills","stars":8,"topics":["agent-skills","ai-agents","ai-tools","awesome-list","claude-code","codex","cursor","llm","mcp","npx-skills","openclaw","skills-catalog"],"license":"mit","html_url":"https://github.com/agentskillexchange/skills","pushed_at":"2026-05-18T19:02:17Z","description":"The open catalog of AI agent skills — 2,000+ security-scanned skills for Claude Code, Cursor, Codex, and more.","skill_md_sha":"d9893a8e80f20d3f0a8837b48f7765a7d4e38acf","skill_md_path":"skills/langsmith-sdk-for-llm-tracing-and-evaluation/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/agentskillexchange/skills/tree/main/skills/langsmith-sdk-for-llm-tracing-and-evaluation"},"layout":"multi","source":"github","category":"skills","frontmatter":{"name":"LangSmith SDK for LLM Tracing and Evaluation","description":"LangSmith provides tracing, evaluation, and debugging workflows for LLM applications. This skill is useful when an agent team needs structured observability around prompts, chains, tool calls, datasets, and eval runs across multiple frameworks."},"skills_sh_url":"https://skills.sh/agentskillexchange/skills/langsmith-sdk-for-llm-tracing-and-evaluation"},"updatedAt":"2026-05-18T19:11:07.466Z"}}