{"id":"80442025-18e5-4738-ad79-c5569bad5b9e","shortId":"BQfkDA","kind":"skill","title":"Arize Ai Provider Integration","tagline":"Awesome Copilot skill by Github","description":"# Arize AI Integration Skill\n\n## Concepts\n\n- **AI Integration** = stored LLM provider credentials registered in Arize; used by evaluators to call a judge model and by other Arize features that need to invoke an LLM on your behalf\n- **Provider** = the LLM service backing the integration (e.g., `openAI`, `anthropic`, `awsBedrock`)\n- **Integration ID** = a base64-encoded global identifier for an integration (e.g., `TGxtSW50ZWdyYXRpb246MTI6YUJjRA==`); required for evaluator creation and other downstream operations\n- **Scoping** = visibility rules controlling which spaces or users can use an integration\n- **Auth type** = how Arize authenticates with the provider: `default` (provider API key), `proxy_with_headers` (proxy via custom headers), or `bearer_token` (bearer token auth)\n\n## Prerequisites\n\nProceed directly with the task — run the `ax` command you need. Do NOT check versions, env vars, or profiles upfront.\n\nIf an `ax` command fails, troubleshoot based on the error:\n- `command not found` or version error → see references/ax-setup.md\n- `401 Unauthorized` / missing API key → run `ax profiles show` to inspect the current profile. If the profile is missing or the API key is wrong: check `.env` for `ARIZE_API_KEY` and use it to create/update the profile via references/ax-profiles.md. If `.env` has no key either, ask the user for their Arize API key (https://app.arize.com/admin > API Keys)\n- Space ID unknown → check `.env` for `ARIZE_SPACE_ID`, or run `ax spaces list -o json`, or ask the user\n- LLM provider call fails (missing OPENAI_API_KEY / ANTHROPIC_API_KEY) → check `.env`, load if present, otherwise ask the user\n\n---\n\n## List AI Integrations\n\nList all integrations accessible in a space:\n\n```bash\nax ai-integrations list --space-id SPACE_ID\n```\n\nFilter by name (case-insensitive substring match):\n\n```bash\nax ai-integrations list --space-id SPACE_ID --name \"openai\"\n```\n\nPaginate large result sets:\n\n```bash\n# Get first page\nax ai-integrations list --space-id SPACE_ID --limit 20 -o json\n\n# Get next page using cursor from previous response\nax ai-integrations list --space-id SPACE_ID --limit 20 --cursor CURSOR_TOKEN -o json\n```\n\n**Key flags:**\n\n| Flag | Description |\n|------|-------------|\n| `--space-id` | Space to list integrations in |\n| `--name` | Case-insensitive substring filter on integration name |\n| `--limit` | Max results (1–100, default 50) |\n| `--cursor` | Pagination token from a previous response |\n| `-o, --output` | Output format: `table` (default) or `json` |\n\n**Response fields:**\n\n| Field | Description |\n|-------|-------------|\n| `id` | Base64 integration ID — copy this for downstream commands |\n| `name` | Human-readable name |\n| `provider` | LLM provider enum (see Supported Providers below) |\n| `has_api_key` | `true` if credentials are stored |\n| `model_names` | Allowed model list, or `null` if all models are enabled |\n| `enable_default_models` | Whether default models for this provider are allowed |\n| `function_calling_enabled` | Whether tool/function calling is enabled |\n| `auth_type` | Authentication method: `default`, `proxy_with_headers`, or `bearer_token` |\n\n---\n\n## Get a Specific Integration\n\n```bash\nax ai-integrations get INT_ID\nax ai-integrations get INT_ID -o json\n```\n\nUse this to inspect an integration's full configuration or to confirm its ID after creation.\n\n---\n\n## Create an AI Integration\n\nBefore creating, always list integrations first — the user may already have a suitable one:\n\n```bash\nax ai-integrations list --space-id SPACE_ID\n```\n\nIf no suitable integration exists, create one. The required flags depend on the provider.\n\n### OpenAI\n\n```bash\nax ai-integrations create \\\n  --name \"My OpenAI Integration\" \\\n  --provider openAI \\\n  --api-key $OPENAI_API_KEY\n```\n\n### Anthropic\n\n```bash\nax ai-integrations create \\\n  --name \"My Anthropic Integration\" \\\n  --provider anthropic \\\n  --api-key $ANTHROPIC_API_KEY\n```\n\n### Azure OpenAI\n\n```bash\nax ai-integrations create \\\n  --name \"My Azure OpenAI Integration\" \\\n  --provider azureOpenAI \\\n  --api-key $AZURE_OPENAI_API_KEY \\\n  --base-url \"https://my-resource.openai.azure.com/\"\n```\n\n### AWS Bedrock\n\nAWS Bedrock uses IAM role-based auth instead of an API key. Provide the ARN of the role Arize should assume:\n\n```bash\nax ai-integrations create \\\n  --name \"My Bedrock Integration\" \\\n  --provider awsBedrock \\\n  --role-arn \"arn:aws:iam::123456789012:role/ArizeBedrockRole\"\n```\n\n### Vertex AI\n\nVertex AI uses GCP service account credentials. Provide the GCP project and region:\n\n```bash\nax ai-integrations create \\\n  --name \"My Vertex AI Integration\" \\\n  --provider vertexAI \\\n  --project-id \"my-gcp-project\" \\\n  --location \"us-central1\"\n```\n\n### Gemini\n\n```bash\nax ai-integrations create \\\n  --name \"My Gemini Integration\" \\\n  --provider gemini \\\n  --api-key $GEMINI_API_KEY\n```\n\n### NVIDIA NIM\n\n```bash\nax ai-integrations create \\\n  --name \"My NVIDIA NIM Integration\" \\\n  --provider nvidiaNim \\\n  --api-key $NVIDIA_API_KEY \\\n  --base-url \"https://integrate.api.nvidia.com/v1\"\n```\n\n### Custom (OpenAI-compatible endpoint)\n\n```bash\nax ai-integrations create \\\n  --name \"My Custom Integration\" \\\n  --provider custom \\\n  --base-url \"https://my-llm-proxy.example.com/v1\" \\\n  --api-key $CUSTOM_LLM_API_KEY\n```\n\n### Supported Providers\n\n| Provider | Required extra flags |\n|----------|---------------------|\n| `openAI` | `--api-key <key>` |\n| `anthropic` | `--api-key <key>` |\n| `azureOpenAI` | `--api-key <key>`, `--base-url <azure-endpoint>` |\n| `awsBedrock` | `--role-arn <arn>` |\n| `vertexAI` | `--project-id <gcp-project>`, `--location <region>` |\n| `gemini` | `--api-key <key>` |\n| `nvidiaNim` | `--api-key <key>`, `--base-url <nim-endpoint>` |\n| `custom` | `--base-url <endpoint>` |\n\n### Optional flags for any provider\n\n| Flag | Description |\n|------|-------------|\n| `--model-names` | Comma-separated list of allowed model names; omit to allow all models |\n| `--enable-default-models` / `--no-default-models` | Enable or disable the provider's default model list |\n| `--function-calling` / `--no-function-calling` | Enable or disable tool/function calling support |\n\n### After creation\n\nCapture the returned integration ID (e.g., `TGxtSW50ZWdyYXRpb246MTI6YUJjRA==`) — it is needed for evaluator creation and other downstream commands. If you missed it, retrieve it:\n\n```bash\nax ai-integrations list --space-id SPACE_ID -o json\n# or, if you know the ID:\nax ai-integrations get INT_ID\n```\n\n---\n\n## Update an AI Integration\n\n`update` is a partial update — only the flags you provide are changed. Omitted fields stay as-is.\n\n```bash\n# Rename\nax ai-integrations update INT_ID --name \"New Name\"\n\n# Rotate the API key\nax ai-integrations update INT_ID --api-key $OPENAI_API_KEY\n\n# Change the model list\nax ai-integrations update INT_ID --model-names \"gpt-4o,gpt-4o-mini\"\n\n# Update base URL (for Azure, custom, or NIM)\nax ai-integrations update INT_ID --base-url \"https://new-endpoint.example.com/v1\"\n```\n\nAny flag accepted by `create` can be passed to `update`.\n\n---\n\n## Delete an AI Integration\n\n**Warning:** Deletion is permanent. Evaluators that reference this integration will no longer be able to run.\n\n```bash\nax ai-integrations delete INT_ID --force\n```\n\nOmit `--force` to get a confirmation prompt instead of deleting immediately.\n\n---\n\n## Troubleshooting\n\n| Problem | Solution |\n|---------|----------|\n| `ax: command not found` | See references/ax-setup.md |\n| `401 Unauthorized` | API key may not have access to this space. Verify key and space ID at https://app.arize.com/admin > API Keys |\n| `No profile found` | Run `ax profiles show --expand`; set `ARIZE_API_KEY` env var or write `~/.arize/config.toml` |\n| `Integration not found` | Verify with `ax ai-integrations list --space-id SPACE_ID` |\n| `has_api_key: false` after create | Credentials were not saved — re-run `update` with the correct `--api-key` or `--role-arn` |\n| Evaluator runs fail with LLM errors | Check integration credentials with `ax ai-integrations get INT_ID`; rotate the API key if needed |\n| `provider` mismatch | Cannot change provider after creation — delete and recreate with the correct provider |\n\n---\n\n## Related Skills\n\n- **arize-evaluator**: Create LLM-as-judge evaluators that use an AI integration → use `arize-evaluator`\n- **arize-experiment**: Run experiments that use evaluators backed by an AI integration → use `arize-experiment`\n\n---\n\n## Save Credentials for Future Use\n\nSee references/ax-profiles.md § Save Credentials for Future Use.","tags":["arize","provider","integration","awesome","copilot","github"],"capabilities":["skill","source-github","category-awesome-copilot"],"categories":["awesome-copilot"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/github/awesome-copilot/arize-ai-provider-integration","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"install_from":"skills.sh"}},"qualityScore":"0.300","qualityRationale":"deterministic score 0.30 from registry signals: · indexed on skills.sh · published under github/awesome-copilot","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill:v1","enrichmentVersion":1,"enrichedAt":"2026-04-22T05:40:46.214Z","embedding":null,"createdAt":"2026-04-18T20:36:12.246Z","updatedAt":"2026-04-22T05:40:46.214Z","lastSeenAt":"2026-04-22T05:40:46.214Z","tsv":"'/.arize/config.toml':1103 '/admin':210,1084 '/v1':733,756,1005 '1':366 '100':367 '123456789012':647 '20':314,336 '401':154,1065 '4o':980,983 '50':369 'abl':1033 'accept':1008 'access':259,1072 'account':656 'ai':2,11,15,254,266,285,305,327,468,475,500,519,545,564,584,632,650,652,667,673,692,712,742,890,908,915,939,953,970,995,1018,1039,1111,1155,1194,1211 'ai-integr':265,284,304,326,467,474,518,544,563,583,631,666,691,711,741,889,907,938,952,969,994,1038,1110,1154 'allow':421,441,824,829 'alreadi':511 'alway':504 'anthrop':55,241,560,569,572,576,774 'api':100,157,175,183,206,211,239,242,412,555,558,574,577,595,599,618,702,705,723,726,758,762,772,776,780,796,800,949,959,962,1067,1085,1097,1120,1137,1162 'api-key':554,573,594,701,722,757,771,775,779,795,799,958,1136 'app.arize.com':209,1083 'app.arize.com/admin':208,1082 'ariz':1,10,23,35,93,182,205,219,626,1096,1183,1198,1201,1215 'arize-evalu':1182,1197 'arize-experi':1200,1214 'arn':622,643,644,788,1142 'as-i':932 'ask':200,230,250 'assum':628 'auth':90,114,450,614 'authent':94,452 'aw':605,607,645 'awesom':5 'awsbedrock':56,640,785 'ax':123,138,160,224,264,283,303,325,466,473,517,543,562,582,630,665,690,710,740,888,906,937,951,968,993,1037,1059,1091,1109,1153 'azur':579,589,597,989 'azureopenai':593,778 'back':50,1208 'base':142,602,613,729,752,783,803,807,986,1001 'base-url':601,728,751,782,802,806,1000 'base64':61,390 'base64-encoded':60 'bash':263,282,299,465,516,542,561,581,629,664,689,709,739,887,935,1036 'bearer':110,112,459 'bedrock':606,608,637 'behalf':45 'call':28,235,443,447,851,855,860 'cannot':1168 'captur':864 'case':278,356 'case-insensit':277,355 'category-awesome-copilot' 'central1':687 'chang':928,964,1169 'check':129,179,216,244,1149 'comma':820 'comma-separ':819 'command':124,139,146,397,880,1060 'compat':737 'concept':14 'configur':490 'confirm':493,1050 'control':81 'copi':393 'copilot':6 'correct':1135,1178 'creat':498,503,532,547,566,586,634,669,694,714,744,1010,1124,1185 'create/update':189 'creation':73,497,863,876,1172 'credenti':20,416,657,1125,1151,1218,1225 'current':166 'cursor':321,337,338,370 'custom':107,734,747,750,760,805,990 'default':98,368,382,432,435,454,834,838,846 'delet':1016,1021,1041,1054,1173 'depend':537 'descript':345,388,815 'direct':117 'disabl':842,858 'downstream':76,396,879 'e.g':53,68,869 'either':199 'enabl':430,431,444,449,833,840,856 'enable-default-model':832 'encod':62 'endpoint':738 'enum':406 'env':131,180,195,217,245,1099 'error':145,151,1148 'evalu':26,72,875,1024,1143,1184,1190,1199,1207 'exist':531 'expand':1094 'experi':1202,1204,1216 'extra':768 'fail':140,236,1145 'fals':1122 'featur':36 'field':386,387,930 'filter':274,359 'first':301,507 'flag':343,344,536,769,810,814,924,1007 'forc':1044,1046 'format':380 'found':148,1062,1089,1106 'full':489 'function':442,850,854 'function-cal':849 'futur':1220,1227 'gcp':654,660,682 'gemini':688,697,700,704,794 'get':300,317,461,470,477,910,1048,1157 'github':9 'global':63 'gpt':979,982 'gpt-4o':978 'gpt-4o-mini':981 'header':104,108,457 'human':400 'human-read':399 'iam':610,646 'id':58,214,221,271,273,290,292,310,312,332,334,348,389,392,472,479,495,524,526,679,792,868,895,897,905,912,943,957,974,999,1043,1080,1116,1118,1159 'identifi':64 'immedi':1055 'insensit':279,357 'inspect':164,485 'instead':615,1052 'int':471,478,911,942,956,973,998,1042,1158 'integr':4,12,16,52,57,67,89,255,258,267,286,306,328,352,361,391,464,469,476,487,501,506,520,530,546,551,565,570,585,591,633,638,668,674,693,698,713,719,743,748,867,891,909,916,940,954,971,996,1019,1028,1040,1104,1112,1150,1156,1195,1212 'integrate.api.nvidia.com':732 'integrate.api.nvidia.com/v1':731 'invok':40 'json':228,316,341,384,481,899 'judg':30,1189 'key':101,158,176,184,198,207,212,240,243,342,413,556,559,575,578,596,600,619,703,706,724,727,759,763,773,777,781,797,801,950,960,963,1068,1077,1086,1098,1121,1138,1163 'know':903 'larg':296 'limit':313,335,363 'list':226,253,256,268,287,307,329,351,423,505,521,822,848,892,967,1113 'llm':18,42,48,233,404,761,1147,1187 'llm-as-judg':1186 'load':246 'locat':684,793 'longer':1031 'match':281 'max':364 'may':510,1069 'method':453 'mini':984 'mismatch':1167 'miss':156,172,237,883 'model':31,419,422,428,433,436,817,825,831,835,839,847,966,976 'model-nam':816,975 'my-gcp-project':680 'my-llm-proxy.example.com':755 'my-llm-proxy.example.com/v1':754 'my-resource.openai.azure.com':604 'name':276,293,354,362,398,402,420,548,567,587,635,670,695,715,745,818,826,944,946,977 'need':38,126,873,1165 'new':945 'new-endpoint.example.com':1004 'new-endpoint.example.com/v1':1003 'next':318 'nim':708,718,992 'no-default-model':836 'no-function-cal':852 'null':425 'nvidia':707,717,725 'nvidianim':721,798 'o':227,315,340,377,480,898 'omit':827,929,1045 'one':515,533 'openai':54,238,294,541,550,553,557,580,590,598,736,770,961 'openai-compat':735 'oper':77 'option':809 'otherwis':249 'output':378,379 'page':302,319 'pagin':295,371 'partial':920 'pass':1013 'perman':1023 'prerequisit':115 'present':248 'previous':323,375 'problem':1057 'proceed':116 'profil':134,161,167,170,191,1088,1092 'project':661,678,683,791 'project-id':677,790 'prompt':1051 'provid':3,19,46,97,99,234,403,405,409,439,540,552,571,592,620,639,658,675,699,720,749,765,766,813,844,926,1166,1170,1179 'proxi':102,105,455 're':1130 're-run':1129 'readabl':401 'recreat':1175 'refer':1026 'references/ax-profiles.md':193,1223 'references/ax-setup.md':153,1064 'region':663 'regist':21 'relat':1180 'renam':936 'requir':70,535,767 'respons':324,376,385 'result':297,365 'retriev':885 'return':866 'role':612,625,642,787,1141 'role-arn':641,786,1140 'role-bas':611 'role/arizebedrockrole':648 'rotat':947,1160 'rule':80 'run':121,159,223,1035,1090,1131,1144,1203 'save':1128,1217,1224 'scope':78 'see':152,407,1063,1222 'separ':821 'servic':49,655 'set':298,1095 'show':162,1093 'skill':7,13,1181 'solut':1058 'source-github' 'space':83,213,220,225,262,270,272,289,291,309,311,331,333,347,349,523,525,894,896,1075,1079,1115,1117 'space-id':269,288,308,330,346,522,893,1114 'specif':463 'stay':931 'store':17,418 'substr':280,358 'suitabl':514,529 'support':408,764,861 'tabl':381 'task':120 'tgxtsw50zwdyyxrpb246mti6yujjra':69,870 'token':111,113,339,372,460 'tool/function':446,859 'troubleshoot':141,1056 'true':414 'type':91,451 'unauthor':155,1066 'unknown':215 'updat':913,917,921,941,955,972,985,997,1015,1132 'upfront':135 'url':603,730,753,784,804,808,987,1002 'us':686 'us-central1':685 'use':24,87,186,320,482,609,653,1192,1196,1206,1213,1221,1228 'user':85,202,232,252,509 'var':132,1100 'verifi':1076,1107 'version':130,150 'vertex':649,651,672 'vertexai':676,789 'via':106,192 'visibl':79 'warn':1020 'whether':434,445 'write':1102 'wrong':178","prices":[{"id":"48dbc323-6085-4f5d-9502-da8c007a1e93","listingId":"80442025-18e5-4738-ad79-c5569bad5b9e","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"github","category":"awesome-copilot","install_from":"skills.sh"},"createdAt":"2026-04-18T20:36:12.246Z"}],"sources":[{"listingId":"80442025-18e5-4738-ad79-c5569bad5b9e","source":"github","sourceId":"github/awesome-copilot/arize-ai-provider-integration","sourceUrl":"https://github.com/github/awesome-copilot/tree/main/skills/arize-ai-provider-integration","isPrimary":false,"firstSeenAt":"2026-04-18T21:48:12.646Z","lastSeenAt":"2026-04-22T00:52:03.542Z"},{"listingId":"80442025-18e5-4738-ad79-c5569bad5b9e","source":"skills_sh","sourceId":"github/awesome-copilot/arize-ai-provider-integration","sourceUrl":"https://skills.sh/github/awesome-copilot/arize-ai-provider-integration","isPrimary":true,"firstSeenAt":"2026-04-18T20:36:12.246Z","lastSeenAt":"2026-04-22T05:40:46.214Z"}],"details":{"listingId":"80442025-18e5-4738-ad79-c5569bad5b9e","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"github","slug":"arize-ai-provider-integration","source":"skills_sh","category":"awesome-copilot","skills_sh_url":"https://skills.sh/github/awesome-copilot/arize-ai-provider-integration"},"updatedAt":"2026-04-22T05:40:46.214Z"}}