{"id":"3f902542-0fb0-4f05-bee3-01b9c2e5e76a","shortId":"c9JuvE","kind":"skill","title":"azure-databricks","tagline":"Expert knowledge for Azure Databricks development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Unity Catalog, Delta/Lakeflow pip","description":"# Azure Databricks Skill\n\nThis skill provides expert guidance for Azure Databricks. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.\n\n## How to Use This Skill\n\n> **IMPORTANT for Agent**: Use the **Category Index** below to locate relevant sections. For categories with line ranges (e.g., `L35-L120`), use `read_file` with the specified lines. For categories with file links (e.g., `[security.md](security.md)`), use `read_file` on the linked reference file\n\n> **IMPORTANT for Agent**: If `metadata.generated_at` is more than 3 months old, suggest the user pull the latest version from the repository. If `mcp_microsoftdocs` tools are not available, suggest the user install it: [Installation Guide](https://github.com/MicrosoftDocs/mcp/blob/main/README.md)\n\nThis skill requires **network access** to fetch documentation content:\n- **Preferred**: Use `mcp_microsoftdocs:microsoft_docs_fetch` with query string `from=learn-agent-skill`. Returns Markdown.\n- **Fallback**: Use `fetch_webpage` with query string `from=learn-agent-skill&accept=text/markdown`. Returns Markdown.\n\n## Category Index\n\n| Category | Location | Description |\n|----------|----------|-------------|\n| Troubleshooting | L37-L139 | Diagnosing and fixing Databricks issues: cluster startup/termination, Spark and SQL errors, connectors/Lakeflow ingestion, VS Code/CLI/Connect, model serving, AI agents, and performance debugging. |\n| Best Practices | L140-L308 | Best-practice guidance for Databricks architecture, performance, cost, governance, streaming, Lakeflow, ML/LLM/MLOps, Vector Search, BI, and operational reliability across the lakehouse. |\n| Decision Making | L309-L400 | Guides for architectural and migration decisions: choosing compute, runtimes, Unity Catalog, budgets, networking, ML/LLM options, ingestion, and lakehouse deployment patterns. |\n| Architecture & Design Patterns | L401-L439 | Architectural blueprints and patterns for Databricks: lakehouse, networking, storage, HA/DR, governance, performance, cost, streaming, Lakebase, ML/MLOps, RAG, agents, and IDP pipelines. |\n| Limits & Quotas | [limits-quotas.md](limits-quotas.md) | Quotas, limits, and constraints for Azure Databricks compute, connectors, Lakeflow, Lakebase, model serving, tokens, APIs, data types, dashboards, and Unity Catalog resources. |\n| Security | [security.md](security.md) | Security, identity, and compliance for Azure Databricks: authN/authZ, Unity Catalog/ABAC, networking, encryption, secrets, audit logs, compliance controls, and secure external/ingestion integrations. |\n| Configuration | [configuration.md](configuration.md) | Configuring and administering Azure Databricks: accounts, workspaces, security, networking, compute, jobs, data/UC/Delta/Lakeflow, ML/serving, agents, Marketplace, and SQL/runtime settings. |\n| Integrations & Coding Patterns | [integrations.md](integrations.md) | Patterns and APIs for integrating Databricks with external data systems, tools, and AI/ML frameworks, plus detailed PySpark/SQL function references and Lakehouse Federation connectivity. |\n| Deployment | [deployment.md](deployment.md) | Deploying and operating Databricks workspaces, CI/CD, IaC, model/feature serving, AI agents, dashboards, and migrations (Unity Catalog, Feature Store, routing, charts) across Azure environments |\n\n### Troubleshooting\n| Topic | URL |\n|-------|-----|\n| Interpret Azure Databricks diagnostic audit log events | https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/audit-logs |\n| Troubleshoot Azure Databricks compute startup issues | https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/ |\n| Resolve Databricks classic compute termination error codes | https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes |\n| Debug Spark applications using Databricks Spark UI | https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui |\n| Troubleshoot Apache Kafka usage on Databricks | https://learn.microsoft.com/en-us/azure/databricks/connect/streaming/kafka/faq |\n| Diagnose and fix common Delta Sharing errors | https://learn.microsoft.com/en-us/azure/databricks/delta-sharing/troubleshooting |\n| Troubleshoot common Databricks CLI issues | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/troubleshooting |\n| Diagnose and fix Databricks Connect Python issues | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting |\n| Diagnose and fix Databricks Connect Scala issues | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting |\n| Troubleshoot common Databricks Terraform provider errors | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/troubleshoot |\n| Resolve common issues with Databricks VS Code extension | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/faqs |\n| Troubleshoot Databricks VS Code extension errors | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting |\n| Resolve ARITHMETIC_OVERFLOW errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class |\n| Handle CAST_INVALID_INPUT errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/cast-invalid-input-error-class |\n| Diagnose DC_GA4_RAW_DATA_ERROR in GA4 connector | https://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class |\n| Understand DC_SFDC_API_ERROR in Databricks connectors | https://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class |\n| Diagnose DC_SQLSERVER_ERROR in SQL Server connector | https://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class |\n| Understand DELTA_ICEBERG_COMPAT_V1_VIOLATION errors | https://learn.microsoft.com/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class |\n| Handle DIVIDE_BY_ZERO errors in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/error-messages/divide-by-zero-error-class |\n| Handle Azure Databricks named error conditions | https://learn.microsoft.com/en-us/azure/databricks/error-messages/error-classes |\n| Fix EWKB_PARSE_ERROR geometry parsing issues | https://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class |\n| Fix EWKT_PARSE_ERROR geometry parsing issues | https://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class |\n| Resolve GEOJSON_PARSE_ERROR in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/geojson-parse-error-error-class |\n| Address GROUP_BY_AGGREGATE errors in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/error-messages/group-by-aggregate-error-class |\n| Handle H3_INVALID_CELL_ID errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class |\n| Interpret and resolve H3_INVALID_GRID_DISTANCE_VALUE in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class |\n| Handle H3_INVALID_RESOLUTION_VALUE errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class |\n| Resolve H3_NOT_ENABLED errors and tier requirements | https://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-not-enabled-error-class |\n| Fix INSUFFICIENT_TABLE_PROPERTY errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/insufficient-table-property-error-class |\n| Troubleshoot INVALID_ARRAY_INDEX errors in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-error-class |\n| Troubleshoot INVALID_ARRAY_INDEX_IN_ELEMENT_AT in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class |\n| Resolve MISSING_AGGREGATION errors in Databricks queries | https://learn.microsoft.com/en-us/azure/databricks/error-messages/missing-aggregation-error-class |\n| Diagnose ROW_COLUMN_ACCESS errors for filters and masks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/row-column-access-error-class |\n| Interpret Azure Databricks SQLSTATE error codes | https://learn.microsoft.com/en-us/azure/databricks/error-messages/sqlstates |\n| Fix TABLE_OR_VIEW_NOT_FOUND errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class |\n| Resolve UNRESOLVED_ROUTINE function resolution errors | https://learn.microsoft.com/en-us/azure/databricks/error-messages/unresolved-routine-error-class |\n| Understand UNSUPPORTED_TABLE_OPERATION errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class |\n| Understand UNSUPPORTED_VIEW_OPERATION errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class |\n| Troubleshoot WKB_PARSE_ERROR for geometry parsing | https://learn.microsoft.com/en-us/azure/databricks/error-messages/wkb-parse-error-error-class |\n| Troubleshoot WKT_PARSE_ERROR for geometry parsing | https://learn.microsoft.com/en-us/azure/databricks/error-messages/wkt-parse-error-error-class |\n| Troubleshoot MLflow 2 Agent Evaluation issues | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/troubleshooting |\n| Troubleshoot and debug Databricks AI agents | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/debug-agent |\n| Diagnose and fix common Genie Space issues | https://learn.microsoft.com/en-us/azure/databricks/genie/troubleshooting |\n| Troubleshoot common Databricks Auto Loader issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/faq |\n| Resolve common Confluence connector ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-faq |\n| Troubleshoot authentication and rate limit errors for Confluence | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot |\n| Troubleshoot Dynamics 365 Lakeflow ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot |\n| Resolve common issues with Lakeflow managed connectors | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/faq |\n| Troubleshoot Google Ads connector ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot |\n| Troubleshoot Google Analytics raw data ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot |\n| Troubleshoot common HubSpot connector ingestion problems | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot |\n| Troubleshoot Jira Lakeflow ingestion errors | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot |\n| Troubleshoot Meta Ads ingestion connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot |\n| Diagnose and fix MySQL Lakeflow Connect ingestion | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot |\n| Troubleshoot common Outlook connector ingestion errors | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/outlook-troubleshoot |\n| Troubleshoot PostgreSQL Lakeflow Connect ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot |\n| Troubleshoot Lakeflow Connect query-based connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot |\n| Troubleshoot Salesforce Lakeflow ingestion problems | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot |\n| Diagnose and fix Databricks ServiceNow connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot |\n| Diagnose and fix Lakeflow SharePoint connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot |\n| Troubleshoot Databricks Smartsheet connector errors | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/smartsheet-troubleshoot |\n| Answer common SQL Server Lakeflow Connect connector questions | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-faq |\n| Resolve SQL Server Lakeflow Connect ingestion problems | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot |\n| Troubleshoot TikTok Ads connector in Lakeflow | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot |\n| Troubleshoot Workday HCM connector in Lakeflow | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot |\n| Diagnose and fix Databricks Workday connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot |\n| Resolve common Zendesk Support connector errors | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot |\n| Handle Zerobus Ingest errors and retries | https://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-errors |\n| Inspect logs for Databricks init script execution | https://learn.microsoft.com/en-us/azure/databricks/init-scripts/logs |\n| Test and validate Databricks ODBC driver connections | https://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/testing |\n| Configure and troubleshoot Lakeflow Jobs with many tasks | https://learn.microsoft.com/en-us/azure/databricks/jobs/large-jobs |\n| Monitor and inspect Lakeflow Jobs runs and history | https://learn.microsoft.com/en-us/azure/databricks/jobs/monitor |\n| Troubleshoot and repair Azure Databricks Lakeflow job failures | https://learn.microsoft.com/en-us/azure/databricks/jobs/repair-job-failures |\n| Monitor and troubleshoot Lakeflow Spark pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/observability |\n| Use pipeline query history for debugging and tuning | https://learn.microsoft.com/en-us/azure/databricks/ldp/query-history |\n| Recover Lakeflow pipelines from streaming checkpoint failures | https://learn.microsoft.com/en-us/azure/databricks/ldp/recover-streaming |\n| User guides, migration, and troubleshooting for AI Runtime | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides |\n| Diagnose and resolve Databricks Feature Store issues | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations |\n| Debug common Databricks model serving issues | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug |\n| Diagnose Databricks model serving issues with Genie Code | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code |\n| Debug Python code in Databricks notebooks | https://learn.microsoft.com/en-us/azure/databricks/notebooks/debugger |\n| Troubleshoot failing Spark jobs and executors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs |\n| Use Databricks Spark jobs timeline for debugging | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline |\n| Diagnose long-running Spark stages in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage |\n| Investigate high I/O Spark stages in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io |\n| Debug slow low-I/O Spark stages in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io |\n| Identify expensive reads in Spark DAG on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read |\n| Diagnose gaps between Spark jobs in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps |\n| Diagnose and fix Spark memory issues on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues |\n| Troubleshoot Azure Databricks Partner Connect issues | https://learn.microsoft.com/en-us/azure/databricks/partner-connect/troubleshoot |\n| Troubleshoot common Azure Databricks Git folder errors | https://learn.microsoft.com/en-us/azure/databricks/repos/errors-troubleshooting |\n| Fetch cursor rows and handle SQLSTATE in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/fetch-stmt |\n| Use GET DIAGNOSTICS for SQL error handling in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/get-diagnostics-stmt |\n| Open cursors and handle errors with OPEN in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/open-stmt |\n| Validate UTF-8 strings and handle INVALID_UTF8_STRING | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/validate_utf8 |\n| Interpret Databricks SQL query performance insights | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/performance-insights |\n| Use Databricks SQL query history to debug performance | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-history |\n| Analyze Databricks SQL query profiles to find bottlenecks | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-profile |\n| Troubleshoot and configure Databricks SQL scheduled queries | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/schedule-query |\n\n### Best Practices\n| Topic | URL |\n|-------|-----|\n| Apply Databricks usage tags for accurate cost attribution | https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/usage-detail-tags |\n| Use default Databricks policy families to enforce compute best practices | https://learn.microsoft.com/en-us/azure/databricks/admin/clusters/policy-families |\n| Apply Azure Databricks identity configuration best practices | https://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices |\n| Configure default deletion vectors for Databricks Delta tables | https://learn.microsoft.com/en-us/azure/databricks/admin/workspace-settings/deletion-vectors |\n| Apply best practices for Azure Databricks serverless workspaces | https://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices |\n| Migrate Databricks library installs from init scripts | https://learn.microsoft.com/en-us/azure/databricks/archive/compute/libraries-init-scripts |\n| Apply compute policy best practices in Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/archive/compute/policies-best-practices |\n| Use DBIO for transactional writes to cloud storage in Databricks | https://learn.microsoft.com/en-us/azure/databricks/archive/legacy/dbio-commit |\n| Optimize skewed joins in Databricks using skew hints | https://learn.microsoft.com/en-us/azure/databricks/archive/legacy/skew-join |\n| Migrate from Databricks Deep Learning Pipelines | https://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines |\n| Use advanced techniques in Databricks metric views | https://learn.microsoft.com/en-us/azure/databricks/business-semantics/metric-views/advanced-techniques |\n| Apply Azure Databricks administration best practices | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/administration |\n| Optimize BI performance with Databricks SQL warehouses | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving |\n| Prepare and model data for high-performance BI on Databricks | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep |\n| Configure Databricks SQL warehouses for optimal BI serving | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving |\n| Apply Azure Databricks compute creation best practices | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/compute |\n| Implement Azure Databricks production job scheduling best practices | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/jobs |\n| Best practices for Power BI dashboards on Databricks | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/power-bi |\n| Apply Databricks compute configuration best practices | https://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices |\n| Use flexible node types for reliable Databricks compute | https://learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-types |\n| Apply best practices for Databricks pools | https://learn.microsoft.com/en-us/azure/databricks/compute/pool-best-practices |\n| Apply serverless compute best practices in Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/compute/serverless/best-practices |\n| Tune Databricks SQL warehouses for BI workloads | https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings |\n| Use system table queries to monitor Databricks SQL warehouses | https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/monitor/queries |\n| Control large interactive queries with Query Watchdog | https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/query-watchdog |\n| Apply observability best practices for Databricks jobs and pipelines | https://learn.microsoft.com/en-us/azure/databricks/data-engineering/observability-best-practices |\n| Best practices for designing Unity Catalog ABAC policies | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/best-practices |\n| Optimize performance of Unity Catalog ABAC policies | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/performance |\n| Apply Unity Catalog data governance best practices | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/best-practices |\n| Apply row filters and column masks in Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/filters-and-masks/ |\n| Work with legacy Hive metastore database objects | https://learn.microsoft.com/en-us/azure/databricks/database-objects/hive-metastore |\n| Follow DBFS root storage recommendations in Databricks | https://learn.microsoft.com/en-us/azure/databricks/dbfs/dbfs-root |\n| Migrate from DBFS mounts to Unity Catalog external locations | https://learn.microsoft.com/en-us/azure/databricks/dbfs/mounts |\n| Apply DBFS and Unity Catalog usage best practices | https://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog |\n| Optimize Delta Sharing to reduce cloud egress costs | https://learn.microsoft.com/en-us/azure/databricks/delta-sharing/manage-egress |\n| Apply Delta Lake best practices on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/best-practices |\n| Optimize tables with liquid clustering instead of partitioning | https://learn.microsoft.com/en-us/azure/databricks/delta/clustering |\n| Tune Azure Databricks data skipping with stats and Z-order | https://learn.microsoft.com/en-us/azure/databricks/delta/data-skipping |\n| Use deletion vectors to optimize Delta table updates | https://learn.microsoft.com/en-us/azure/databricks/delta/deletion-vectors |\n| Drop or replace Delta and Unity Catalog tables safely | https://learn.microsoft.com/en-us/azure/databricks/delta/drop-table |\n| Optimize Delta table file layout on Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/optimize |\n| Handle Delta Lake limitations on Amazon S3 | https://learn.microsoft.com/en-us/azure/databricks/delta/s3-limitations |\n| Use selective overwrite options in Delta Lake | https://learn.microsoft.com/en-us/azure/databricks/delta/selective-overwrite |\n| Control Delta table data file size on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/tune-file-size |\n| Vacuum Delta tables and manage retention safely | https://learn.microsoft.com/en-us/azure/databricks/delta/vacuum |\n| Optimize VARIANT data performance with shredding on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/variant-shredding |\n| Apply MLOps Stack best practices with bundles | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/bundles/mlops-stacks |\n| Apply CI/CD best practices on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/best-practices |\n| View Databricks cluster policy families via CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/policy-families-commands |\n| Apply security and performance best practices for Databricks apps | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/best-practices |\n| Test Databricks Connect for Python code with pytest | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/testing |\n| Handle async queries and interruptions in Databricks Connect | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/queries |\n| Choose between Databricks volumes and workspace files | https://learn.microsoft.com/en-us/azure/databricks/files/files-recommendations |\n| Orchestrate multi-agent systems with Supervisor Agent | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/multi-agent-supervisor |\n| Apply best practices for MLflow 2 evaluation sets | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/evaluation-set |\n| Follow an end-to-end Databricks agents development workflow | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/guide/agents-dev-workflow |\n| Measure RAG performance with Databricks metrics | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-assess-performance |\n| Evaluate and monitor RAG apps on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag |\n| Optimize Databricks RAG application quality | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-overview |\n| Improve Databricks RAG chain quality | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-rag-chain |\n| Write effective custom instructions for Genie Code | https://learn.microsoft.com/en-us/azure/databricks/genie-code/instructions |\n| Apply practical tips to improve Genie Code responses | https://learn.microsoft.com/en-us/azure/databricks/genie-code/tips |\n| Use Genie Agent mode for complex analysis | https://learn.microsoft.com/en-us/azure/databricks/genie/agent-mode |\n| Evaluate Genie Spaces using benchmarks | https://learn.microsoft.com/en-us/azure/databricks/genie/benchmarks |\n| Apply best practices to curate Genie Spaces | https://learn.microsoft.com/en-us/azure/databricks/genie/best-practices |\n| Migrate existing Auto Loader streams to file events | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/migrating-to-file-events |\n| Configure Auto Loader for production workloads | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production |\n| Apply common COPY INTO data loading patterns | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples |\n| Apply common patterns for Lakeflow ingestion | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns |\n| Perform full refreshes of Lakeflow target tables | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/full-refresh |\n| Maintain Lakeflow managed ingestion pipelines | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pipeline-maintenance |\n| Maintain and operate PostgreSQL ingestion pipelines in Lakeflow | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance |\n| Enable incremental ingestion for Salesforce formula fields | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields |\n| Use Databricks init scripts for cluster customization | https://learn.microsoft.com/en-us/azure/databricks/init-scripts/ |\n| Reference external files safely in Databricks init scripts | https://learn.microsoft.com/en-us/azure/databricks/init-scripts/referencing-files |\n| Configure and optimize compute for Lakeflow Jobs | https://learn.microsoft.com/en-us/azure/databricks/jobs/compute |\n| Build metadata-driven For each jobs with control tables | https://learn.microsoft.com/en-us/azure/databricks/jobs/how-to/foreach-sql-lookup-tutorial |\n| Apply best practices for configuring classic Lakeflow Jobs | https://learn.microsoft.com/en-us/azure/databricks/jobs/run-classic-jobs |\n| Apply cost optimization best practices on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices |\n| Implement best practices for Databricks data and AI governance | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices |\n| Design observability and monitoring strategy for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability |\n| Apply interoperability and usability best practices on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices |\n| Implement operational excellence best practices on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices |\n| Apply performance best practices for Azure Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices |\n| Apply reliability best practices on Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices |\n| Implement security and compliance best practices in Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/security-compliance-and-privacy/best-practices |\n| Optimize Lakeflow pipelines with enhanced autoscaling | https://learn.microsoft.com/en-us/azure/databricks/ldp/auto-scaling |\n| Apply best practices for Lakeflow Spark Declarative Pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices |\n| Use advanced AUTO CDC features and monitor processing metrics | https://learn.microsoft.com/en-us/azure/databricks/ldp/cdc-advanced |\n| Develop and test Lakeflow Spark Declarative Pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/develop |\n| Manage Python dependencies safely in Databricks pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/external-dependencies |\n| Implement advanced expectation patterns at scale | https://learn.microsoft.com/en-us/azure/databricks/ldp/expectation-patterns |\n| Reduce high initialization times in Lakeflow pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/fix-high-init |\n| Backfill historical data with Lakeflow pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/flows-backfill |\n| Run full refresh operations for Databricks streaming tables safely | https://learn.microsoft.com/en-us/azure/databricks/ldp/full-refresh-st |\n| Optimize stateful stream processing with watermarks | https://learn.microsoft.com/en-us/azure/databricks/ldp/stateful-processing |\n| Design CDC and snapshot patterns in Databricks | https://learn.microsoft.com/en-us/azure/databricks/ldp/what-is-change-data-capture |\n| Restart the Python process to refresh Databricks libraries | https://learn.microsoft.com/en-us/azure/databricks/libraries/restart-python-process |\n| Apply data loading best practices on Databricks AI Runtime | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/dataloading |\n| Apply Hyperopt best practices on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices |\n| Improve Databricks AutoML forecasting with covariates | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl/automl-covariate-forecast |\n| Implement point-in-time correct feature joins for time series ML | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/time-series |\n| Benchmark Databricks LLM endpoints for latency and TPS | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark |\n| Implement LLMOps workflows on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/llmops |\n| Validate models before Databricks serving deployment | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation |\n| Monitor Databricks model quality and endpoint health | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/monitor-diagnose-endpoints |\n| Optimize Databricks Model Serving endpoints for production | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/production-optimization |\n| Load test Databricks Mosaic AI serving endpoints | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test |\n| Tune and scale Ray clusters on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/scale-ray |\n| Follow deep learning best practices on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/dl-best-practices |\n| Fine-tune Hugging Face models on a single GPU in Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/huggingface/fine-tune-model |\n| Prepare datasets for Hugging Face fine-tuning on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/huggingface/load-data |\n| Adapt Apache Spark workloads for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/migration/spark |\n| Align MLflow LLM judges with human evaluators | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges |\n| Evaluate and compare MLflow prompt versions effectively | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts |\n| Use manual MLflow tracing for production GenAI apps | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/manual-tracing/ |\n| Analyze GenAI traces for errors and performance | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces |\n| Run Databricks notebooks safely and efficiently | https://learn.microsoft.com/en-us/azure/databricks/notebooks/run-notebook |\n| Test and schedule Databricks notebook code | https://learn.microsoft.com/en-us/azure/databricks/notebooks/test-notebooks |\n| Create and manage Lakebase read replicas | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/manage-read-replicas |\n| Monitor Lakebase queries using pg_stat_statements | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/pg-stat-statements |\n| Apply performance optimization recommendations on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/ |\n| Use adaptive query execution on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/aqe |\n| Leverage cost-based optimizer in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/optimizations/cbo |\n| Improve read performance with Databricks disk cache | https://learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache |\n| Improve Delta query performance with dynamic file pruning on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/dynamic-file-pruning |\n| Accelerate data access with predictive I/O | https://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-io |\n| Use predictive optimization for Unity Catalog tables | https://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-optimization |\n| Tune Azure Databricks range join optimization | https://learn.microsoft.com/en-us/azure/databricks/optimizations/range-join |\n| Diagnose Databricks Spark cost and performance in UI | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/ |\n| Debug skew and spill in Databricks Spark stages | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page |\n| Handle Databricks spot instance losses effectively | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances |\n| Resolve long Spark stages with a single task | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task |\n| Optimize many small Spark jobs on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs |\n| Mitigate overloaded Spark driver on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded |\n| Detect unnecessary data rewriting in Databricks Spark writes | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data |\n| Best practices for setting up Databricks Partner Connect | https://learn.microsoft.com/en-us/azure/databricks/partner-connect/best-practice |\n| Optimize joins with broadcast hints in Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/broadcast |\n| Configure networking for Databricks Lakehouse Federation data sources | https://learn.microsoft.com/en-us/azure/databricks/query-federation/networking |\n| Optimize performance of Databricks Lakehouse Federation queries | https://learn.microsoft.com/en-us/azure/databricks/query-federation/performance-recommendations |\n| Transform complex and nested data types in Databricks | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/complex-types |\n| Use higher-order functions on arrays in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/higher-order-functions |\n| Differences between VARIANT and JSON strings in Databricks | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/variant-json-diff |\n| Work with OBJECT type and VARIANT schemas in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/object-type |\n| Use TIMESTAMP_NTZ type and Delta support in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/timestamp-ntz-type |\n| Use VARIANT type and Iceberg compatibility in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/variant-type |\n| Collect table statistics with ANALYZE TABLE for optimization | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-analyze-compute-statistics |\n| Benchmark Databricks SQL warehouses with the TPC-DS dataset | https://learn.microsoft.com/en-us/azure/databricks/sql/tpcds-eval |\n| Optimize Databricks SQL queries using primary key constraints | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-optimization-constraints |\n| Use Structured Streaming checkpoints safely on Databricks | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/checkpoints |\n| Configure Databricks Structured Streaming for production | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/production |\n| Optimize and monitor Databricks real-time streaming performance | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/performance |\n| Optimize stateless Structured Streaming queries on Databricks | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateless-streaming |\n| Apply watermarks for stateful streaming on Databricks | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/watermarks |\n| Use automatic Unity Catalog table upgrades in Databricks | https://learn.microsoft.com/en-us/azure/databricks/tables/automatic-upgrades |\n| Analyze Databricks table size and optimize storage costs | https://learn.microsoft.com/en-us/azure/databricks/tables/size |\n| Design data models optimized for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/transform/data-modeling |\n| Optimize join performance for Azure Databricks workloads | https://learn.microsoft.com/en-us/azure/databricks/transform/optimize-joins |\n| Clean and validate data with Databricks batch and streaming | https://learn.microsoft.com/en-us/azure/databricks/transform/validate |\n| Optimize Unity Catalog batch Python UDF performance | https://learn.microsoft.com/en-us/azure/databricks/udf/python-batch-udf |\n| Tune Mosaic AI Vector Search performance and latency | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-best-practices |\n| Design and run load tests for Vector Search endpoints | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-endpoint-load-test |\n| Improve Mosaic AI Vector Search retrieval quality | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-retrieval-quality |\n| Identify and clean up unused Databricks Vector Search endpoints | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-unused-endpoints |\n| Download internet data into Azure Databricks volumes | https://learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files |\n\n### Decision Making\n| Topic | URL |\n|-------|-----|\n| Manage and change Azure Databricks subscription tier | https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/account |\n| Create and manage Databricks budgets to track usage | https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/budgets |\n| Plan migration from Standard to Premium Databricks workspaces | https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/standard-tier |\n| Decide when and how to use serverless Databricks workspaces | https://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces |\n| Decide and migrate from dbx to Databricks bundles | https://learn.microsoft.com/en-us/azure/databricks/archive/dev-tools/dbx/dbx-migrate |\n| Migrate optimized LLM endpoints to provisioned throughput | https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/migrate-provisioned-throughput |\n| Decide when to use Databricks Light runtime | https://learn.microsoft.com/en-us/azure/databricks/archive/runtime/light |\n| Plan migration of Databricks workloads to Spark 3.x | https://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/ |\n| Select and manage the default Unity Catalog catalog | https://learn.microsoft.com/en-us/azure/databricks/catalogs/default |\n| Choose appropriate Azure Databricks compute types | https://learn.microsoft.com/en-us/azure/databricks/compute/choose-compute |\n| Select compatible flexible node types for Databricks compute | https://learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-type-instances |\n| Decide when and how to use GPU Databricks compute | https://learn.microsoft.com/en-us/azure/databricks/compute/gpu |\n| Decide when and how to use Azure Databricks pools | https://learn.microsoft.com/en-us/azure/databricks/compute/pool-index |\n| Plan migration from classic to serverless Databricks compute | https://learn.microsoft.com/en-us/azure/databricks/compute/serverless/migration |\n| Choose and manage Azure Databricks SQL warehouse sizing and scaling | https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-behavior |\n| Choose between Databricks SQL warehouse types | https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-types |\n| Choose between ABAC and table-level filters in Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/abac-vs-rls-cm |\n| Choose between managed and external Unity Catalog assets | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/managed-versus-external |\n| Plan and execute upgrade of Databricks workspaces to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/ |\n| Prepare and migrate to Unity Catalog–only Databricks workspaces | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/uc-only-migration |\n| Choose Delta Lake protocol versions and feature sets | https://learn.microsoft.com/en-us/azure/databricks/delta/feature-compatibility |\n| Choose local development tools for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ |\n| Migrate from legacy to new Databricks CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/migrate |\n| Manage Databricks account budget policies via CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-budget-policy-commands |\n| Configure Databricks account budgets using CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-budgets-commands |\n| Manage Databricks account usage dashboards via CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-usage-dashboards-commands |\n| Plan migration from legacy Databricks Connect runtimes | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect-legacy |\n| Migrate from older to new Databricks Connect for Python | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/migrate |\n| Migrate from legacy to new Scala Databricks Connect | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/migrate |\n| Choose and use Databricks SDKs for automation | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sdks |\n| Decide between CDKTF and Databricks Terraform provider | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/cdktf |\n| Choose Unity Catalog integration method for external engines | https://learn.microsoft.com/en-us/azure/databricks/external-access/integrations |\n| Decide when to migrate agents to Databricks Apps | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/migrate-agent-to-apps |\n| Use external models with Mosaic AI Model Serving | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/external-models/ |\n| Select Azure Databricks generative AI capabilities for your workflow | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/guide/gen-ai-capabilities |\n| Choose between Databricks Free Edition and free trial | https://learn.microsoft.com/en-us/azure/databricks/getting-started/free-trial-vs-free-edition |\n| Choose incremental ingestion options from cloud object storage | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/ |\n| Select Auto Loader file detection mode for your workload | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/file-detection-modes |\n| Plan migration of existing data to Delta Lake on Databricks | https://learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/ |\n| Choose and set up MySQL Lakeflow ingestion | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql |\n| Plan and configure PostgreSQL Lakeflow ingestion | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql |\n| Plan Microsoft SQL Server Lakeflow ingestion workflow | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-overview |\n| Choose and start with Databricks ODBC and JDBC drivers | https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-odbc-bi |\n| Migrate from Simba Spark ODBC to Databricks ODBC | https://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/migration |\n| Plan and manage production workloads with Lakeflow Jobs | https://learn.microsoft.com/en-us/azure/databricks/jobs/ |\n| Decide when to run Lakeflow Jobs on serverless compute | https://learn.microsoft.com/en-us/azure/databricks/jobs/run-serverless-jobs |\n| Migrate from Spark Submit tasks in Databricks jobs | https://learn.microsoft.com/en-us/azure/databricks/jobs/spark-submit |\n| Plan production Azure Databricks lakehouse deployments | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/ |\n| Design compute and workspace configuration for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/compute |\n| Choose a programming language for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/languages/overview |\n| Choose triggered vs continuous mode for pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/pipeline-mode |\n| Upgrade workspace feature tables to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/uc/upgrade-feature-table-to-uc |\n| Select Databricks-hosted foundation models for APIs | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-models |\n| Migrate MLflow model versions to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-models |\n| Decide and migrate to Unity Catalog model management | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-to-uc |\n| Upgrade Databricks ML workflows to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/upgrade-workflows |\n| Choose Databricks options for batch model inference | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-inference/ |\n| Migrate from legacy to Mosaic AI Model Serving | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/migrate-model-serving |\n| Decide when to use Spark vs. Ray on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/spark-ray-overview |\n| Understand Azure Databricks generative model maintenance policy | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/retired-models-policy |\n| Plan migration of data applications to Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/migration/ |\n| Scope and plan ETL pipeline migration to Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/migration/etl |\n| Choose a migration path from Parquet to Delta Lake | https://learn.microsoft.com/en-us/azure/databricks/migration/parquet-to-delta-lake |\n| Plan migration from data warehouse to Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/migration/warehouse-to-lakehouse |\n| Decide and migrate from Agent Evaluation to MLflow 3 | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-eval-migration |\n| Quick reference for migrating to MLflow 3 | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-eval-migration-reference |\n| Choose between open source and managed MLflow on Databricks | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/overview/oss-managed-diff |\n| Choose compute resources for Databricks notebooks | https://learn.microsoft.com/en-us/azure/databricks/notebooks/notebook-compute |\n| Right-size Lakebase instance capacity and scaling | https://learn.microsoft.com/en-us/azure/databricks/oltp/instances/create/capacity |\n| Choose backup and restore methods for Lakebase | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/backup-methods |\n| Decide when and how to use Lakebase Autoscaling by default | https://learn.microsoft.com/en-us/azure/databricks/oltp/upgrade-to-autoscaling |\n| Configure incremental refresh for Databricks materialized views | https://learn.microsoft.com/en-us/azure/databricks/optimizations/incremental-refresh |\n| Choose pandas options on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/pandas/ |\n| Use Hive metastore federation in Unity Catalog migrations | https://learn.microsoft.com/en-us/azure/databricks/query-federation/hms-federation-concepts |\n| Migrate legacy Databricks query federation to Lakehouse Federation | https://learn.microsoft.com/en-us/azure/databricks/query-federation/migrate |\n| Plan and execute migration to Databricks Runtime 11.x | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/11.x-migration |\n| Migrate workloads to Databricks Runtime 12.x safely | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/12.x-migration |\n| Migrate workloads to Databricks Runtime 13.x safely | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/13.x-migration |\n| Migrate workloads to Databricks Runtime 14.x safely | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/14.x-migration |\n| Plan around Databricks Runtime and feature lifecycles | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/databricks-runtime-ver |\n| Understand serverless DBU billing by Azure Databricks SKU | https://learn.microsoft.com/en-us/azure/databricks/resources/pricing |\n| Plan and manage Azure Databricks serverless networking costs | https://learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/cost-management |\n| Decide between Spark Connect and Spark Classic | https://learn.microsoft.com/en-us/azure/databricks/spark/connect-vs-classic |\n| Choose between SparkR and sparklyr on Databricks | https://learn.microsoft.com/en-us/azure/databricks/sparkr/sparkr-vs-sparklyr |\n| Use SYNC to upgrade Hive tables to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-sync |\n| Choose Structured Streaming output modes on Databricks | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/output-mode |\n| Choose and implement Databricks transaction modes | https://learn.microsoft.com/en-us/azure/databricks/transactions/transaction-modes |\n| Optimize and manage Mosaic AI Vector Search costs | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-cost-management |\n\n### Architecture & Design Patterns\n| Topic | URL |\n|-------|-----|\n| Plan disaster recovery architecture for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/admin/disaster-recovery |\n| Design and use materialization for Databricks metric views | https://learn.microsoft.com/en-us/azure/databricks/business-semantics/metric-views/materialization |\n| Implement fan-in and fan-out in Lakeflow pipelines | https://learn.microsoft.com/en-us/azure/databricks/data-engineering/fan-in-fan-out |\n| Choose patterns for external access to Databricks data | https://learn.microsoft.com/en-us/azure/databricks/external-access/ |\n| Build an IDP pipeline with Databricks AI Functions | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/idp-pipeline-tutorial |\n| Design intelligent document processing pipelines on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/intelligent-document-processing |\n| Design multi-agent orchestrator apps on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-apps |\n| Apply agent system design patterns on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/guide/agent-system-design-patterns |\n| Design measurement infrastructure for RAG quality on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-enable-measurement |\n| Design and tune Databricks RAG inference chains | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-inference-chain-rag |\n| Design cost optimization architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/ |\n| Apply data and AI governance architecture on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/ |\n| Design Delta Lake and medallion data architecture on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/delta-lake |\n| Design high availability and disaster recovery for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/ha-dr |\n| Design Azure Databricks network and connectivity architecture | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/network |\n| Design storage architecture for Azure Databricks and Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/storage |\n| Design Azure Databricks workspace architecture strategy | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/workspace-strategy |\n| Design interoperability and usability architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/ |\n| Design operational excellence architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/ |\n| Design performance efficiency architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/ |\n| Apply Azure Databricks lakehouse reference architectures | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reference |\n| Design reliability architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/ |\n| Apply medallion lakehouse architecture on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse/medallion |\n| Choose Databricks ML model deployment patterns | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/deployment-patterns |\n| Implement MLOps workflows on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/mlops-workflow |\n| Choose and train deep learning recommender models on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-recommender-models |\n| Use Lakebase branches for database development workflows | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/branches |\n| Design for high availability with Lakebase computes | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/high-availability |\n| Scale reads with Lakebase read replicas | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/read-replicas |\n| Connect Databricks Serverless Private Git to on-prem Git | https://learn.microsoft.com/en-us/azure/databricks/repos/connect-on-prem-git-server |\n| Set up Databricks Serverless Private Git with Private Link | https://learn.microsoft.com/en-us/azure/databricks/repos/serverless-private-git |\n| Choose patterns for modeling semi-structured data on Databricks | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/ |\n| Choose async checkpointing for Databricks stateful queries | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/async-checkpointing |\n| Use async progress tracking in Databricks streaming | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/async-progress-checking |\n| Decide when and how to partition Delta tables | https://learn.microsoft.com/en-us/azure/databricks/tables/partitions |","tags":["azure","databricks","agent","skills","microsoftdocs","agent-skills","agentic-skills","agentskill","ai-agents","ai-coding","azure-functions","azure-kubernetes-service"],"capabilities":["skill","source-microsoftdocs","skill-azure-databricks","topic-agent","topic-agent-skills","topic-agentic-skills","topic-agentskill","topic-ai-agents","topic-ai-coding","topic-azure","topic-azure-functions","topic-azure-kubernetes-service","topic-azure-openai","topic-azure-sql-database","topic-azure-storage"],"categories":["Agent-Skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/MicrosoftDocs/Agent-Skills/azure-databricks","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add MicrosoftDocs/Agent-Skills","source_repo":"https://github.com/MicrosoftDocs/Agent-Skills","install_from":"skills.sh"}},"qualityScore":"0.700","qualityRationale":"deterministic score 0.70 from registry signals: · indexed on github topic:agent-skills · 549 github stars · SKILL.md body (61,499 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-05-18T18:53:52.040Z","embedding":null,"createdAt":"2026-04-18T21:58:48.371Z","updatedAt":"2026-05-18T18:53:52.040Z","lastSeenAt":"2026-05-18T18:53:52.040Z","tsv":"'-8':1392 '/en-us/azure/databricks/admin/account-settings/account':3208 '/en-us/azure/databricks/admin/account-settings/audit-logs':453 '/en-us/azure/databricks/admin/account-settings/budgets':3219 '/en-us/azure/databricks/admin/account-settings/standard-tier':3230 '/en-us/azure/databricks/admin/account-settings/usage-detail-tags':1457 '/en-us/azure/databricks/admin/clusters/policy-families':1470 '/en-us/azure/databricks/admin/disaster-recovery':4167 '/en-us/azure/databricks/admin/users-groups/best-practices':1480 '/en-us/azure/databricks/admin/workspace-settings/deletion-vectors':1491 '/en-us/azure/databricks/admin/workspace/serverless-workspaces':3242 '/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices':1502 '/en-us/azure/databricks/archive/compute/libraries-init-scripts':1512 '/en-us/azure/databricks/archive/compute/policies-best-practices':1523 '/en-us/azure/databricks/archive/dev-tools/dbx/dbx-migrate':3253 '/en-us/azure/databricks/archive/legacy/dbio-commit':1536 '/en-us/azure/databricks/archive/legacy/skew-join':1547 '/en-us/azure/databricks/archive/machine-learning/migrate-provisioned-throughput':3263 '/en-us/azure/databricks/archive/runtime/light':3273 '/en-us/azure/databricks/archive/spark-3.x-migration/':3285 '/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines':1556 '/en-us/azure/databricks/business-semantics/metric-views/advanced-techniques':1566 '/en-us/azure/databricks/business-semantics/metric-views/materialization':4178 '/en-us/azure/databricks/catalogs/default':3296 '/en-us/azure/databricks/cheat-sheet/administration':1575 '/en-us/azure/databricks/cheat-sheet/bi-serving':1585 '/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep':1599 '/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving':1610 '/en-us/azure/databricks/cheat-sheet/compute':1620 '/en-us/azure/databricks/cheat-sheet/jobs':1631 '/en-us/azure/databricks/cheat-sheet/power-bi':1642 '/en-us/azure/databricks/compute/choose-compute':3305 '/en-us/azure/databricks/compute/cluster-config-best-practices':1651 '/en-us/azure/databricks/compute/flexible-node-type-instances':3316 '/en-us/azure/databricks/compute/flexible-node-types':1662 '/en-us/azure/databricks/compute/gpu':3328 '/en-us/azure/databricks/compute/pool-best-practices':1671 '/en-us/azure/databricks/compute/pool-index':3340 '/en-us/azure/databricks/compute/serverless/best-practices':1682 '/en-us/azure/databricks/compute/serverless/migration':3351 '/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings':1692 '/en-us/azure/databricks/compute/sql-warehouse/monitor/queries':1704 '/en-us/azure/databricks/compute/sql-warehouse/warehouse-behavior':3364 '/en-us/azure/databricks/compute/sql-warehouse/warehouse-types':3373 '/en-us/azure/databricks/compute/troubleshooting/':462 '/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes':472 '/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui':482 '/en-us/azure/databricks/compute/troubleshooting/query-watchdog':1714 '/en-us/azure/databricks/connect/streaming/kafka/faq':491 '/en-us/azure/databricks/data-engineering/fan-in-fan-out':4192 '/en-us/azure/databricks/data-engineering/observability-best-practices':1726 '/en-us/azure/databricks/data-governance/unity-catalog/abac/abac-vs-rls-cm':3387 '/en-us/azure/databricks/data-governance/unity-catalog/abac/best-practices':1737 '/en-us/azure/databricks/data-governance/unity-catalog/abac/performance':1747 '/en-us/azure/databricks/data-governance/unity-catalog/best-practices':1757 '/en-us/azure/databricks/data-governance/unity-catalog/filters-and-masks/':1769 '/en-us/azure/databricks/data-governance/unity-catalog/managed-versus-external':3398 '/en-us/azure/databricks/data-governance/unity-catalog/upgrade/':3411 '/en-us/azure/databricks/data-governance/unity-catalog/upgrade/uc-only-migration':3423 '/en-us/azure/databricks/database-objects/hive-metastore':1779 '/en-us/azure/databricks/dbfs/dbfs-root':1789 '/en-us/azure/databricks/dbfs/mounts':1801 '/en-us/azure/databricks/dbfs/unity-catalog':1812 '/en-us/azure/databricks/delta-sharing/manage-egress':1823 '/en-us/azure/databricks/delta-sharing/troubleshooting':501 '/en-us/azure/databricks/delta/best-practices':1834 '/en-us/azure/databricks/delta/clustering':1845 '/en-us/azure/databricks/delta/data-skipping':1859 '/en-us/azure/databricks/delta/deletion-vectors':1870 '/en-us/azure/databricks/delta/drop-table':1882 '/en-us/azure/databricks/delta/feature-compatibility':3434 '/en-us/azure/databricks/delta/optimize':1892 '/en-us/azure/databricks/delta/s3-limitations':1902 '/en-us/azure/databricks/delta/selective-overwrite':1912 '/en-us/azure/databricks/delta/tune-file-size':1924 '/en-us/azure/databricks/delta/vacuum':1934 '/en-us/azure/databricks/delta/variant-shredding':1946 '/en-us/azure/databricks/dev-tools/':3444 '/en-us/azure/databricks/dev-tools/bundles/mlops-stacks':1956 '/en-us/azure/databricks/dev-tools/ci-cd/best-practices':1966 '/en-us/azure/databricks/dev-tools/cli/migrate':3454 '/en-us/azure/databricks/dev-tools/cli/reference/account-budget-policy-commands':3464 '/en-us/azure/databricks/dev-tools/cli/reference/account-budgets-commands':3473 '/en-us/azure/databricks/dev-tools/cli/reference/account-usage-dashboards-commands':3483 '/en-us/azure/databricks/dev-tools/cli/reference/policy-families-commands':1976 '/en-us/azure/databricks/dev-tools/cli/troubleshooting':509 '/en-us/azure/databricks/dev-tools/databricks-apps/best-practices':1988 '/en-us/azure/databricks/dev-tools/databricks-connect-legacy':3493 '/en-us/azure/databricks/dev-tools/databricks-connect/python/migrate':3505 '/en-us/azure/databricks/dev-tools/databricks-connect/python/testing':1999 '/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting':519 '/en-us/azure/databricks/dev-tools/databricks-connect/queries':2010 '/en-us/azure/databricks/dev-tools/databricks-connect/scala/migrate':3516 '/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting':529 '/en-us/azure/databricks/dev-tools/sdks':3526 '/en-us/azure/databricks/dev-tools/terraform/cdktf':3536 '/en-us/azure/databricks/dev-tools/terraform/troubleshoot':538 '/en-us/azure/databricks/dev-tools/vscode-ext/faqs':549 '/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting':558 '/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class':567 '/en-us/azure/databricks/error-messages/cast-invalid-input-error-class':577 '/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class':589 '/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class':600 '/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class':611 '/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class':621 '/en-us/azure/databricks/error-messages/divide-by-zero-error-class':632 '/en-us/azure/databricks/error-messages/error-classes':641 '/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class':651 '/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class':661 '/en-us/azure/databricks/error-messages/geojson-parse-error-error-class':670 '/en-us/azure/databricks/error-messages/group-by-aggregate-error-class':681 '/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class':692 '/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class':705 '/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class':716 '/en-us/azure/databricks/error-messages/h3-not-enabled-error-class':727 '/en-us/azure/databricks/error-messages/insufficient-table-property-error-class':737 '/en-us/azure/databricks/error-messages/invalid-array-index-error-class':748 '/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class':760 '/en-us/azure/databricks/error-messages/missing-aggregation-error-class':770 '/en-us/azure/databricks/error-messages/row-column-access-error-class':782 '/en-us/azure/databricks/error-messages/sqlstates':791 '/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class':803 '/en-us/azure/databricks/error-messages/unresolved-routine-error-class':812 '/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class':822 '/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class':832 '/en-us/azure/databricks/error-messages/wkb-parse-error-error-class':842 '/en-us/azure/databricks/error-messages/wkt-parse-error-error-class':852 '/en-us/azure/databricks/external-access/':4203 '/en-us/azure/databricks/external-access/integrations':3547 '/en-us/azure/databricks/files/files-recommendations':2020 '/en-us/azure/databricks/generative-ai/agent-bricks/idp-pipeline-tutorial':4214 '/en-us/azure/databricks/generative-ai/agent-bricks/intelligent-document-processing':4224 '/en-us/azure/databricks/generative-ai/agent-bricks/multi-agent-supervisor':2031 '/en-us/azure/databricks/generative-ai/agent-evaluation/evaluation-set':2042 '/en-us/azure/databricks/generative-ai/agent-evaluation/troubleshooting':861 '/en-us/azure/databricks/generative-ai/agent-framework/debug-agent':870 '/en-us/azure/databricks/generative-ai/agent-framework/migrate-agent-to-apps':3558 '/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-apps':4235 '/en-us/azure/databricks/generative-ai/external-models/':3569 '/en-us/azure/databricks/generative-ai/guide/agent-system-design-patterns':4246 '/en-us/azure/databricks/generative-ai/guide/agents-dev-workflow':2055 '/en-us/azure/databricks/generative-ai/guide/gen-ai-capabilities':3581 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-assess-performance':2064 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-enable-measurement':4257 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag':2074 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-inference-chain-rag':4267 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-overview':2082 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-rag-chain':2090 '/en-us/azure/databricks/genie-code/instructions':2100 '/en-us/azure/databricks/genie-code/tips':2111 '/en-us/azure/databricks/genie/agent-mode':2121 '/en-us/azure/databricks/genie/benchmarks':2129 '/en-us/azure/databricks/genie/best-practices':2139 '/en-us/azure/databricks/genie/troubleshooting':880 '/en-us/azure/databricks/getting-started/free-trial-vs-free-edition':3592 '/en-us/azure/databricks/ingestion/cloud-object-storage/':3603 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/faq':889 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/file-detection-modes':3615 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/migrating-to-file-events':2150 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production':2159 '/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples':2169 '/en-us/azure/databricks/ingestion/data-migration/':3628 '/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns':2178 '/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-faq':898 '/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot':909 '/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot':918 '/en-us/azure/databricks/ingestion/lakeflow-connect/faq':928 '/en-us/azure/databricks/ingestion/lakeflow-connect/full-refresh':2188 '/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot':937 '/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot':947 '/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot':956 '/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot':964 '/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot':973 '/en-us/azure/databricks/ingestion/lakeflow-connect/mysql':3638 '/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot':983 '/en-us/azure/databricks/ingestion/lakeflow-connect/outlook-troubleshoot':992 '/en-us/azure/databricks/ingestion/lakeflow-connect/pipeline-maintenance':2196 '/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql':3647 '/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance':2207 '/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot':1001 '/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot':1012 '/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields':2217 '/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot':1020 '/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot':1030 '/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot':1040 '/en-us/azure/databricks/ingestion/lakeflow-connect/smartsheet-troubleshoot':1048 '/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-faq':1059 '/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-overview':3657 '/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot':1069 '/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot':1078 '/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot':1087 '/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot':1097 '/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot':1106 '/en-us/azure/databricks/ingestion/zerobus-errors':1115 '/en-us/azure/databricks/init-scripts/':2227 '/en-us/azure/databricks/init-scripts/logs':1125 '/en-us/azure/databricks/init-scripts/referencing-files':2238 '/en-us/azure/databricks/integrations/jdbc-odbc-bi':3669 '/en-us/azure/databricks/integrations/odbc/migration':3680 '/en-us/azure/databricks/integrations/odbc/testing':1135 '/en-us/azure/databricks/jobs/':3691 '/en-us/azure/databricks/jobs/compute':2248 '/en-us/azure/databricks/jobs/how-to/foreach-sql-lookup-tutorial':2261 '/en-us/azure/databricks/jobs/large-jobs':1146 '/en-us/azure/databricks/jobs/monitor':1157 '/en-us/azure/databricks/jobs/repair-job-failures':1168 '/en-us/azure/databricks/jobs/run-classic-jobs':2272 '/en-us/azure/databricks/jobs/run-serverless-jobs':3703 '/en-us/azure/databricks/jobs/spark-submit':3714 '/en-us/azure/databricks/lakehouse-architecture/cost-optimization/':4277 '/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices':2282 '/en-us/azure/databricks/lakehouse-architecture/data-governance/':4288 '/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices':2294 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/':3723 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/compute':3734 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/delta-lake':4300 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/ha-dr':4312 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/network':4322 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability':2305 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/storage':4334 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/workspace-strategy':4343 '/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/':4354 '/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices':2316 '/en-us/azure/databricks/lakehouse-architecture/operational-excellence/':4364 '/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices':2326 '/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/':4374 '/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices':2337 '/en-us/azure/databricks/lakehouse-architecture/reference':4383 '/en-us/azure/databricks/lakehouse-architecture/reliability/':4392 '/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices':2347 '/en-us/azure/databricks/lakehouse-architecture/security-compliance-and-privacy/best-practices':2358 '/en-us/azure/databricks/lakehouse/medallion':4401 '/en-us/azure/databricks/languages/overview':3744 '/en-us/azure/databricks/ldp/auto-scaling':2367 '/en-us/azure/databricks/ldp/best-practices':2378 '/en-us/azure/databricks/ldp/cdc-advanced':2390 '/en-us/azure/databricks/ldp/develop':2400 '/en-us/azure/databricks/ldp/developer/external-dependencies':2410 '/en-us/azure/databricks/ldp/expectation-patterns':2419 '/en-us/azure/databricks/ldp/fix-high-init':2429 '/en-us/azure/databricks/ldp/flows-backfill':2438 '/en-us/azure/databricks/ldp/full-refresh-st':2450 '/en-us/azure/databricks/ldp/observability':1177 '/en-us/azure/databricks/ldp/pipeline-mode':3754 '/en-us/azure/databricks/ldp/query-history':1188 '/en-us/azure/databricks/ldp/recover-streaming':1198 '/en-us/azure/databricks/ldp/stateful-processing':2459 '/en-us/azure/databricks/ldp/what-is-change-data-capture':2469 '/en-us/azure/databricks/libraries/restart-python-process':2480 '/en-us/azure/databricks/machine-learning/ai-runtime/dataloading':2492 '/en-us/azure/databricks/machine-learning/ai-runtime/guides':1209 '/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices':2502 '/en-us/azure/databricks/machine-learning/automl/automl-covariate-forecast':2511 '/en-us/azure/databricks/machine-learning/feature-store/time-series':2526 '/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations':1219 '/en-us/azure/databricks/machine-learning/feature-store/uc/upgrade-feature-table-to-uc':3764 '/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark':2537 '/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-models':3775 '/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-models':3785 '/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-to-uc':3796 '/en-us/azure/databricks/machine-learning/manage-model-lifecycle/upgrade-workflows':3806 '/en-us/azure/databricks/machine-learning/mlops/deployment-patterns':4410 '/en-us/azure/databricks/machine-learning/mlops/llmops':2546 '/en-us/azure/databricks/machine-learning/mlops/mlops-workflow':4419 '/en-us/azure/databricks/machine-learning/model-inference/':3816 '/en-us/azure/databricks/machine-learning/model-serving/migrate-model-serving':3827 '/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug':1228 '/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code':1239 '/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation':2555 '/en-us/azure/databricks/machine-learning/model-serving/monitor-diagnose-endpoints':2565 '/en-us/azure/databricks/machine-learning/model-serving/production-optimization':2575 '/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test':2585 '/en-us/azure/databricks/machine-learning/ray/scale-ray':2595 '/en-us/azure/databricks/machine-learning/ray/spark-ray-overview':3839 '/en-us/azure/databricks/machine-learning/retired-models-policy':3849 '/en-us/azure/databricks/machine-learning/train-model/dl-best-practices':2606 '/en-us/azure/databricks/machine-learning/train-model/huggingface/fine-tune-model':2621 '/en-us/azure/databricks/machine-learning/train-model/huggingface/load-data':2634 '/en-us/azure/databricks/machine-learning/train-recommender-models':4431 '/en-us/azure/databricks/migration/':3860 '/en-us/azure/databricks/migration/etl':3872 '/en-us/azure/databricks/migration/parquet-to-delta-lake':3884 '/en-us/azure/databricks/migration/spark':2644 '/en-us/azure/databricks/migration/warehouse-to-lakehouse':3895 '/en-us/azure/databricks/mlflow3/genai/agent-eval-migration':3907 '/en-us/azure/databricks/mlflow3/genai/agent-eval-migration-reference':3917 '/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges':2654 '/en-us/azure/databricks/mlflow3/genai/overview/oss-managed-diff':3929 '/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts':2664 '/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/manual-tracing/':2675 '/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces':2685 '/en-us/azure/databricks/notebooks/debugger':1248 '/en-us/azure/databricks/notebooks/notebook-compute':3938 '/en-us/azure/databricks/notebooks/run-notebook':2694 '/en-us/azure/databricks/notebooks/test-notebooks':2703 '/en-us/azure/databricks/oltp/instances/create/capacity':3949 '/en-us/azure/databricks/oltp/projects/backup-methods':3959 '/en-us/azure/databricks/oltp/projects/branches':4441 '/en-us/azure/databricks/oltp/projects/high-availability':4451 '/en-us/azure/databricks/oltp/projects/manage-read-replicas':2712 '/en-us/azure/databricks/oltp/projects/pg-stat-statements':2722 '/en-us/azure/databricks/oltp/projects/read-replicas':4460 '/en-us/azure/databricks/oltp/upgrade-to-autoscaling':3972 '/en-us/azure/databricks/optimizations/':2732 '/en-us/azure/databricks/optimizations/aqe':2741 '/en-us/azure/databricks/optimizations/cbo':2752 '/en-us/azure/databricks/optimizations/disk-cache':2762 '/en-us/azure/databricks/optimizations/dynamic-file-pruning':2776 '/en-us/azure/databricks/optimizations/incremental-refresh':3982 '/en-us/azure/databricks/optimizations/predictive-io':2785 '/en-us/azure/databricks/optimizations/predictive-optimization':2795 '/en-us/azure/databricks/optimizations/range-join':2804 '/en-us/azure/databricks/optimizations/spark-ui-guide/':2815 '/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs':1259 '/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline':1269 '/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage':1280 '/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io':1290 '/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page':2826 '/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances':2835 '/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task':2846 '/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io':1303 '/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs':2856 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read':1314 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded':2865 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps':1324 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues':1335 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data':2876 '/en-us/azure/databricks/pandas/':3991 '/en-us/azure/databricks/partner-connect/best-practice':2887 '/en-us/azure/databricks/partner-connect/troubleshoot':1344 '/en-us/azure/databricks/pyspark/reference/functions/broadcast':2898 '/en-us/azure/databricks/query-federation/hms-federation-concepts':4002 '/en-us/azure/databricks/query-federation/migrate':4013 '/en-us/azure/databricks/query-federation/networking':2909 '/en-us/azure/databricks/query-federation/performance-recommendations':2919 '/en-us/azure/databricks/release-notes/runtime/11.x-migration':4025 '/en-us/azure/databricks/release-notes/runtime/12.x-migration':4036 '/en-us/azure/databricks/release-notes/runtime/13.x-migration':4047 '/en-us/azure/databricks/release-notes/runtime/14.x-migration':4058 '/en-us/azure/databricks/release-notes/runtime/databricks-runtime-ver':4068 '/en-us/azure/databricks/repos/connect-on-prem-git-server':4473 '/en-us/azure/databricks/repos/errors-troubleshooting':1354 '/en-us/azure/databricks/repos/serverless-private-git':4485 '/en-us/azure/databricks/resources/pricing':4079 '/en-us/azure/databricks/security/network/serverless-network-security/cost-management':4090 '/en-us/azure/databricks/semi-structured/':4498 '/en-us/azure/databricks/semi-structured/complex-types':2930 '/en-us/azure/databricks/semi-structured/higher-order-functions':2943 '/en-us/azure/databricks/semi-structured/variant-json-diff':2954 '/en-us/azure/databricks/spark/connect-vs-classic':4100 '/en-us/azure/databricks/sparkr/sparkr-vs-sparklyr':4110 '/en-us/azure/databricks/sql/language-manual/control-flow/fetch-stmt':1365 '/en-us/azure/databricks/sql/language-manual/control-flow/get-diagnostics-stmt':1377 '/en-us/azure/databricks/sql/language-manual/control-flow/open-stmt':1389 '/en-us/azure/databricks/sql/language-manual/data-types/object-type':2966 '/en-us/azure/databricks/sql/language-manual/data-types/timestamp-ntz-type':2978 '/en-us/azure/databricks/sql/language-manual/data-types/variant-type':2989 '/en-us/azure/databricks/sql/language-manual/functions/validate_utf8':1401 '/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-analyze-compute-statistics':3000 '/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-sync':4122 '/en-us/azure/databricks/sql/tpcds-eval':3013 '/en-us/azure/databricks/sql/user/queries/performance-insights':1410 '/en-us/azure/databricks/sql/user/queries/query-history':1421 '/en-us/azure/databricks/sql/user/queries/query-optimization-constraints':3024 '/en-us/azure/databricks/sql/user/queries/query-profile':1432 '/en-us/azure/databricks/sql/user/queries/schedule-query':1442 '/en-us/azure/databricks/structured-streaming/async-checkpointing':4508 '/en-us/azure/databricks/structured-streaming/async-progress-checking':4518 '/en-us/azure/databricks/structured-streaming/checkpoints':3034 '/en-us/azure/databricks/structured-streaming/output-mode':4132 '/en-us/azure/databricks/structured-streaming/production':3043 '/en-us/azure/databricks/structured-streaming/real-time/performance':3055 '/en-us/azure/databricks/structured-streaming/stateless-streaming':3065 '/en-us/azure/databricks/structured-streaming/watermarks':3075 '/en-us/azure/databricks/tables/automatic-upgrades':3086 '/en-us/azure/databricks/tables/partitions':4529 '/en-us/azure/databricks/tables/size':3097 '/en-us/azure/databricks/transactions/transaction-modes':4141 '/en-us/azure/databricks/transform/data-modeling':3107 '/en-us/azure/databricks/transform/optimize-joins':3117 '/en-us/azure/databricks/transform/validate':3129 '/en-us/azure/databricks/udf/python-batch-udf':3139 '/en-us/azure/databricks/vector-search/vector-search-best-practices':3150 '/en-us/azure/databricks/vector-search/vector-search-cost-management':4152 '/en-us/azure/databricks/vector-search/vector-search-endpoint-load-test':3162 '/en-us/azure/databricks/vector-search/vector-search-retrieval-quality':3172 '/en-us/azure/databricks/vector-search/vector-search-unused-endpoints':3184 '/en-us/azure/databricks/volumes/download-internet-files':3194 '/microsoftdocs/mcp/blob/main/readme.md)':163 '/o':1296 '11':4021 '12':4031 '13':4042 '14':4053 '2':855,2037 '3':134,3281,3904,3914 '365':912 'abac':1733,1743,3376 'acceler':2777 'accept':202 'access':168,774,2779,4197 'account':374,3457,3467,3476 'accur':1452 'across':261,438 'ad':931,967,1072 'adapt':2635,2734 'address':671 'administ':371 'administr':1570 'advanc':1558,2380,2412 'agent':83,127,186,200,233,312,382,428,856,867,2024,2028,2050,2114,3552,3900,4228,4237 'aggreg':674,763 'ai':232,427,866,1205,2290,2488,2580,3142,3165,3564,3574,3822,4146,4210,4281 'ai/ml':404 'align':2645 'amazon':1898 'analysi':2118 'analyt':940 'analyz':1422,2676,2994,3087 'answer':1049 'apach':484,2636 'api':334,394,593,3772 'app':1985,2069,2672,3555,4230 'appli':1447,1471,1492,1513,1567,1611,1643,1663,1672,1715,1748,1758,1802,1824,1947,1957,1977,2032,2101,2130,2160,2170,2262,2273,2306,2327,2338,2368,2481,2493,2723,3066,4236,4278,4375,4393 'applic':475,2078,3854 'appropri':3298 'architectur':16,52,248,271,289,295,4153,4161,4271,4283,4295,4319,4325,4339,4348,4358,4368,4380,4386,4396 'arithmet':560 'around':4060 'array':740,751,2937 'asset':3395 'async':2001,4500,4510 'attribut':1454 'audit':358,448 'authent':900 'authn/authz':352 'auto':884,2142,2152,2381,3605 'autom':3523 'automat':3077 'automl':2505 'autosc':2364,3967 'avail':153,4303,4445 'azur':2,7,35,44,325,350,372,439,445,455,634,784,1161,1337,1347,1472,1496,1519,1568,1612,1622,1678,1830,1847,1920,1942,1962,2301,2332,2498,2542,2602,2640,2728,2772,2797,2894,3103,3112,3189,3202,3299,3335,3355,3440,3571,3717,3730,3740,3841,3856,3868,3987,4074,4083,4163,4242,4314,4327,4336,4376,4415 'azure-databrick':1 'backfil':2430 'backup':3951 'base':1007,2745 'batch':3124,3133,3811 'benchmark':2126,2527,3001 'best':12,48,237,243,1443,1466,1476,1493,1516,1571,1616,1627,1632,1647,1664,1675,1717,1727,1753,1808,1827,1950,1959,1981,2033,2131,2263,2276,2284,2310,2320,2329,2340,2352,2369,2484,2495,2599,2877 'best-practic':242 'bi':257,1577,1594,1606,1636,1688 'bill':4072 'blueprint':296 'bottleneck':1429 'branch':4434 'broadcast':2891 'budget':280,3213,3458,3468 'build':2249,4204 'bundl':1953,3250 'cach':2759 'capabl':75,3575 'capac':3944 'cast':569 'catalog':32,279,340,433,1732,1742,1750,1766,1796,1806,1877,2791,3079,3132,3292,3293,3384,3394,3408,3417,3539,3761,3782,3791,3803,3998,4119,4331 'catalog/abac':354 'categori':86,94,110,206,208 'cdc':2382,2461 'cdktf':3529 'cell':685 'chain':2086,4264 'chang':3201 'chart':437 'checkpoint':1194,3028,4501 'choos':275,2011,3297,3352,3365,3374,3388,3424,3435,3517,3537,3582,3593,3629,3658,3735,3745,3807,3873,3918,3930,3950,3983,4101,4123,4133,4193,4402,4420,4486,4499 'ci/cd':423,1958 'classic':465,2267,3344,4097 'clean':3118,3175 'cli':505,1973,3451,3461,3470,3480 'cloud':1530,1818,3598 'cluster':220,1839,1969,2223,2590 'code':24,60,388,469,545,553,788,1236,1242,1994,2097,2107,2700 'code/cli/connect':229 'collect':2990 'column':773,1762 'combin':65 'common':495,503,531,540,874,882,891,920,949,985,1050,1099,1221,1346,2161,2171 'compar':2657 'compat':615,2984,3307 'complex':2117,2921 'complianc':348,360,2351 'comput':276,327,378,457,466,1465,1514,1614,1645,1659,1674,2242,3301,3313,3325,3348,3700,3725,3931,4448 'condit':638 'configur':22,58,366,369,1136,1435,1475,1481,1600,1646,2151,2239,2266,2899,3035,3465,3641,3728,3973 'configuration.md':367,368 'confluenc':892,906 'connect':414,514,524,979,996,1004,1054,1064,1132,1340,1991,2007,2884,3489,3500,3513,4094,4318,4461 'connector':328,586,597,608,893,925,932,951,969,987,1008,1026,1036,1044,1055,1073,1082,1093,1102 'connectors/lakeflow':226 'constraint':323,3021 'content':70,172 'continu':3748 'control':361,1705,1913,2257 'copi':2162 'correct':2517 'cost':250,307,1453,1820,2274,2744,2808,3094,4087,4149,4269 'cost-bas':2743 'covari':2508 'cover':46 'creat':2704,3209 'creation':1615 'curat':2134 'cursor':1356,1379 'custom':2093,2224 'dag':1309 'dashboard':337,429,1637,3478 'data':335,400,582,942,1589,1751,1849,1916,1937,2164,2288,2432,2482,2778,2868,2905,2924,3099,3121,3187,3620,3853,3888,4200,4279,4294,4493 'data/uc/delta/lakeflow':380 'databas':1775,4436 'databrick':3,8,36,45,218,247,300,326,351,373,397,421,446,456,464,477,488,504,513,523,532,543,551,564,574,596,628,635,667,677,689,702,713,734,744,757,766,785,800,819,829,865,883,1024,1042,1091,1119,1129,1162,1213,1222,1230,1244,1256,1261,1277,1287,1300,1311,1321,1332,1338,1348,1362,1374,1386,1403,1412,1423,1436,1448,1460,1473,1486,1497,1504,1520,1533,1541,1550,1561,1569,1580,1596,1601,1613,1623,1639,1644,1658,1667,1679,1684,1699,1720,1786,1831,1848,1889,1921,1943,1963,1968,1984,1990,2006,2013,2049,2060,2071,2076,2084,2219,2233,2279,2287,2302,2313,2323,2333,2343,2355,2406,2444,2466,2476,2487,2499,2504,2528,2543,2550,2557,2567,2578,2592,2603,2618,2631,2641,2687,2698,2729,2738,2748,2757,2773,2798,2806,2821,2828,2853,2862,2871,2882,2895,2902,2913,2927,2939,2951,2963,2975,2986,3002,3015,3031,3036,3047,3062,3072,3083,3088,3104,3113,3123,3178,3190,3203,3212,3226,3238,3249,3268,3277,3300,3312,3324,3336,3347,3356,3367,3404,3419,3441,3450,3456,3466,3475,3488,3499,3512,3520,3531,3554,3572,3584,3625,3662,3676,3710,3718,3731,3741,3767,3798,3808,3836,3842,3857,3869,3891,3926,3934,3977,3988,4005,4019,4029,4040,4051,4061,4075,4084,4107,4129,4136,4164,4173,4199,4209,4221,4232,4243,4254,4261,4273,4285,4297,4308,4315,4328,4337,4350,4360 'databricks-host':3766 'dataset':2623,3010 'dbfs':1781,1792,1803 'dbio':1525 'dbu':4071 'dbx':3247 'dc':579,591,602 'debug':236,473,864,1183,1220,1240,1266,1291,1417,2816 'decid':3231,3243,3264,3317,3329,3527,3548,3692,3786,3828,3896,3960,4091,4519 'decis':14,50,264,274,3195 'declar':2374,2396 'deep':1551,2597,4423 'default':1459,1482,3290,3969 'delet':1483,1861 'delta':496,613,1487,1814,1825,1865,1874,1884,1894,1908,1914,1926,2764,2972,3425,3622,3880,4290,4525 'delta/lakeflow':33 'depend':2403 'deploy':27,63,287,415,418,2552,3720,4406 'deployment.md':416,417 'descript':210 'design':17,53,290,1730,2295,2460,3098,3151,3724,4154,4168,4215,4225,4239,4247,4258,4268,4289,4301,4313,4323,4335,4344,4355,4365,4384,4442 'detail':407 'detect':2866,3608 'develop':9,2051,2391,3437,4437 'diagnos':215,492,510,520,578,601,771,871,974,1021,1031,1088,1210,1229,1270,1315,1325,2805 'diagnost':447,1368 'differ':2944 'disast':4159,4305 'disk':2758 'distanc':699 'divid':623 'doc':178 'document':73,171,4217 'download':3185 'driven':2252 'driver':1131,2860,3666 'drop':1871 'ds':3009 'dynam':911,2768 'e.g':98,114 'edit':3586 'effect':2092,2661,2832 'effici':2691,4367 'egress':1819 'element':754 'enabl':720,2208 'encrypt':356 'end':2046,2048 'end-to-end':2045 'endpoint':2530,2561,2570,2582,3159,3181,3257 'enforc':1464 'engin':3544 'enhanc':2363 'environ':440 'error':225,468,498,535,555,562,572,583,594,604,618,626,637,645,655,665,675,687,711,721,732,742,764,775,787,798,809,817,827,836,846,904,961,989,1045,1103,1110,1351,1371,1382,2680 'etl':3864 'evalu':857,2038,2065,2122,2651,2655,3901 'event':450,2147 'ewkb':643 'ewkt':653 'excel':2319,4357 'execut':1122,2736,3401,4016 'executor':1254 'exist':2141,3619 'expect':2413 'expens':1305 'expert':4,41 'extens':546,554 'extern':399,1797,2229,3392,3543,3560,4196 'external/ingestion':364 'face':2611,2626 'fail':1250 'failur':1165,1195 'fallback':190 'famili':1462,1971 'fan':4181,4185 'fan-in':4180 'fan-out':4184 'featur':434,1214,2383,2518,3430,3757,4064 'feder':413,2904,2915,3995,4007,4010 'fetch':74,170,179,192,1355 'field':2214 'file':104,112,119,124,1886,1917,2017,2146,2230,2769,3607 'filter':777,1760,3381 'find':1428 'fine':2608,2628 'fine-tun':2607,2627 'fix':217,494,512,522,642,652,728,792,873,976,1023,1033,1090,1327 'flexibl':1653,3308 'folder':1350 'follow':1780,2043,2596 'forecast':2506 'formula':2213 'found':797 'foundat':3769 'framework':405 'free':3585,3588 'full':2180,2440 'function':409,807,2935,4211 'ga4':580,585 'gap':1316 'genai':2671,2677 'generat':3573,3843 'geni':875,1235,2096,2106,2113,2123,2135 'geojson':663 'geometri':646,656,838,848 'get':1367 'git':1349,4465,4470,4479 'github.com':162 'github.com/microsoftdocs/mcp/blob/main/readme.md)':161 'googl':930,939 'govern':251,305,1752,2291,4282 'gpu':2616,3323 'grid':698 'group':672 'guid':160,269,1200 'guidanc':42,245 'h3':683,696,707,718 'ha/dr':304 'handl':568,622,633,682,706,1107,1359,1372,1381,1395,1893,2000,2827 'hcm':1081 'health':2562 'high':1282,1592,2421,4302,4444 'high-perform':1591 'higher':2933 'higher-ord':2932 'hint':1544,2892 'histor':2431 'histori':1154,1181,1415 'hive':1773,3993,4115 'host':3768 'hubspot':950 'hug':2610,2625 'human':2650 'hyperopt':2494 'i/o':1283,2782 'iac':424 'iceberg':614,2983 'id':686 'ident':346,1474 'identifi':1304,3173 'idp':314,4206 'implement':1621,2283,2317,2348,2411,2512,2538,4135,4179,4411 'import':81,125 'improv':2083,2105,2503,2753,2763,3163 'includ':10 'increment':2209,3594,3974 'index':87,207,741,752 'infer':3813,4263 'infrastructur':4249 'ingest':227,284,894,914,933,943,952,960,968,980,988,997,1016,1065,1109,2175,2192,2201,2210,3595,3635,3644,3653 'init':1120,1508,2220,2234 'initi':2422 'input':571 'insight':1407 'inspect':1116,1149 'instal':157,159,1506 'instanc':2830,3943 'instead':1840 'instruct':2094 'insuffici':729 'integr':23,59,365,387,396,3540 'integrations.md':390,391 'intellig':4216 'interact':1707 'internet':3186 'interoper':2307,4345 'interpret':444,693,783,1402 'interrupt':2004 'invalid':570,684,697,708,739,750,1396 'investig':1281 'issu':219,459,506,516,526,541,648,658,858,877,886,895,915,921,934,944,970,998,1009,1027,1037,1094,1216,1225,1233,1330,1341 'jdbc':3665 'jira':958 'job':379,1140,1151,1164,1252,1263,1319,1625,1721,2245,2255,2269,2851,3688,3697,3711 'join':1539,2519,2800,2889,3109 'json':2948 'judg':2648 'kafka':485 'key':3020 'knowledg':5 'l120':101 'l139':214 'l140':240 'l140-l308':239 'l308':241 'l309':267 'l309-l400':266 'l35':100 'l35-l120':99 'l37':213 'l37-l139':212 'l400':268 'l401':293 'l401-l439':292 'l439':294 'lake':1826,1895,1909,3426,3623,3881,4291 'lakebas':309,330,2707,2714,3942,3956,3966,4433,4447,4455 'lakeflow':253,329,913,923,959,978,995,1003,1015,1034,1053,1063,1075,1084,1139,1150,1163,1172,1190,2174,2183,2190,2204,2244,2268,2360,2372,2394,2425,2434,3634,3643,3652,3687,3696,4188 'lakehous':263,286,301,412,2334,2344,2903,2914,3719,3892,4009,4274,4309,4351,4361,4371,4378,4389,4395 'languag':3738 'larg':1706 'latenc':2532,3147 'latest':142 'layout':1887 'learn':185,199,1552,2598,4424 'learn-agent-skil':184,198 'learn.microsoft.com':452,461,471,481,490,500,508,518,528,537,548,557,566,576,588,599,610,620,631,640,650,660,669,680,691,704,715,726,736,747,759,769,781,790,802,811,821,831,841,851,860,869,879,888,897,908,917,927,936,946,955,963,972,982,991,1000,1011,1019,1029,1039,1047,1058,1068,1077,1086,1096,1105,1114,1124,1134,1145,1156,1167,1176,1187,1197,1208,1218,1227,1238,1247,1258,1268,1279,1289,1302,1313,1323,1334,1343,1353,1364,1376,1388,1400,1409,1420,1431,1441,1456,1469,1479,1490,1501,1511,1522,1535,1546,1555,1565,1574,1584,1598,1609,1619,1630,1641,1650,1661,1670,1681,1691,1703,1713,1725,1736,1746,1756,1768,1778,1788,1800,1811,1822,1833,1844,1858,1869,1881,1891,1901,1911,1923,1933,1945,1955,1965,1975,1987,1998,2009,2019,2030,2041,2054,2063,2073,2081,2089,2099,2110,2120,2128,2138,2149,2158,2168,2177,2187,2195,2206,2216,2226,2237,2247,2260,2271,2281,2293,2304,2315,2325,2336,2346,2357,2366,2377,2389,2399,2409,2418,2428,2437,2449,2458,2468,2479,2491,2501,2510,2525,2536,2545,2554,2564,2574,2584,2594,2605,2620,2633,2643,2653,2663,2674,2684,2693,2702,2711,2721,2731,2740,2751,2761,2775,2784,2794,2803,2814,2825,2834,2845,2855,2864,2875,2886,2897,2908,2918,2929,2942,2953,2965,2977,2988,2999,3012,3023,3033,3042,3054,3064,3074,3085,3096 'learn.microsoft.com/en-us/azure/databricks/admin/account-settings/account':3206 'learn.microsoft.com/en-us/azure/databricks/admin/account-settings/audit-logs':451 'learn.microsoft.com/en-us/azure/databricks/admin/account-settings/budgets':3217 'learn.microsoft.com/en-us/azure/databricks/admin/account-settings/standard-tier':3228 'learn.microsoft.com/en-us/azure/databricks/admin/account-settings/usage-detail-tags':1455 'learn.microsoft.com/en-us/azure/databricks/admin/clusters/policy-families':1468 'learn.microsoft.com/en-us/azure/databricks/admin/disaster-recovery':4165 'learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices':1478 'learn.microsoft.com/en-us/azure/databricks/admin/workspace-settings/deletion-vectors':1489 'learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces':3240 'learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices':1500 'learn.microsoft.com/en-us/azure/databricks/archive/compute/libraries-init-scripts':1510 'learn.microsoft.com/en-us/azure/databricks/archive/compute/policies-best-practices':1521 'learn.microsoft.com/en-us/azure/databricks/archive/dev-tools/dbx/dbx-migrate':3251 'learn.microsoft.com/en-us/azure/databricks/archive/legacy/dbio-commit':1534 'learn.microsoft.com/en-us/azure/databricks/archive/legacy/skew-join':1545 'learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/migrate-provisioned-throughput':3261 'learn.microsoft.com/en-us/azure/databricks/archive/runtime/light':3271 'learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/':3283 'learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines':1554 'learn.microsoft.com/en-us/azure/databricks/business-semantics/metric-views/advanced-techniques':1564 'learn.microsoft.com/en-us/azure/databricks/business-semantics/metric-views/materialization':4176 'learn.microsoft.com/en-us/azure/databricks/catalogs/default':3294 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/administration':1573 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving':1583 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep':1597 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving':1608 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/compute':1618 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/jobs':1629 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/power-bi':1640 'learn.microsoft.com/en-us/azure/databricks/compute/choose-compute':3303 'learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices':1649 'learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-type-instances':3314 'learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-types':1660 'learn.microsoft.com/en-us/azure/databricks/compute/gpu':3326 'learn.microsoft.com/en-us/azure/databricks/compute/pool-best-practices':1669 'learn.microsoft.com/en-us/azure/databricks/compute/pool-index':3338 'learn.microsoft.com/en-us/azure/databricks/compute/serverless/best-practices':1680 'learn.microsoft.com/en-us/azure/databricks/compute/serverless/migration':3349 'learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings':1690 'learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/monitor/queries':1702 'learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-behavior':3362 'learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-types':3371 'learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/':460 'learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes':470 'learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui':480 'learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/query-watchdog':1712 'learn.microsoft.com/en-us/azure/databricks/connect/streaming/kafka/faq':489 'learn.microsoft.com/en-us/azure/databricks/data-engineering/fan-in-fan-out':4190 'learn.microsoft.com/en-us/azure/databricks/data-engineering/observability-best-practices':1724 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/abac-vs-rls-cm':3385 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/best-practices':1735 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/performance':1745 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/best-practices':1755 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/filters-and-masks/':1767 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/managed-versus-external':3396 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/':3409 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/uc-only-migration':3421 'learn.microsoft.com/en-us/azure/databricks/database-objects/hive-metastore':1777 'learn.microsoft.com/en-us/azure/databricks/dbfs/dbfs-root':1787 'learn.microsoft.com/en-us/azure/databricks/dbfs/mounts':1799 'learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog':1810 'learn.microsoft.com/en-us/azure/databricks/delta-sharing/manage-egress':1821 'learn.microsoft.com/en-us/azure/databricks/delta-sharing/troubleshooting':499 'learn.microsoft.com/en-us/azure/databricks/delta/best-practices':1832 'learn.microsoft.com/en-us/azure/databricks/delta/clustering':1843 'learn.microsoft.com/en-us/azure/databricks/delta/data-skipping':1857 'learn.microsoft.com/en-us/azure/databricks/delta/deletion-vectors':1868 'learn.microsoft.com/en-us/azure/databricks/delta/drop-table':1880 'learn.microsoft.com/en-us/azure/databricks/delta/feature-compatibility':3432 'learn.microsoft.com/en-us/azure/databricks/delta/optimize':1890 'learn.microsoft.com/en-us/azure/databricks/delta/s3-limitations':1900 'learn.microsoft.com/en-us/azure/databricks/delta/selective-overwrite':1910 'learn.microsoft.com/en-us/azure/databricks/delta/tune-file-size':1922 'learn.microsoft.com/en-us/azure/databricks/delta/vacuum':1932 'learn.microsoft.com/en-us/azure/databricks/delta/variant-shredding':1944 'learn.microsoft.com/en-us/azure/databricks/dev-tools/':3442 'learn.microsoft.com/en-us/azure/databricks/dev-tools/bundles/mlops-stacks':1954 'learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/best-practices':1964 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/migrate':3452 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-budget-policy-commands':3462 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-budgets-commands':3471 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-usage-dashboards-commands':3481 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/policy-families-commands':1974 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/troubleshooting':507 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/best-practices':1986 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect-legacy':3491 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/migrate':3503 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/testing':1997 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting':517 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/queries':2008 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/migrate':3514 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting':527 'learn.microsoft.com/en-us/azure/databricks/dev-tools/sdks':3524 'learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/cdktf':3534 'learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/troubleshoot':536 'learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/faqs':547 'learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting':556 'learn.microsoft.com/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class':565 'learn.microsoft.com/en-us/azure/databricks/error-messages/cast-invalid-input-error-class':575 'learn.microsoft.com/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class':587 'learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class':598 'learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class':609 'learn.microsoft.com/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class':619 'learn.microsoft.com/en-us/azure/databricks/error-messages/divide-by-zero-error-class':630 'learn.microsoft.com/en-us/azure/databricks/error-messages/error-classes':639 'learn.microsoft.com/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class':649 'learn.microsoft.com/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class':659 'learn.microsoft.com/en-us/azure/databricks/error-messages/geojson-parse-error-error-class':668 'learn.microsoft.com/en-us/azure/databricks/error-messages/group-by-aggregate-error-class':679 'learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class':690 'learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class':703 'learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class':714 'learn.microsoft.com/en-us/azure/databricks/error-messages/h3-not-enabled-error-class':725 'learn.microsoft.com/en-us/azure/databricks/error-messages/insufficient-table-property-error-class':735 'learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-error-class':746 'learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class':758 'learn.microsoft.com/en-us/azure/databricks/error-messages/missing-aggregation-error-class':768 'learn.microsoft.com/en-us/azure/databricks/error-messages/row-column-access-error-class':780 'learn.microsoft.com/en-us/azure/databricks/error-messages/sqlstates':789 'learn.microsoft.com/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class':801 'learn.microsoft.com/en-us/azure/databricks/error-messages/unresolved-routine-error-class':810 'learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class':820 'learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class':830 'learn.microsoft.com/en-us/azure/databricks/error-messages/wkb-parse-error-error-class':840 'learn.microsoft.com/en-us/azure/databricks/error-messages/wkt-parse-error-error-class':850 'learn.microsoft.com/en-us/azure/databricks/external-access/':4201 'learn.microsoft.com/en-us/azure/databricks/external-access/integrations':3545 'learn.microsoft.com/en-us/azure/databricks/files/files-recommendations':2018 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/idp-pipeline-tutorial':4212 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/intelligent-document-processing':4222 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/multi-agent-supervisor':2029 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/evaluation-set':2040 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/troubleshooting':859 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/debug-agent':868 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/migrate-agent-to-apps':3556 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-apps':4233 'learn.microsoft.com/en-us/azure/databricks/generative-ai/external-models/':3567 'learn.microsoft.com/en-us/azure/databricks/generative-ai/guide/agent-system-design-patterns':4244 'learn.microsoft.com/en-us/azure/databricks/generative-ai/guide/agents-dev-workflow':2053 'learn.microsoft.com/en-us/azure/databricks/generative-ai/guide/gen-ai-capabilities':3579 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-assess-performance':2062 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-enable-measurement':4255 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag':2072 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-inference-chain-rag':4265 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-overview':2080 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-rag-chain':2088 'learn.microsoft.com/en-us/azure/databricks/genie-code/instructions':2098 'learn.microsoft.com/en-us/azure/databricks/genie-code/tips':2109 'learn.microsoft.com/en-us/azure/databricks/genie/agent-mode':2119 'learn.microsoft.com/en-us/azure/databricks/genie/benchmarks':2127 'learn.microsoft.com/en-us/azure/databricks/genie/best-practices':2137 'learn.microsoft.com/en-us/azure/databricks/genie/troubleshooting':878 'learn.microsoft.com/en-us/azure/databricks/getting-started/free-trial-vs-free-edition':3590 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/':3601 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/faq':887 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/file-detection-modes':3613 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/migrating-to-file-events':2148 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production':2157 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples':2167 'learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/':3626 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns':2176 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-faq':896 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot':907 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot':916 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/faq':926 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/full-refresh':2186 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot':935 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot':945 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot':954 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot':962 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot':971 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql':3636 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot':981 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/outlook-troubleshoot':990 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pipeline-maintenance':2194 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql':3645 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance':2205 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot':999 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot':1010 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields':2215 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot':1018 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot':1028 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot':1038 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/smartsheet-troubleshoot':1046 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-faq':1057 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-overview':3655 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot':1067 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot':1076 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot':1085 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot':1095 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot':1104 'learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-errors':1113 'learn.microsoft.com/en-us/azure/databricks/init-scripts/':2225 'learn.microsoft.com/en-us/azure/databricks/init-scripts/logs':1123 'learn.microsoft.com/en-us/azure/databricks/init-scripts/referencing-files':2236 'learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-odbc-bi':3667 'learn.microsoft.com/en-us/azure/databricks/integrations/odbc/migration':3678 'learn.microsoft.com/en-us/azure/databricks/integrations/odbc/testing':1133 'learn.microsoft.com/en-us/azure/databricks/jobs/':3689 'learn.microsoft.com/en-us/azure/databricks/jobs/compute':2246 'learn.microsoft.com/en-us/azure/databricks/jobs/how-to/foreach-sql-lookup-tutorial':2259 'learn.microsoft.com/en-us/azure/databricks/jobs/large-jobs':1144 'learn.microsoft.com/en-us/azure/databricks/jobs/monitor':1155 'learn.microsoft.com/en-us/azure/databricks/jobs/repair-job-failures':1166 'learn.microsoft.com/en-us/azure/databricks/jobs/run-classic-jobs':2270 'learn.microsoft.com/en-us/azure/databricks/jobs/run-serverless-jobs':3701 'learn.microsoft.com/en-us/azure/databricks/jobs/spark-submit':3712 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/':4275 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices':2280 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/':4286 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices':2292 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/':3721 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/compute':3732 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/delta-lake':4298 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/ha-dr':4310 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/network':4320 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability':2303 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/storage':4332 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/workspace-strategy':4341 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/':4352 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices':2314 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/':4362 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices':2324 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/':4372 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices':2335 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reference':4381 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/':4390 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices':2345 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/security-compliance-and-privacy/best-practices':2356 'learn.microsoft.com/en-us/azure/databricks/lakehouse/medallion':4399 'learn.microsoft.com/en-us/azure/databricks/languages/overview':3742 'learn.microsoft.com/en-us/azure/databricks/ldp/auto-scaling':2365 'learn.microsoft.com/en-us/azure/databricks/ldp/best-practices':2376 'learn.microsoft.com/en-us/azure/databricks/ldp/cdc-advanced':2388 'learn.microsoft.com/en-us/azure/databricks/ldp/develop':2398 'learn.microsoft.com/en-us/azure/databricks/ldp/developer/external-dependencies':2408 'learn.microsoft.com/en-us/azure/databricks/ldp/expectation-patterns':2417 'learn.microsoft.com/en-us/azure/databricks/ldp/fix-high-init':2427 'learn.microsoft.com/en-us/azure/databricks/ldp/flows-backfill':2436 'learn.microsoft.com/en-us/azure/databricks/ldp/full-refresh-st':2448 'learn.microsoft.com/en-us/azure/databricks/ldp/observability':1175 'learn.microsoft.com/en-us/azure/databricks/ldp/pipeline-mode':3752 'learn.microsoft.com/en-us/azure/databricks/ldp/query-history':1186 'learn.microsoft.com/en-us/azure/databricks/ldp/recover-streaming':1196 'learn.microsoft.com/en-us/azure/databricks/ldp/stateful-processing':2457 'learn.microsoft.com/en-us/azure/databricks/ldp/what-is-change-data-capture':2467 'learn.microsoft.com/en-us/azure/databricks/libraries/restart-python-process':2478 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/dataloading':2490 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides':1207 'learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices':2500 'learn.microsoft.com/en-us/azure/databricks/machine-learning/automl/automl-covariate-forecast':2509 'learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/time-series':2524 'learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations':1217 'learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/uc/upgrade-feature-table-to-uc':3762 'learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark':2535 'learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-models':3773 'learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-models':3783 'learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-to-uc':3794 'learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/upgrade-workflows':3804 'learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/deployment-patterns':4408 'learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/llmops':2544 'learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/mlops-workflow':4417 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-inference/':3814 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/migrate-model-serving':3825 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug':1226 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code':1237 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation':2553 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/monitor-diagnose-endpoints':2563 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/production-optimization':2573 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test':2583 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/scale-ray':2593 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/spark-ray-overview':3837 'learn.microsoft.com/en-us/azure/databricks/machine-learning/retired-models-policy':3847 'learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/dl-best-practices':2604 'learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/huggingface/fine-tune-model':2619 'learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/huggingface/load-data':2632 'learn.microsoft.com/en-us/azure/databricks/machine-learning/train-recommender-models':4429 'learn.microsoft.com/en-us/azure/databricks/migration/':3858 'learn.microsoft.com/en-us/azure/databricks/migration/etl':3870 'learn.microsoft.com/en-us/azure/databricks/migration/parquet-to-delta-lake':3882 'learn.microsoft.com/en-us/azure/databricks/migration/spark':2642 'learn.microsoft.com/en-us/azure/databricks/migration/warehouse-to-lakehouse':3893 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-eval-migration':3905 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-eval-migration-reference':3915 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges':2652 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/overview/oss-managed-diff':3927 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts':2662 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/manual-tracing/':2673 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces':2683 'learn.microsoft.com/en-us/azure/databricks/notebooks/debugger':1246 'learn.microsoft.com/en-us/azure/databricks/notebooks/notebook-compute':3936 'learn.microsoft.com/en-us/azure/databricks/notebooks/run-notebook':2692 'learn.microsoft.com/en-us/azure/databricks/notebooks/test-notebooks':2701 'learn.microsoft.com/en-us/azure/databricks/oltp/instances/create/capacity':3947 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/backup-methods':3957 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/branches':4439 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/high-availability':4449 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/manage-read-replicas':2710 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/pg-stat-statements':2720 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/read-replicas':4458 'learn.microsoft.com/en-us/azure/databricks/oltp/upgrade-to-autoscaling':3970 'learn.microsoft.com/en-us/azure/databricks/optimizations/':2730 'learn.microsoft.com/en-us/azure/databricks/optimizations/aqe':2739 'learn.microsoft.com/en-us/azure/databricks/optimizations/cbo':2750 'learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache':2760 'learn.microsoft.com/en-us/azure/databricks/optimizations/dynamic-file-pruning':2774 'learn.microsoft.com/en-us/azure/databricks/optimizations/incremental-refresh':3980 'learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-io':2783 'learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-optimization':2793 'learn.microsoft.com/en-us/azure/databricks/optimizations/range-join':2802 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/':2813 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs':1257 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline':1267 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage':1278 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io':1288 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page':2824 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances':2833 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task':2844 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io':1301 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs':2854 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read':1312 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded':2863 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps':1322 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues':1333 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data':2874 'learn.microsoft.com/en-us/azure/databricks/pandas/':3989 'learn.microsoft.com/en-us/azure/databricks/partner-connect/best-practice':2885 'learn.microsoft.com/en-us/azure/databricks/partner-connect/troubleshoot':1342 'learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/broadcast':2896 'learn.microsoft.com/en-us/azure/databricks/query-federation/hms-federation-concepts':4000 'learn.microsoft.com/en-us/azure/databricks/query-federation/migrate':4011 'learn.microsoft.com/en-us/azure/databricks/query-federation/networking':2907 'learn.microsoft.com/en-us/azure/databricks/query-federation/performance-recommendations':2917 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/11.x-migration':4023 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/12.x-migration':4034 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/13.x-migration':4045 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/14.x-migration':4056 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/databricks-runtime-ver':4066 'learn.microsoft.com/en-us/azure/databricks/repos/connect-on-prem-git-server':4471 'learn.microsoft.com/en-us/azure/databricks/repos/errors-troubleshooting':1352 'learn.microsoft.com/en-us/azure/databricks/repos/serverless-private-git':4483 'learn.microsoft.com/en-us/azure/databricks/resources/pricing':4077 'learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/cost-management':4088 'learn.microsoft.com/en-us/azure/databricks/semi-structured/':4496 'learn.microsoft.com/en-us/azure/databricks/semi-structured/complex-types':2928 'learn.microsoft.com/en-us/azure/databricks/semi-structured/higher-order-functions':2941 'learn.microsoft.com/en-us/azure/databricks/semi-structured/variant-json-diff':2952 'learn.microsoft.com/en-us/azure/databricks/spark/connect-vs-classic':4098 'learn.microsoft.com/en-us/azure/databricks/sparkr/sparkr-vs-sparklyr':4108 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/fetch-stmt':1363 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/get-diagnostics-stmt':1375 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/open-stmt':1387 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/object-type':2964 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/timestamp-ntz-type':2976 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/variant-type':2987 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/validate_utf8':1399 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-analyze-compute-statistics':2998 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-sync':4120 'learn.microsoft.com/en-us/azure/databricks/sql/tpcds-eval':3011 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/performance-insights':1408 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-history':1419 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-optimization-constraints':3022 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-profile':1430 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/schedule-query':1440 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/async-checkpointing':4506 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/async-progress-checking':4516 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/checkpoints':3032 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/output-mode':4130 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/production':3041 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/performance':3053 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateless-streaming':3063 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/watermarks':3073 'learn.microsoft.com/en-us/azure/databricks/tables/automatic-upgrades':3084 'learn.microsoft.com/en-us/azure/databricks/tables/partitions':4527 'learn.microsoft.com/en-us/azure/databricks/tables/size':3095 'learn.microsoft.com/en-us/azure/databricks/transactions/transaction-modes':4139 'learn.microsoft.com/en-us/azure/databricks/transform/data-modeling':3105 'learn.microsoft.com/en-us/azure/databricks/transform/optimize-joins':3115 'learn.microsoft.com/en-us/azure/databricks/transform/validate':3127 'learn.microsoft.com/en-us/azure/databricks/udf/python-batch-udf':3137 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-best-practices':3148 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-cost-management':4150 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-endpoint-load-test':3160 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-retrieval-quality':3170 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-unused-endpoints':3182 'learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files':3192 'legaci':1772,3447,3487,3508,3819,4004 'level':3380 'leverag':2742 'librari':1505,2477 'lifecycl':4065 'light':3269 'limit':19,55,316,321,903,1896 'limits-quotas.md':318,319 'line':96,108 'link':113,122,4482 'liquid':1838 'llm':2529,2647,3256 'llmop':2539 'load':2165,2483,2576,3154 'loader':885,2143,2153,3606 'local':66,3436 'locat':90,209,1798 'log':359,449,1117 'long':1272,2837 'long-run':1271 'loss':2831 'low':1294 'low-i':1293 'maintain':2189,2197 'mainten':3845 'make':15,51,265,3196 'manag':924,1929,2191,2401,2706,3199,3211,3288,3354,3390,3455,3474,3683,3793,3923,4082,4144 'mani':1142,2848 'manual':2666 'markdown':189,205 'marketplac':383 'mask':779,1763 'materi':3978,4171 'mcp':148,175 'measur':2056,4248 'medallion':4293,4394 'memori':1329 'meta':966 'metadata':2251 'metadata-driven':2250 'metadata.generated':129 'metastor':1774,3994 'method':3541,3954 'metric':1562,2061,2387,4174 'microsoft':177,3649 'microsoftdoc':149,176 'migrat':273,431,1201,1503,1548,1790,2140,3221,3245,3254,3275,3342,3414,3445,3485,3494,3506,3551,3617,3670,3704,3776,3788,3817,3851,3866,3875,3886,3898,3911,3999,4003,4017,4026,4037,4048 'miss':762 'mitig':2857 'ml':2523,3799,4404 'ml/llm':282 'ml/llm/mlops':254 'ml/mlops':310 'ml/serving':381 'mlflow':854,2036,2646,2658,2667,3777,3903,3913,3924 'mlop':1948,4412 'mode':2115,3609,3749,4127,4138 'model':230,331,1223,1231,1588,2548,2558,2568,2612,3100,3561,3565,3770,3778,3792,3812,3823,3844,4405,4426,4489 'model/feature':425 'monitor':1147,1169,1698,2067,2298,2385,2556,2713,3046 'month':135 'mosaic':2579,3141,3164,3563,3821,4145 'mount':1793 'multi':2023,4227 'multi-ag':2022,4226 'mysql':977,3633 'name':636 'nest':2923 'network':167,281,302,355,377,2900,4086,4316 'new':3449,3498,3510 'node':1654,3309 'notebook':1245,2688,2699,3935 'ntz':2969 'object':1776,2957,3599 'observ':1716,2296 'odbc':1130,3663,3674,3677 'old':136 'older':3496 'on-prem':4467 'open':1378,1384,3920 'oper':259,420,816,826,2199,2318,2442,4356 'optim':1537,1576,1605,1738,1813,1835,1864,1883,1935,2075,2241,2275,2359,2451,2566,2725,2746,2788,2801,2847,2888,2910,2997,3014,3044,3056,3092,3101,3108,3130,3255,4142,4270 'option':283,1906,3596,3809,3985 'orchestr':2021,4229 'order':1856,2934 'outlook':986 'output':4126 'overflow':561 'overload':2858 'overwrit':1905 'panda':3984 'parquet':3878 'pars':644,647,654,657,664,835,839,845,849 'partit':1842,4524 'partner':1339,2883 'path':3876 'pattern':18,25,54,61,288,291,298,389,392,2166,2172,2414,2464,4155,4194,4240,4407,4487 'perform':235,249,306,1406,1418,1578,1593,1739,1938,1980,2058,2179,2328,2682,2724,2755,2766,2810,2911,3052,3110,3136,3145,4366 'pg':2717 'pip':34 'pipelin':315,1174,1179,1191,1553,1723,2193,2202,2361,2375,2397,2407,2426,2435,3751,3865,4189,4207,4219 'plan':3220,3274,3341,3399,3484,3616,3639,3648,3681,3715,3850,3863,3885,4014,4059,4080,4158 'plus':406 'point':2514 'point-in-tim':2513 'polici':1461,1515,1734,1744,1970,3459,3846 'pool':1668,3337 'postgresql':994,2200,3642 'power':1635 'practic':13,49,238,244,1444,1467,1477,1494,1517,1572,1617,1628,1633,1648,1665,1676,1718,1728,1754,1809,1828,1951,1960,1982,2034,2102,2132,2264,2277,2285,2311,2321,2330,2341,2353,2370,2485,2496,2600,2878 'predict':2781,2787 'prefer':173 'prem':4469 'premium':3225 'prepar':1586,2622,3412 'primari':3019 'privat':4464,4478,4481 'problem':953,1017,1066 'process':2386,2454,2473,4218 'product':1624,2155,2572,2670,3040,3684,3716 'profil':1426 'program':3737 'progress':4511 'prompt':2659 'properti':731 'protocol':3427 'provid':40,534,3533 'provis':3259 'prune':2770 'pull':140 'pyspark/sql':408 'pytest':1996 'python':515,1241,1993,2402,2472,3134,3502 'qualiti':2079,2087,2559,3169,4252 'queri':181,195,767,1006,1180,1405,1414,1425,1439,1696,1708,1710,2002,2715,2735,2765,2916,3017,3060,4006,4505 'query-bas':1005 'question':1056 'quick':68,3908 'quick-refer':67 'quota':20,56,317,320 'rag':311,2057,2068,2077,2085,4251,4262 'rang':97,2799 'rate':902 'raw':581,941 'ray':2589,3834 'read':103,118,1306,2708,2754,4453,4456 'real':3049 'real-tim':3048 'recommend':1784,2726,4425 'recov':1189 'recoveri':4160,4306 'reduc':1817,2420 'refer':69,123,410,2228,3909,4379 'refresh':2181,2441,2475,3975 'relev':91 'reliabl':260,1657,2339,4385 'remot':72 'repair':1160 'replac':1873 'replica':2709,4457 'repositori':146 'requir':166,724 'resolut':709,808 'resolv':463,539,559,662,695,717,761,804,890,919,1060,1098,1212,2836 'resourc':341,3932 'respons':2108 'restart':2470 'restor':3953 'retent':1930 'retri':1112 'retriev':3168 'return':188,204 'rewrit':2869 'right':3940 'right-siz':3939 'root':1782 'rout':436 'routin':806 'row':772,1357,1759 'run':1152,1273,2439,2686,3153,3695 'runtim':277,1206,2489,3270,3490,4020,4030,4041,4052,4062 's3':1899 'safe':1879,1931,2231,2404,2447,2689,3029,4033,4044,4055 'salesforc':1014,2212 'scala':525,3511 'scale':2416,2588,3361,3946,4452 'schedul':1438,1626,2697 'schema':2961 'scope':3861 'script':1121,1509,2221,2235 'sdks':3521 'search':256,3144,3158,3167,3180,4148 'secret':357 'section':92 'secur':21,57,342,345,363,376,1978,2349 'security.md':115,116,343,344 'select':1904,3286,3306,3570,3604,3765 'semi':4491 'semi-structur':4490 'seri':2522 'serv':231,332,426,1224,1232,1607,2551,2569,2581,3566,3824 'server':607,1052,1062,3651 'serverless':1498,1673,3237,3346,3699,4070,4085,4463,4477 'servicenow':1025 'set':386,2039,2880,3431,3631,4474 'sfdc':592 'share':497,1815 'sharepoint':1035 'shred':1940 'simba':3672 'singl':2615,2842 'size':1918,3090,3359,3941 'skew':1538,1543,2817 'skill':37,39,80,165,187,201 'skill-azure-databricks' 'skip':1850 'sku':4076 'slow':1292 'small':2849 'smartsheet':1043 'snapshot':2463 'sourc':2906,3921 'source-microsoftdocs' 'space':876,2124,2136 'spark':222,474,478,1173,1251,1262,1274,1284,1297,1308,1318,1328,2373,2395,2637,2807,2822,2838,2850,2859,2872,3280,3673,3706,3832,4093,4096 'sparklyr':4105 'sparkr':4103 'specifi':107 'spill':2819 'spot':2829 'sql':224,606,629,678,745,1051,1061,1370,1404,1413,1424,1437,1581,1602,1685,1700,2749,2940,3003,3016,3357,3368,3650 'sql/runtime':385 'sqlserver':603 'sqlstate':786,1360 'stack':1949 'stage':1275,1285,1298,2823,2839 'standard':3223 'start':3660 'startup':458 'startup/termination':221 'stat':1852,2718 'state':2452,3069,4504 'stateless':3057 'statement':2719 'statist':2992 'storag':303,1531,1783,3093,3600,4324 'store':435,1215 'strategi':2299,4340 'stream':252,308,1193,2144,2445,2453,3027,3038,3051,3059,3070,3126,4125,4515 'string':182,196,1393,1398,2949 'structur':3026,3037,3058,4124,4492 'submit':3707 'subscript':3204 'suggest':137,154 'supervisor':2027 'support':1101,2973 'sync':4112 'system':401,1694,2025,4238 'tabl':730,793,815,1488,1695,1836,1866,1878,1885,1915,1927,2185,2258,2446,2792,2991,2995,3080,3089,3379,3758,4116,4526 'table-level':3378 'tag':1450 'target':2184 'task':1143,2843,3708 'techniqu':1559 'termin':467 'terraform':533,3532 'test':1126,1989,2393,2577,2695,3155 'text/markdown':203 'throughput':3260 'tier':723,3205 'tiktok':1071 'time':2423,2516,2521,3050 'timelin':1264 'timestamp':2968 'tip':2103 'token':333 'tool':150,402,3438 'topic':442,1445,3197,4156 'topic-agent' 'topic-agent-skills' 'topic-agentic-skills' 'topic-agentskill' 'topic-ai-agents' 'topic-ai-coding' 'topic-azure' 'topic-azure-functions' 'topic-azure-kubernetes-service' 'topic-azure-openai' 'topic-azure-sql-database' 'topic-azure-storage' 'tpc':3008 'tpc-ds':3007 'tps':2534 'trace':2668,2678 'track':3215,4512 'train':4422 'transact':1527,4137 'transform':2920 'trial':3589 'trigger':3746 'troubleshoot':11,47,211,441,454,483,502,530,550,738,749,833,843,853,862,881,899,910,929,938,948,957,965,984,993,1002,1013,1041,1070,1079,1138,1158,1171,1203,1249,1336,1345,1433 'tune':1185,1683,1846,2586,2609,2629,2796,3140,4260 'type':336,1655,2925,2958,2970,2981,3302,3310,3370 'udf':3135 'ui':479,2812 'understand':590,612,813,823,3840,4069 'uniti':31,278,339,353,432,1731,1741,1749,1765,1795,1805,1876,2790,3078,3131,3291,3383,3393,3407,3416,3538,3760,3781,3790,3802,3997,4118,4330 'unnecessari':2867 'unresolv':805 'unsupport':814,824 'unus':3177 'updat':1867 'upgrad':3081,3402,3755,3797,4114 'url':443,1446,3198,4157 'usabl':2309,4347 'usag':486,1449,1807,3216,3477 'use':28,30,78,84,102,117,174,191,476,1178,1260,1366,1411,1458,1524,1542,1557,1652,1693,1860,1903,2112,2125,2218,2379,2665,2716,2733,2786,2931,2967,2979,3018,3025,3076,3236,3267,3322,3334,3469,3519,3559,3831,3965,3992,4111,4170,4432,4509 'user':139,156,1199 'utf':1391 'utf8':1397 'v1':616 'vacuum':1925 'valid':1128,1390,2547,3120 'valu':700,710 'variant':1936,2946,2960,2980 'vector':255,1484,1862,3143,3157,3166,3179,4147 'version':143,2660,3428,3779 'via':1972,3460,3479 'view':795,825,1563,1967,3979,4175 'violat':617 'volum':2014,3191 'vs':228,544,552,3747,3833 'warehous':1582,1603,1686,1701,3004,3358,3369,3889 'watchdog':1711 'watermark':2456,3067 'webpag':193 'wkb':834 'wkt':844 'work':1770,2955 'workday':1080,1092 'workflow':2052,2540,3578,3654,3800,4413,4438 'workload':1689,2156,2638,3114,3278,3612,3685,4027,4038,4049 'workspac':375,422,1499,2016,3227,3239,3405,3420,3727,3756,4338 'write':1528,2091,2873 'x':3282,4022,4032,4043,4054 'z':1855 'z-order':1854 'zendesk':1100 'zero':625 'zerobus':1108","prices":[{"id":"f690a74b-2320-453a-b339-4bdaa5bec17a","listingId":"3f902542-0fb0-4f05-bee3-01b9c2e5e76a","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"MicrosoftDocs","category":"Agent-Skills","install_from":"skills.sh"},"createdAt":"2026-04-18T21:58:48.371Z"}],"sources":[{"listingId":"3f902542-0fb0-4f05-bee3-01b9c2e5e76a","source":"github","sourceId":"MicrosoftDocs/Agent-Skills/azure-databricks","sourceUrl":"https://github.com/MicrosoftDocs/Agent-Skills/tree/main/skills/azure-databricks","isPrimary":false,"firstSeenAt":"2026-04-18T21:58:48.371Z","lastSeenAt":"2026-05-18T18:53:52.040Z"}],"details":{"listingId":"3f902542-0fb0-4f05-bee3-01b9c2e5e76a","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"MicrosoftDocs","slug":"azure-databricks","github":{"repo":"MicrosoftDocs/Agent-Skills","stars":549,"topics":["agent","agent-skills","agentic-skills","agentskill","ai","ai-agents","ai-coding","azure","azure-functions","azure-kubernetes-service","azure-openai","azure-sql-database","azure-storage","azure-virtual-machine","claude-code","github-copilot","microsoft-learn","openai-codex","skills"],"license":"cc-by-4.0","html_url":"https://github.com/MicrosoftDocs/Agent-Skills","pushed_at":"2026-05-17T02:50:05Z","description":"Curated Agent Skills for Microsoft & Azure – giving AI coding assistants structured, real-time expertise from Microsoft Learn docs.","skill_md_sha":"51fda5e3c862e24d606d36236d8bd66929476c90","skill_md_path":"skills/azure-databricks/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/MicrosoftDocs/Agent-Skills/tree/main/skills/azure-databricks"},"layout":"multi","source":"github","category":"Agent-Skills","frontmatter":{"name":"azure-databricks","description":"Expert knowledge for Azure Databricks development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Unity Catalog, Delta/Lakeflow pipelines, Spark SQL, ML/LLM serving, or AI agents on Azure Databricks, and other Azure Databricks related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure HDInsight (use azure-hdinsight), Azure Machine Learning (use azure-machine-learning), Azure Data Factory (use azure-data-factory).","compatibility":"Requires network access. Uses mcp_microsoftdocs:microsoft_docs_fetch or fetch_webpage to retrieve documentation."},"skills_sh_url":"https://skills.sh/MicrosoftDocs/Agent-Skills/azure-databricks"},"updatedAt":"2026-05-18T18:53:52.040Z"}}