{"id":"3f902542-0fb0-4f05-bee3-01b9c2e5e76a","shortId":"c9JuvE","kind":"skill","title":"azure-databricks","tagline":"Expert knowledge for Azure Databricks development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Unity Catalog, Lakehouse/Lakebase","description":"# Azure Databricks Skill\n\nThis skill provides expert guidance for Azure Databricks. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.\n\n## How to Use This Skill\n\n> **IMPORTANT for Agent**: Use the **Category Index** below to locate relevant sections. For categories with line ranges (e.g., `L35-L120`), use `read_file` with the specified lines. For categories with file links (e.g., `[security.md](security.md)`), use `read_file` on the linked reference file\n\n> **IMPORTANT for Agent**: If `metadata.generated_at` is more than 3 months old, suggest the user pull the latest version from the repository. If `mcp_microsoftdocs` tools are not available, suggest the user install it: [Installation Guide](https://github.com/MicrosoftDocs/mcp/blob/main/README.md)\n\nThis skill requires **network access** to fetch documentation content:\n- **Preferred**: Use `mcp_microsoftdocs:microsoft_docs_fetch` with query string `from=learn-agent-skill`. Returns Markdown.\n- **Fallback**: Use `fetch_webpage` with query string `from=learn-agent-skill&accept=text/markdown`. Returns Markdown.\n\n## Category Index\n\n| Category | Location | Description |\n|----------|----------|-------------|\n| Troubleshooting | L37-L138 | Diagnosing and fixing Databricks errors, job and compute failures, connector/ingestion issues, SQL error codes, and performance/debugging problems across Spark, AI, Lakeflow, and tooling. |\n| Best Practices | L139-L313 | End-to-end Databricks best practices for performance, cost, governance, streaming, ML/LLM/RAG, BI, Lakeflow, Vector Search, and operational reliability across Azure Databricks workloads. |\n| Decision Making | L314-L401 | Guides for choosing Azure Databricks architectures, compute, runtimes, ML/LLM options, and detailed migration paths (Unity Catalog, Delta, SQL, Connect, MLflow, serverless, Lakebase, and networking). |\n| Architecture & Design Patterns | L402-L444 | Architectural blueprints and patterns for Databricks: lakehouse, networking, storage, HA/DR, governance, performance, ML/MLOps, RAG/agents, Lakebase, streaming, and external data access. |\n| Limits & Quotas | [limits-quotas.md](limits-quotas.md) | Limits, quotas, and constraints for Databricks compute, AI/BI, connectors, Lakeflow, Lakebase, model serving, tokens, data types, and Unity Catalog resources, plus related workarounds. |\n| Security | [security.md](security.md) | Identity, access control, encryption, networking, compliance, and secure integrations for Azure Databricks, Unity Catalog, Lakeflow, Lakebase, apps, and external data sources. |\n| Configuration | [configuration.md](configuration.md) | Configuring and administering Azure Databricks: accounts, workspaces, security, networking, compute, storage, jobs, ML/serving, Lakehouse/Unity Catalog, Lakeflow, apps, and system-table–based monitoring. |\n| Integrations & Coding Patterns | [integrations.md](integrations.md) | Patterns and APIs for integrating Databricks with external data systems, tools, and AI/ML frameworks, plus detailed PySpark/SQL function references and Lakehouse Federation/streaming examples. |\n| Deployment | [deployment.md](deployment.md) | Deploying and operating Databricks apps, agents, models, jobs, and infrastructure using CI/CD, IaC, bundles, serving, Terraform, Git, and region/release planning. |\n\n### Troubleshooting\n| Topic | URL |\n|-------|-----|\n| Monitor Genie space activity with audit log queries | https://learn.microsoft.com/en-us/azure/databricks/ai-bi/admin/audit |\n| Troubleshoot Azure Databricks compute startup issues | https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/ |\n| Resolve Databricks classic compute termination error codes | https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes |\n| Debug Spark applications using Databricks Spark UI | https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui |\n| Troubleshoot Apache Kafka usage on Databricks | https://learn.microsoft.com/en-us/azure/databricks/connect/streaming/kafka/faq |\n| Audit and monitor Delta Sharing activity with Databricks logs | https://learn.microsoft.com/en-us/azure/databricks/delta-sharing/audit-logs |\n| Troubleshoot common Delta Sharing access errors | https://learn.microsoft.com/en-us/azure/databricks/delta-sharing/troubleshooting |\n| Troubleshoot common Databricks CLI errors and issues | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/troubleshooting |\n| Use Databricks app details for monitoring and troubleshooting | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/view-app-details |\n| Troubleshoot Databricks Connect for Python issues | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting |\n| Troubleshoot Databricks Connect for Scala problems | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting |\n| Troubleshoot common Databricks Terraform provider errors | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/troubleshoot |\n| Resolve common issues with Databricks VS Code extension | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/faqs |\n| Troubleshoot Databricks VS Code extension errors | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting |\n| Resolve ARITHMETIC_OVERFLOW errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class |\n| Handle CAST_INVALID_INPUT errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/cast-invalid-input-error-class |\n| Diagnose DC_GA4_RAW_DATA_ERROR in GA4 connector | https://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class |\n| Understand DC_SFDC_API_ERROR in Databricks connectors | https://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class |\n| Diagnose DC_SQLSERVER_ERROR in SQL Server connector | https://learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class |\n| Understand DELTA_ICEBERG_COMPAT_V1_VIOLATION errors | https://learn.microsoft.com/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class |\n| Handle DIVIDE_BY_ZERO errors in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/error-messages/divide-by-zero-error-class |\n| Handle Azure Databricks named error conditions | https://learn.microsoft.com/en-us/azure/databricks/error-messages/error-classes |\n| Fix EWKB_PARSE_ERROR geometry parsing issues | https://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class |\n| Fix EWKT_PARSE_ERROR geometry parsing issues | https://learn.microsoft.com/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class |\n| Resolve GEOJSON_PARSE_ERROR in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/geojson-parse-error-error-class |\n| Address GROUP_BY_AGGREGATE errors in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/error-messages/group-by-aggregate-error-class |\n| Handle H3_INVALID_CELL_ID errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class |\n| Interpret and resolve H3_INVALID_GRID_DISTANCE_VALUE in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class |\n| Handle H3_INVALID_RESOLUTION_VALUE errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class |\n| Resolve H3_NOT_ENABLED errors and tier requirements | https://learn.microsoft.com/en-us/azure/databricks/error-messages/h3-not-enabled-error-class |\n| Fix INSUFFICIENT_TABLE_PROPERTY errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/insufficient-table-property-error-class |\n| Troubleshoot INVALID_ARRAY_INDEX errors in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-error-class |\n| Troubleshoot INVALID_ARRAY_INDEX_IN_ELEMENT_AT in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class |\n| Resolve MISSING_AGGREGATION errors in Databricks queries | https://learn.microsoft.com/en-us/azure/databricks/error-messages/missing-aggregation-error-class |\n| Diagnose ROW_COLUMN_ACCESS errors for filters and masks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/row-column-access-error-class |\n| Interpret Azure Databricks SQLSTATE error codes | https://learn.microsoft.com/en-us/azure/databricks/error-messages/sqlstates |\n| Fix TABLE_OR_VIEW_NOT_FOUND errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class |\n| Resolve UNRESOLVED_ROUTINE function resolution errors | https://learn.microsoft.com/en-us/azure/databricks/error-messages/unresolved-routine-error-class |\n| Understand UNSUPPORTED_TABLE_OPERATION errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class |\n| Understand UNSUPPORTED_VIEW_OPERATION errors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class |\n| Troubleshoot WKB_PARSE_ERROR for geometry parsing | https://learn.microsoft.com/en-us/azure/databricks/error-messages/wkb-parse-error-error-class |\n| Troubleshoot WKT_PARSE_ERROR for geometry parsing | https://learn.microsoft.com/en-us/azure/databricks/error-messages/wkt-parse-error-error-class |\n| Troubleshoot Mosaic AI Agent Evaluation issues | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/troubleshooting |\n| Troubleshoot and debug Databricks AI agent deployments | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/debug-agent |\n| Troubleshoot common Azure Databricks Genie issues | https://learn.microsoft.com/en-us/azure/databricks/genie/troubleshooting |\n| Resolve common Databricks Auto Loader questions and issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/faq |\n| Diagnose and fix Databricks Confluence ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot |\n| Troubleshoot Dynamics 365 data ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot |\n| Troubleshoot Google Ads connector ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot |\n| Troubleshoot Google Analytics raw data ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot |\n| Troubleshoot HubSpot connector ingestion problems | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot |\n| Troubleshoot Jira Lakeflow ingestion errors | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot |\n| Troubleshoot Meta Ads Lakeflow ingestion issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot |\n| Diagnose and fix MySQL Lakeflow Connect ingestion errors | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot |\n| Resolve common PostgreSQL Lakeflow Connect connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-faq |\n| Troubleshoot PostgreSQL ingestion with Lakeflow Connect | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot |\n| Troubleshoot Lakeflow Connect query-based connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot |\n| Troubleshoot Salesforce Lakeflow ingestion problems | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot |\n| Diagnose and fix Databricks ServiceNow connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot |\n| Diagnose and fix Lakeflow SharePoint connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot |\n| Answer common SQL Server Lakeflow Connect connector questions | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-faq |\n| Troubleshoot SQL Server ingestion with Lakeflow Connect | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot |\n| Troubleshoot TikTok Ads connector in Lakeflow | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot |\n| Troubleshoot Workday HCM connector in Lakeflow | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot |\n| Diagnose and fix Databricks Workday connector issues | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot |\n| Troubleshoot Databricks Zendesk Support connector errors | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot |\n| Handle Zerobus Ingest errors and retries | https://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-errors |\n| Use logging to troubleshoot Databricks init scripts | https://learn.microsoft.com/en-us/azure/databricks/init-scripts/logs |\n| Test and validate legacy Databricks JDBC driver connections | https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/testing |\n| Test and validate Databricks ODBC driver connections | https://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/testing |\n| Configure and troubleshoot Lakeflow Jobs with many tasks | https://learn.microsoft.com/en-us/azure/databricks/jobs/large-jobs |\n| Troubleshoot and repair Azure Databricks job failures | https://learn.microsoft.com/en-us/azure/databricks/jobs/repair-job-failures |\n| Monitor and troubleshoot Lakeflow Spark pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/observability |\n| Use pipeline query history for debugging and tuning | https://learn.microsoft.com/en-us/azure/databricks/ldp/query-history |\n| Recover Databricks pipelines from checkpoint failures | https://learn.microsoft.com/en-us/azure/databricks/ldp/recover-streaming |\n| User guides, migration, and troubleshooting for AI Runtime | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides |\n| Troubleshoot Databricks Feature Store issues and limits | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations |\n| Debug common issues in Databricks Model Serving endpoints | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug |\n| Diagnose Databricks model serving issues with Genie Code | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code |\n| Debug Python code in Databricks notebooks | https://learn.microsoft.com/en-us/azure/databricks/notebooks/debugger |\n| Troubleshoot failing Spark jobs and executors in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs |\n| Use Databricks Spark jobs timeline for debugging | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline |\n| Diagnose long-running Spark stages in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage |\n| Investigate high I/O Spark stages in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io |\n| Debug slow low-I/O Spark stages in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io |\n| Identify expensive reads in Spark DAG on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read |\n| Diagnose gaps between Spark jobs in Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps |\n| Diagnose and fix Spark memory issues on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues |\n| Troubleshoot Azure Databricks Partner Connect issues | https://learn.microsoft.com/en-us/azure/databricks/partner-connect/troubleshoot |\n| Troubleshoot Databricks Git folder errors | https://learn.microsoft.com/en-us/azure/databricks/repos/errors-troubleshooting |\n| Fetch cursor rows and handle SQLSTATE in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/fetch-stmt |\n| Use GET DIAGNOSTICS for SQL error handling in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/get-diagnostics-stmt |\n| Open cursors and handle errors with OPEN in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/open-stmt |\n| Validate UTF-8 strings and handle INVALID_UTF8_STRING | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/validate_utf8 |\n| Understand Databricks SQL query performance insights | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/performance-insights |\n| Use Databricks query history to debug performance | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-history |\n| Interpret Databricks query profiles for performance tuning | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-profile |\n| Identify and clean up unused Vector Search endpoints | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-unused-endpoints |\n\n### Best Practices\n| Topic | URL |\n|-------|-----|\n| Use Databricks default compute policy families effectively | https://learn.microsoft.com/en-us/azure/databricks/admin/clusters/policy-families |\n| Apply identity best practices and migrate to federation | https://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices |\n| Apply best practices for Azure Databricks serverless workspaces | https://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices |\n| Migrate Databricks library installs from init scripts | https://learn.microsoft.com/en-us/azure/databricks/archive/compute/libraries-init-scripts |\n| Apply best practices for Databricks compute policies | https://learn.microsoft.com/en-us/azure/databricks/archive/compute/policies-best-practices |\n| Use DBIO for transactional writes to cloud storage in Databricks | https://learn.microsoft.com/en-us/azure/databricks/archive/legacy/dbio-commit |\n| Optimize skewed joins in Databricks using skew hints | https://learn.microsoft.com/en-us/azure/databricks/archive/legacy/skew-join |\n| Migrate from Databricks Deep Learning Pipelines | https://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines |\n| Model business data with Unity Catalog metric views | https://learn.microsoft.com/en-us/azure/databricks/business-semantics/metric-views/basic-modeling |\n| Apply Azure Databricks platform administration best practices | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/administration |\n| Optimize BI performance with Databricks SQL warehouses | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving |\n| Prepare and model data for high-performance BI on Databricks | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep |\n| Configure Databricks SQL warehouses for optimal BI serving | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving |\n| Apply Azure Databricks compute creation best practices | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/compute |\n| Implement Azure Databricks production job scheduling best practices | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/jobs |\n| Best practices for Power BI dashboards on Databricks | https://learn.microsoft.com/en-us/azure/databricks/cheat-sheet/power-bi |\n| Apply Databricks compute configuration best practices | https://learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices |\n| Use flexible node types for reliable Databricks compute | https://learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-types |\n| Apply best practices for Databricks pools | https://learn.microsoft.com/en-us/azure/databricks/compute/pool-best-practices |\n| Apply serverless compute best practices in Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/compute/serverless/best-practices |\n| Tune Databricks SQL warehouses for BI workloads | https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings |\n| Use system table queries to monitor Databricks SQL warehouses | https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/monitor/queries |\n| Control large interactive queries with Query Watchdog | https://learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/query-watchdog |\n| Apply observability best practices for Databricks jobs and pipelines | https://learn.microsoft.com/en-us/azure/databricks/data-engineering/observability-best-practices |\n| Write efficient UDFs for Unity Catalog ABAC policies | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/udf-best-practices |\n| Apply Unity Catalog data governance best practices | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/best-practices |\n| Work with legacy Hive metastore database objects | https://learn.microsoft.com/en-us/azure/databricks/database-objects/hive-metastore |\n| Follow DBFS root storage recommendations in Databricks | https://learn.microsoft.com/en-us/azure/databricks/dbfs/dbfs-root |\n| Migrate from DBFS mounts to Unity Catalog external locations | https://learn.microsoft.com/en-us/azure/databricks/dbfs/mounts |\n| Apply DBFS and Unity Catalog usage best practices | https://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog |\n| Optimize Delta Sharing to reduce cloud egress costs | https://learn.microsoft.com/en-us/azure/databricks/delta-sharing/manage-egress |\n| Apply Delta Lake best practices on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/best-practices |\n| Optimize Databricks tables with liquid clustering | https://learn.microsoft.com/en-us/azure/databricks/delta/clustering |\n| Tune Azure Databricks data skipping with stats and Z-order | https://learn.microsoft.com/en-us/azure/databricks/delta/data-skipping |\n| Use deletion vectors to accelerate Delta table modifications on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/deletion-vectors |\n| Optimize Delta table file layout on Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/optimize |\n| Handle Delta Lake limitations on Amazon S3 | https://learn.microsoft.com/en-us/azure/databricks/delta/s3-limitations |\n| Apply selective overwrite patterns in Delta Lake | https://learn.microsoft.com/en-us/azure/databricks/delta/selective-overwrite |\n| Control Delta table data file size on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/tune-file-size |\n| Vacuum Delta tables safely and efficiently on Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/vacuum |\n| Optimize VARIANT data performance with shredding on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/delta/variant-shredding |\n| Apply MLOps Stack best practices with bundles | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/bundles/mlops-stacks |\n| Apply Databricks-recommended CI/CD workflows and patterns | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/best-practices |\n| View Databricks cluster policy families via CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/policy-families-commands |\n| Apply security and performance best practices for Databricks apps | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/best-practices |\n| Test Databricks Connect for Python code with pytest | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/testing |\n| Handle async queries and interruptions in Databricks Connect | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/queries |\n| Choose between Databricks volumes and workspace files | https://learn.microsoft.com/en-us/azure/databricks/files/files-recommendations |\n| Customize MLflow 2 AI judges for your agents | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/advanced-agent-eval |\n| Apply best practices for MLflow 2 evaluation sets | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/evaluation-set |\n| Measure RAG performance with Databricks metrics | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-assess-performance |\n| Create evaluation sets for Databricks RAG apps | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-define-quality |\n| Evaluate and monitor RAG apps on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag |\n| Optimize Databricks RAG application quality | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-overview |\n| Improve Databricks RAG chain quality | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-rag-chain |\n| Configure Genie Code custom instructions effectively | https://learn.microsoft.com/en-us/azure/databricks/genie-code/instructions |\n| Apply practical tips to improve Genie Code responses | https://learn.microsoft.com/en-us/azure/databricks/genie-code/tips |\n| Apply best practices for curating Genie spaces | https://learn.microsoft.com/en-us/azure/databricks/genie/best-practices |\n| Migrate existing Auto Loader streams to file events | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/migrating-to-file-events |\n| Apply common Auto Loader data ingestion patterns | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/patterns |\n| Configure Databricks Auto Loader for production | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production |\n| Configure Auto Loader with Unity Catalog for secure ingestion | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/unity-catalog |\n| Apply common COPY INTO data loading patterns | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples |\n| Use the _metadata file column in Databricks | https://learn.microsoft.com/en-us/azure/databricks/ingestion/file-metadata-column |\n| Apply common patterns for Lakeflow managed ingestion pipelines | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns |\n| Fully refresh Lakeflow Connect managed ingestion target tables | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/full-refresh |\n| Query system.billing.usage to monitor Lakeflow ingestion costs | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/monitor-costs |\n| Perform ongoing maintenance for Lakeflow pipelines | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pipeline-maintenance |\n| Maintain and operate PostgreSQL ingestion pipelines in Lakeflow | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance |\n| Enable incremental ingestion for Salesforce formula fields | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields |\n| Use Databricks init scripts for cluster customization | https://learn.microsoft.com/en-us/azure/databricks/init-scripts/ |\n| Reference external files safely in Databricks init scripts | https://learn.microsoft.com/en-us/azure/databricks/init-scripts/referencing-files |\n| Configure compute for Lakeflow Jobs with recommended patterns | https://learn.microsoft.com/en-us/azure/databricks/jobs/compute |\n| Build metadata-driven For each jobs with control tables | https://learn.microsoft.com/en-us/azure/databricks/jobs/how-to/foreach-sql-lookup-tutorial |\n| Apply best practices for configuring classic Lakeflow Jobs | https://learn.microsoft.com/en-us/azure/databricks/jobs/run-classic-jobs |\n| Apply cost optimization best practices on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices |\n| Implement best practices for Databricks data and AI governance | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices |\n| Design observability and monitoring strategy for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability |\n| Apply interoperability and usability best practices on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices |\n| Implement operational excellence best practices on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices |\n| Apply performance best practices for Azure Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices |\n| Apply reliability best practices on Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices |\n| Optimize Lakeflow pipelines with enhanced autoscaling | https://learn.microsoft.com/en-us/azure/databricks/ldp/auto-scaling |\n| Apply best practices for Lakeflow Spark Declarative Pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/best-practices |\n| Use advanced AUTO CDC features and monitor processing metrics | https://learn.microsoft.com/en-us/azure/databricks/ldp/cdc-advanced |\n| Apply development best practices to Lakeflow pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/develop |\n| Manage Python dependencies safely in Databricks pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/external-dependencies |\n| Implement advanced expectation patterns at scale | https://learn.microsoft.com/en-us/azure/databricks/ldp/expectation-patterns |\n| Reduce Lakeflow pipeline initialization latency | https://learn.microsoft.com/en-us/azure/databricks/ldp/fix-high-init |\n| Backfill historical data with Lakeflow pipelines | https://learn.microsoft.com/en-us/azure/databricks/ldp/flows-backfill |\n| Run full refresh operations for Databricks streaming tables safely | https://learn.microsoft.com/en-us/azure/databricks/ldp/full-refresh-st |\n| Optimize stateful stream processing with watermarks | https://learn.microsoft.com/en-us/azure/databricks/ldp/stateful-processing |\n| Design CDC and snapshot patterns in Databricks | https://learn.microsoft.com/en-us/azure/databricks/ldp/what-is-change-data-capture |\n| Restart the Python process to refresh Databricks libraries | https://learn.microsoft.com/en-us/azure/databricks/libraries/restart-python-process |\n| Apply data loading best practices on Databricks AI Runtime | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/dataloading |\n| Track experiments and monitor GPU health on AI Runtime | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/tracking-observability |\n| Apply Hyperopt best practices and troubleshooting on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices |\n| Implement point-in-time correct feature joins for time series | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/time-series |\n| Benchmark Databricks LLM endpoints for latency and throughput | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark |\n| Load and prepare data for ML on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/load-data/ |\n| Implement LLMOps workflows on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/llmops |\n| Configure Locust-based load tests for Databricks serving | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/configure-load-test |\n| Validate models before Databricks Model Serving deployment | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation |\n| Optimize Databricks Model Serving endpoints for production | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/production-optimization |\n| Plan and execute load testing for Databricks endpoints | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test |\n| Tune and scale Ray clusters on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/scale-ray |\n| Implement distributed image inference on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/reference-solutions/images-etl-inference |\n| Follow deep learning best practices on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/dl-best-practices |\n| Fine-tune Hugging Face models on a single GPU in Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/huggingface/fine-tune-model |\n| Prepare datasets for Hugging Face fine-tuning on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/huggingface/load-data |\n| Adapt Apache Spark workloads for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/migration/spark |\n| Align MLflow LLM judges with human evaluators | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges |\n| Optimize prompts using MLflow GEPA optimizer | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/automatically-optimize-prompts |\n| Evaluate and compare MLflow prompt versions effectively | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts |\n| Use manual MLflow tracing for production GenAI apps | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/manual-tracing/ |\n| Analyze GenAI traces for errors and performance | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces |\n| Apply software engineering practices to Databricks notebooks | https://learn.microsoft.com/en-us/azure/databricks/notebooks/best-practices |\n| Apply Genie Code effectively in Databricks notebooks | https://learn.microsoft.com/en-us/azure/databricks/notebooks/code-assistant |\n| Run Databricks notebooks safely and efficiently | https://learn.microsoft.com/en-us/azure/databricks/notebooks/run-notebook |\n| Test and schedule Databricks notebook code | https://learn.microsoft.com/en-us/azure/databricks/notebooks/test-notebooks |\n| Configure and optimize Lakebase Postgres computes | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/manage-computes |\n| Create and manage Lakebase read replicas | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/manage-read-replicas |\n| Monitor Lakebase queries using pg_stat_statements | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/pg-stat-statements |\n| Apply performance optimization recommendations on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/ |\n| Use adaptive query execution on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/aqe |\n| Leverage cost-based optimizer in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/optimizations/cbo |\n| Improve read performance with Databricks disk cache | https://learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache |\n| Improve Delta query performance with dynamic file pruning on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/dynamic-file-pruning |\n| Accelerate data access with predictive I/O | https://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-io |\n| Use predictive optimization for Unity Catalog tables | https://learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-optimization |\n| Tune Azure Databricks range join performance | https://learn.microsoft.com/en-us/azure/databricks/optimizations/range-join |\n| Diagnose Databricks Spark cost and performance in UI | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/ |\n| Debug skew and spill in Databricks Spark stages | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page |\n| Handle Databricks spot instance losses effectively | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances |\n| Resolve long Spark stages with a single task | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task |\n| Optimize many small Spark jobs on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs |\n| Mitigate overloaded Spark driver on Databricks | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded |\n| Detect unnecessary data rewriting in Databricks Spark writes | https://learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data |\n| Best practices for setting up Databricks Partner Connect | https://learn.microsoft.com/en-us/azure/databricks/partner-connect/best-practice |\n| Configure networking for Databricks Lakehouse Federation data sources | https://learn.microsoft.com/en-us/azure/databricks/query-federation/networking |\n| Optimize performance of Databricks Lakehouse Federation queries | https://learn.microsoft.com/en-us/azure/databricks/query-federation/performance-recommendations |\n| Encrypt inter-node traffic in Databricks clusters | https://learn.microsoft.com/en-us/azure/databricks/security/keys/encrypt-otw |\n| Transform complex and nested data types in Databricks | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/complex-types |\n| Use higher-order functions on arrays in Databricks SQL | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/higher-order-functions |\n| Query semi-structured data using VARIANT in Databricks | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/variant |\n| Differences between VARIANT and JSON strings in Databricks | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/variant-json-diff |\n| Work with OBJECT type and VARIANT schemas in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/object-type |\n| Use TIMESTAMP_NTZ type and Delta support in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/timestamp-ntz-type |\n| Use VARIANT type and Iceberg compatibility in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/variant-type |\n| Collect table statistics with ANALYZE TABLE for optimization | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-analyze-compute-statistics |\n| Use Databricks SQL query caching for performance | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-caching |\n| Use Databricks SQL query filters effectively | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-filters |\n| Optimize queries using primary key constraints in Databricks | https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-optimization-constraints |\n| Use Delta tables for streaming reads and writes | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/delta-lake |\n| Production best practices for Databricks Structured Streaming | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/production |\n| Optimize and monitor Databricks real-time streaming performance | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/performance |\n| Optimize stateless Structured Streaming queries on Databricks | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateless-streaming |\n| Monitor Azure Databricks Structured Streaming queries | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/stream-monitoring |\n| Combine Unity Catalog with Structured Streaming workloads | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/unity-catalog |\n| Apply watermarks for efficient stateful streaming | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/watermarks |\n| Use Automatic Feature Enablement for Unity Catalog tables | https://learn.microsoft.com/en-us/azure/databricks/tables/automatic-feature-enablement |\n| Analyze and optimize Delta table storage size on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/tables/size |\n| Design data models optimized for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/transform/data-modeling |\n| Optimize join performance for Azure Databricks workloads | https://learn.microsoft.com/en-us/azure/databricks/transform/optimize-joins |\n| Clean and validate data with Databricks batch and streaming | https://learn.microsoft.com/en-us/azure/databricks/transform/validate |\n| Evaluate and compare Mosaic AI Vector Search retrieval quality | https://learn.microsoft.com/en-us/azure/databricks/vector-search/retrieval-quality-eval |\n| Optimize Mosaic AI Vector Search performance | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-best-practices |\n| Optimize and manage Mosaic AI Vector Search costs | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-cost-management |\n| Design and run load tests for Vector Search endpoints | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-endpoint-load-test |\n| Improve Mosaic AI Vector Search retrieval quality | https://learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-retrieval-quality |\n| Download internet data into Azure Databricks volumes | https://learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files |\n\n### Decision Making\n| Topic | URL |\n|-------|-----|\n| Manage and change Azure Databricks subscription plans | https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/account |\n| Plan migration from Databricks Standard to Premium tier | https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/standard-tier |\n| Decide when and how to use serverless workspaces | https://learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces |\n| Decide and migrate from dbx to Databricks bundles | https://learn.microsoft.com/en-us/azure/databricks/archive/dev-tools/dbx/dbx-migrate |\n| Migrate optimized LLM endpoints to provisioned throughput | https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/migrate-provisioned-throughput |\n| Decide when to use Databricks Light runtime | https://learn.microsoft.com/en-us/azure/databricks/archive/runtime/light |\n| Plan migration of Databricks workloads to Spark 3.x | https://learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/ |\n| Select and manage the default Unity Catalog catalog | https://learn.microsoft.com/en-us/azure/databricks/catalogs/default |\n| Choose appropriate Azure Databricks compute types | https://learn.microsoft.com/en-us/azure/databricks/compute/choose-compute |\n| Decide when and how to use GPU Databricks compute | https://learn.microsoft.com/en-us/azure/databricks/compute/gpu |\n| Decide when and how to use Azure Databricks pools | https://learn.microsoft.com/en-us/azure/databricks/compute/pool-index |\n| Plan migration from classic to serverless Databricks compute | https://learn.microsoft.com/en-us/azure/databricks/compute/serverless/migration |\n| Plan Databricks SQL warehouse sizing and queuing | https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-behavior |\n| Choose between Databricks SQL warehouse types | https://learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-types |\n| Choose managed vs external assets in Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/managed-versus-external |\n| Plan and execute upgrade of Databricks workspaces to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/ |\n| Prepare and migrate to Unity Catalog–only Databricks workspaces | https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/uc-only-migration |\n| Choose Delta Lake protocol versions and feature sets | https://learn.microsoft.com/en-us/azure/databricks/delta/feature-compatibility |\n| Choose local development tools for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/ |\n| Migrate from legacy to new Databricks CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/migrate |\n| Manage Databricks account budget policies via CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-budget-policy-commands |\n| Configure Databricks account budgets using CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-budgets-commands |\n| Manage Databricks account usage dashboards via CLI | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-usage-dashboards-commands |\n| Select and configure compute size for Databricks Apps | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/compute-size |\n| Plan migration from legacy Databricks Connect runtimes | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect-legacy |\n| Migrate from older to new Databricks Connect for Python | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/migrate |\n| Migrate from legacy to new Scala Databricks Connect | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/migrate |\n| Choose and use Databricks SDKs for automation | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sdks |\n| Decide between CDKTF and Databricks Terraform provider | https://learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/cdktf |\n| Choose Unity Catalog integration method for external engines | https://learn.microsoft.com/en-us/azure/databricks/external-access/integrations |\n| Interpret MLflow 2 Agent Evaluation quality, cost, latency | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/llm-judge-metrics |\n| Migrate Databricks Community Edition to Free Edition | https://learn.microsoft.com/en-us/azure/databricks/getting-started/ce-migration |\n| Choose between Databricks Free Edition and free trial | https://learn.microsoft.com/en-us/azure/databricks/getting-started/free-trial-vs-free-edition |\n| Choose incremental ingestion options from cloud object storage | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/ |\n| Select Auto Loader file detection mode for your workload | https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/file-detection-modes |\n| Plan migration of existing data to Delta Lake on Databricks | https://learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/ |\n| Plan MySQL ingestion workflow and setup in Lakeflow | https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql |\n| Choose and start with Databricks ODBC and JDBC drivers | https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-odbc-bi |\n| Migrate from Simba Spark ODBC to Databricks ODBC | https://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/migration |\n| Plan and manage production workloads with Lakeflow Jobs | https://learn.microsoft.com/en-us/azure/databricks/jobs/ |\n| Decide when to run Lakeflow Jobs on serverless compute | https://learn.microsoft.com/en-us/azure/databricks/jobs/run-serverless-jobs |\n| Migrate from Spark Submit tasks in Databricks jobs | https://learn.microsoft.com/en-us/azure/databricks/jobs/spark-submit |\n| Plan production Azure Databricks lakehouse deployments | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/ |\n| Design compute and workspace configuration for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/compute |\n| Choose a programming language for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/languages/overview |\n| Migrate legacy and third-party online tables to Lakebase | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/migrate-from-online-tables |\n| Upgrade workspace feature tables to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/uc/upgrade-feature-table-to-uc |\n| Choose Databricks-hosted foundation models and endpoints | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-models |\n| Migrate MLflow model versions to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-models |\n| Decide and migrate to Unity Catalog model management | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-to-uc |\n| Upgrade Databricks ML workflows to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/upgrade-workflows |\n| Choose Databricks options for batch model inference | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-inference/ |\n| Select supported foundation models on Mosaic AI | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/foundation-model-overview |\n| Migrate from legacy MLflow to Mosaic AI Model Serving | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/migrate-model-serving |\n| Decide when to use Spark vs. Ray on Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/spark-ray-overview |\n| Plan migration of data applications to Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/migration/ |\n| Assess options for migrating ETL pipelines to Databricks | https://learn.microsoft.com/en-us/azure/databricks/migration/etl |\n| Choose a migration path from Parquet to Delta Lake | https://learn.microsoft.com/en-us/azure/databricks/migration/parquet-to-delta-lake |\n| Migrate enterprise data warehouses to the Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/migration/warehouse-to-lakehouse |\n| Decide and migrate from Agent Evaluation to MLflow 3 | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-eval-migration |\n| Quick reference for migrating to MLflow 3 | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-eval-migration-reference |\n| Choose between open source and Databricks MLflow | https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/overview/oss-managed-diff |\n| Choose compute resources for Databricks notebooks | https://learn.microsoft.com/en-us/azure/databricks/notebooks/notebook-compute |\n| Right-size Lakebase instance capacity and scaling | https://learn.microsoft.com/en-us/azure/databricks/oltp/instances/create/capacity |\n| Choose backup and restore methods for Lakebase | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/backup-methods |\n| Decide between Lakebase Provisioned and Autoscaling projects | https://learn.microsoft.com/en-us/azure/databricks/oltp/upgrade-to-autoscaling |\n| Choose and configure incremental refresh for Databricks materialized views | https://learn.microsoft.com/en-us/azure/databricks/optimizations/incremental-refresh |\n| Choose pandas options on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/pandas/ |\n| Plan and use Hive metastore federation with Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/query-federation/hms-federation-concepts |\n| Migrate Databricks HTTP routing to serverless compute | https://learn.microsoft.com/en-us/azure/databricks/query-federation/http-migration |\n| Migrate legacy Databricks query federation to Lakehouse Federation | https://learn.microsoft.com/en-us/azure/databricks/query-federation/migrate |\n| Plan and execute migration to Databricks Runtime 11.x | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/11.x-migration |\n| Migrate workloads to Databricks Runtime 12.x safely | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/12.x-migration |\n| Migrate workloads to Databricks Runtime 13.x safely | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/13.x-migration |\n| Migrate workloads to Databricks Runtime 14.x safely | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/14.x-migration |\n| Plan around Databricks Runtime support lifecycles | https://learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/databricks-runtime-ver |\n| Understand serverless DBU billing by Azure Databricks SKU | https://learn.microsoft.com/en-us/azure/databricks/resources/pricing |\n| Evaluate Databricks serverless networking data transfer costs | https://learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/cost-management |\n| Decide between Spark Connect and Spark Classic | https://learn.microsoft.com/en-us/azure/databricks/spark/connect-vs-classic |\n| Decide between SparkR and sparklyr on Databricks | https://learn.microsoft.com/en-us/azure/databricks/sparkr/sparkr-vs-sparklyr |\n| Migrate to the latest Databricks SQL REST API | https://learn.microsoft.com/en-us/azure/databricks/sql/dbsql-api-latest |\n| Use SYNC to upgrade Hive tables to Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-sync |\n| Choose Structured Streaming output modes on Databricks | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/output-mode |\n| Choose and implement Databricks transaction modes | https://learn.microsoft.com/en-us/azure/databricks/transactions/transaction-modes |\n\n### Architecture & Design Patterns\n| Topic | URL |\n|-------|-----|\n| Plan disaster recovery architecture for Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/admin/disaster-recovery |\n| Design and use materialization for Databricks metric views | https://learn.microsoft.com/en-us/azure/databricks/business-semantics/metric-views/materialization |\n| Implement fan-in and fan-out patterns in Lakeflow pipelines | https://learn.microsoft.com/en-us/azure/databricks/data-engineering/fan-in-fan-out |\n| Choose patterns for external access to Databricks data | https://learn.microsoft.com/en-us/azure/databricks/external-access/ |\n| Build an IDP pipeline with Databricks AI Functions | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/idp-pipeline-tutorial |\n| Build multi-agent orchestrator apps on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-apps |\n| Create Genie-based multi-agent systems on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-genie |\n| Build non-conversational Databricks AI agents with MLflow | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/non-conversational-agents |\n| Implement AI agent memory on Databricks Model Serving | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/stateful-agents-model-serving |\n| Apply agent system design patterns on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/guide/agent-system-design-patterns |\n| Design measurement infrastructure for RAG quality on Databricks | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-enable-measurement |\n| Design and tune Databricks RAG inference chains | https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-inference-chain-rag |\n| Design cost optimization architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/ |\n| Apply data and AI governance architecture on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/ |\n| Design Delta Lake and medallion data architecture on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/delta-lake |\n| Design high availability and disaster recovery for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/ha-dr |\n| Design Azure Databricks network and connectivity architecture | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/network |\n| Design storage architecture for Azure Databricks and Unity Catalog | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/storage |\n| Design Azure Databricks workspace architecture strategy | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/workspace-strategy |\n| Design interoperability and usability architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/ |\n| Design operational excellence architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/ |\n| Design performance efficiency architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/ |\n| Apply Azure Databricks lakehouse reference architectures | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reference |\n| Design reliability architecture for Databricks lakehouse | https://learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/ |\n| Apply the data lakehouse pattern on Databricks | https://learn.microsoft.com/en-us/azure/databricks/lakehouse/ |\n| Design online feature workflows with Databricks and third-party stores | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/online-workflows |\n| Choose Databricks ML model deployment patterns | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/deployment-patterns |\n| Implement MLOps workflows on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/mlops-workflow |\n| Choose and train deep-learning recommenders in Databricks | https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-recommender-models |\n| Use Lakebase branches for database development workflows | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/branches |\n| Design for high availability with Lakebase computes | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/high-availability |\n| Scale reads with Lakebase read replicas | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/read-replicas |\n| Serve lakehouse data via Lakebase synced tables | https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/sync-tables |\n| Connect Databricks Serverless Private Git to on-prem Git | https://learn.microsoft.com/en-us/azure/databricks/repos/connect-on-prem-git-server |\n| Set up Databricks Serverless Private Git with Private Link | https://learn.microsoft.com/en-us/azure/databricks/repos/serverless-private-git |\n| Choose patterns for modeling semi-structured data on Databricks | https://learn.microsoft.com/en-us/azure/databricks/semi-structured/ |\n| Use asynchronous state checkpointing in Structured Streaming | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/async-checkpointing |\n| Apply asynchronous progress tracking in Structured Streaming | https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/async-progress-checking |\n| Decide when to partition Delta tables on Azure Databricks | https://learn.microsoft.com/en-us/azure/databricks/tables/partitions |","tags":["azure","databricks","agent","skills","microsoftdocs","agent-skills","agentic-skills","agentskill","ai-agents","ai-coding","azure-functions","azure-kubernetes-service"],"capabilities":["skill","source-microsoftdocs","skill-azure-databricks","topic-agent","topic-agent-skills","topic-agentic-skills","topic-agentskill","topic-ai-agents","topic-ai-coding","topic-azure","topic-azure-functions","topic-azure-kubernetes-service","topic-azure-openai","topic-azure-sql-database","topic-azure-storage"],"categories":["Agent-Skills"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/MicrosoftDocs/Agent-Skills/azure-databricks","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"cli":"npx skills add MicrosoftDocs/Agent-Skills","source_repo":"https://github.com/MicrosoftDocs/Agent-Skills","install_from":"skills.sh"}},"qualityScore":"0.698","qualityRationale":"deterministic score 0.70 from registry signals: · indexed on github topic:agent-skills · 497 github stars · SKILL.md body (62,386 chars)","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill-github:v1","enrichmentVersion":1,"enrichedAt":"2026-04-22T06:53:31.178Z","embedding":null,"createdAt":"2026-04-18T21:58:48.371Z","updatedAt":"2026-04-22T06:53:31.178Z","lastSeenAt":"2026-04-22T06:53:31.178Z","tsv":"'-8':1396 '/en-us/azure/databricks/admin/account-settings/account':3273 '/en-us/azure/databricks/admin/account-settings/standard-tier':3284 '/en-us/azure/databricks/admin/clusters/policy-families':1459 '/en-us/azure/databricks/admin/disaster-recovery':4181 '/en-us/azure/databricks/admin/users-groups/best-practices':1470 '/en-us/azure/databricks/admin/workspace/serverless-workspaces':3295 '/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices':1481 '/en-us/azure/databricks/ai-bi/admin/audit':462 '/en-us/azure/databricks/archive/compute/libraries-init-scripts':1491 '/en-us/azure/databricks/archive/compute/policies-best-practices':1501 '/en-us/azure/databricks/archive/dev-tools/dbx/dbx-migrate':3306 '/en-us/azure/databricks/archive/legacy/dbio-commit':1514 '/en-us/azure/databricks/archive/legacy/skew-join':1525 '/en-us/azure/databricks/archive/machine-learning/migrate-provisioned-throughput':3316 '/en-us/azure/databricks/archive/runtime/light':3326 '/en-us/azure/databricks/archive/spark-3.x-migration/':3338 '/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines':1534 '/en-us/azure/databricks/business-semantics/metric-views/basic-modeling':1545 '/en-us/azure/databricks/business-semantics/metric-views/materialization':4192 '/en-us/azure/databricks/catalogs/default':3349 '/en-us/azure/databricks/cheat-sheet/administration':1555 '/en-us/azure/databricks/cheat-sheet/bi-serving':1565 '/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep':1579 '/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving':1590 '/en-us/azure/databricks/cheat-sheet/compute':1600 '/en-us/azure/databricks/cheat-sheet/jobs':1611 '/en-us/azure/databricks/cheat-sheet/power-bi':1622 '/en-us/azure/databricks/compute/choose-compute':3358 '/en-us/azure/databricks/compute/cluster-config-best-practices':1631 '/en-us/azure/databricks/compute/flexible-node-types':1642 '/en-us/azure/databricks/compute/gpu':3370 '/en-us/azure/databricks/compute/pool-best-practices':1651 '/en-us/azure/databricks/compute/pool-index':3382 '/en-us/azure/databricks/compute/serverless/best-practices':1662 '/en-us/azure/databricks/compute/serverless/migration':3393 '/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings':1672 '/en-us/azure/databricks/compute/sql-warehouse/monitor/queries':1684 '/en-us/azure/databricks/compute/sql-warehouse/warehouse-behavior':3403 '/en-us/azure/databricks/compute/sql-warehouse/warehouse-types':3412 '/en-us/azure/databricks/compute/troubleshooting/':471 '/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes':481 '/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui':491 '/en-us/azure/databricks/compute/troubleshooting/query-watchdog':1694 '/en-us/azure/databricks/connect/streaming/kafka/faq':500 '/en-us/azure/databricks/data-engineering/fan-in-fan-out':4207 '/en-us/azure/databricks/data-engineering/observability-best-practices':1706 '/en-us/azure/databricks/data-governance/unity-catalog/abac/udf-best-practices':1717 '/en-us/azure/databricks/data-governance/unity-catalog/best-practices':1727 '/en-us/azure/databricks/data-governance/unity-catalog/managed-versus-external':3423 '/en-us/azure/databricks/data-governance/unity-catalog/upgrade/':3436 '/en-us/azure/databricks/data-governance/unity-catalog/upgrade/uc-only-migration':3448 '/en-us/azure/databricks/database-objects/hive-metastore':1737 '/en-us/azure/databricks/dbfs/dbfs-root':1747 '/en-us/azure/databricks/dbfs/mounts':1759 '/en-us/azure/databricks/dbfs/unity-catalog':1770 '/en-us/azure/databricks/delta-sharing/audit-logs':512 '/en-us/azure/databricks/delta-sharing/manage-egress':1781 '/en-us/azure/databricks/delta-sharing/troubleshooting':521 '/en-us/azure/databricks/delta/best-practices':1792 '/en-us/azure/databricks/delta/clustering':1801 '/en-us/azure/databricks/delta/data-skipping':1815 '/en-us/azure/databricks/delta/deletion-vectors':1829 '/en-us/azure/databricks/delta/feature-compatibility':3459 '/en-us/azure/databricks/delta/optimize':1839 '/en-us/azure/databricks/delta/s3-limitations':1849 '/en-us/azure/databricks/delta/selective-overwrite':1859 '/en-us/azure/databricks/delta/tune-file-size':1871 '/en-us/azure/databricks/delta/vacuum':1882 '/en-us/azure/databricks/delta/variant-shredding':1894 '/en-us/azure/databricks/dev-tools/':3469 '/en-us/azure/databricks/dev-tools/bundles/mlops-stacks':1904 '/en-us/azure/databricks/dev-tools/ci-cd/best-practices':1915 '/en-us/azure/databricks/dev-tools/cli/migrate':3479 '/en-us/azure/databricks/dev-tools/cli/reference/account-budget-policy-commands':3489 '/en-us/azure/databricks/dev-tools/cli/reference/account-budgets-commands':3498 '/en-us/azure/databricks/dev-tools/cli/reference/account-usage-dashboards-commands':3508 '/en-us/azure/databricks/dev-tools/cli/reference/policy-families-commands':1925 '/en-us/azure/databricks/dev-tools/cli/troubleshooting':531 '/en-us/azure/databricks/dev-tools/databricks-apps/best-practices':1937 '/en-us/azure/databricks/dev-tools/databricks-apps/compute-size':3519 '/en-us/azure/databricks/dev-tools/databricks-apps/view-app-details':542 '/en-us/azure/databricks/dev-tools/databricks-connect-legacy':3529 '/en-us/azure/databricks/dev-tools/databricks-connect/python/migrate':3541 '/en-us/azure/databricks/dev-tools/databricks-connect/python/testing':1948 '/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting':551 '/en-us/azure/databricks/dev-tools/databricks-connect/queries':1959 '/en-us/azure/databricks/dev-tools/databricks-connect/scala/migrate':3552 '/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting':560 '/en-us/azure/databricks/dev-tools/sdks':3562 '/en-us/azure/databricks/dev-tools/terraform/cdktf':3572 '/en-us/azure/databricks/dev-tools/terraform/troubleshoot':569 '/en-us/azure/databricks/dev-tools/vscode-ext/faqs':580 '/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting':589 '/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class':598 '/en-us/azure/databricks/error-messages/cast-invalid-input-error-class':608 '/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class':620 '/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class':631 '/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class':642 '/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class':652 '/en-us/azure/databricks/error-messages/divide-by-zero-error-class':663 '/en-us/azure/databricks/error-messages/error-classes':672 '/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class':682 '/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class':692 '/en-us/azure/databricks/error-messages/geojson-parse-error-error-class':701 '/en-us/azure/databricks/error-messages/group-by-aggregate-error-class':712 '/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class':723 '/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class':736 '/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class':747 '/en-us/azure/databricks/error-messages/h3-not-enabled-error-class':758 '/en-us/azure/databricks/error-messages/insufficient-table-property-error-class':768 '/en-us/azure/databricks/error-messages/invalid-array-index-error-class':779 '/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class':791 '/en-us/azure/databricks/error-messages/missing-aggregation-error-class':801 '/en-us/azure/databricks/error-messages/row-column-access-error-class':813 '/en-us/azure/databricks/error-messages/sqlstates':822 '/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class':834 '/en-us/azure/databricks/error-messages/unresolved-routine-error-class':843 '/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class':853 '/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class':863 '/en-us/azure/databricks/error-messages/wkb-parse-error-error-class':873 '/en-us/azure/databricks/error-messages/wkt-parse-error-error-class':883 '/en-us/azure/databricks/external-access/':4218 '/en-us/azure/databricks/external-access/integrations':3583 '/en-us/azure/databricks/files/files-recommendations':1969 '/en-us/azure/databricks/generative-ai/agent-bricks/idp-pipeline-tutorial':4229 '/en-us/azure/databricks/generative-ai/agent-evaluation/advanced-agent-eval':1980 '/en-us/azure/databricks/generative-ai/agent-evaluation/evaluation-set':1991 '/en-us/azure/databricks/generative-ai/agent-evaluation/llm-judge-metrics':3594 '/en-us/azure/databricks/generative-ai/agent-evaluation/troubleshooting':892 '/en-us/azure/databricks/generative-ai/agent-framework/debug-agent':902 '/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-apps':4240 '/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-genie':4253 '/en-us/azure/databricks/generative-ai/agent-framework/non-conversational-agents':4265 '/en-us/azure/databricks/generative-ai/agent-framework/stateful-agents-model-serving':4276 '/en-us/azure/databricks/generative-ai/guide/agent-system-design-patterns':4286 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-assess-performance':2000 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-define-quality':2010 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-enable-measurement':4297 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag':2020 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-inference-chain-rag':4307 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-overview':2028 '/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-rag-chain':2036 '/en-us/azure/databricks/genie-code/instructions':2045 '/en-us/azure/databricks/genie-code/tips':2056 '/en-us/azure/databricks/genie/best-practices':2066 '/en-us/azure/databricks/genie/troubleshooting':911 '/en-us/azure/databricks/getting-started/ce-migration':3604 '/en-us/azure/databricks/getting-started/free-trial-vs-free-edition':3615 '/en-us/azure/databricks/ingestion/cloud-object-storage/':3626 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/faq':922 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/file-detection-modes':3638 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/migrating-to-file-events':2077 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/patterns':2087 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production':2096 '/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/unity-catalog':2108 '/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples':2118 '/en-us/azure/databricks/ingestion/data-migration/':3651 '/en-us/azure/databricks/ingestion/file-metadata-column':2128 '/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns':2139 '/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot':932 '/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot':941 '/en-us/azure/databricks/ingestion/lakeflow-connect/full-refresh':2150 '/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot':950 '/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot':960 '/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot':968 '/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot':976 '/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot':985 '/en-us/azure/databricks/ingestion/lakeflow-connect/monitor-costs':2160 '/en-us/azure/databricks/ingestion/lakeflow-connect/mysql':3662 '/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot':996 '/en-us/azure/databricks/ingestion/lakeflow-connect/pipeline-maintenance':2169 '/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-faq':1006 '/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance':2180 '/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot':1015 '/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot':1026 '/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields':2190 '/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot':1034 '/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot':1044 '/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot':1054 '/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-faq':1065 '/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot':1075 '/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot':1084 '/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot':1093 '/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot':1103 '/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot':1112 '/en-us/azure/databricks/ingestion/zerobus-errors':1121 '/en-us/azure/databricks/init-scripts/':2200 '/en-us/azure/databricks/init-scripts/logs':1131 '/en-us/azure/databricks/init-scripts/referencing-files':2211 '/en-us/azure/databricks/integrations/jdbc-odbc-bi':3674 '/en-us/azure/databricks/integrations/jdbc/testing':1142 '/en-us/azure/databricks/integrations/odbc/migration':3685 '/en-us/azure/databricks/integrations/odbc/testing':1152 '/en-us/azure/databricks/jobs/':3696 '/en-us/azure/databricks/jobs/compute':2222 '/en-us/azure/databricks/jobs/how-to/foreach-sql-lookup-tutorial':2235 '/en-us/azure/databricks/jobs/large-jobs':1163 '/en-us/azure/databricks/jobs/repair-job-failures':1173 '/en-us/azure/databricks/jobs/run-classic-jobs':2246 '/en-us/azure/databricks/jobs/run-serverless-jobs':3708 '/en-us/azure/databricks/jobs/spark-submit':3719 '/en-us/azure/databricks/lakehouse-architecture/cost-optimization/':4317 '/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices':2256 '/en-us/azure/databricks/lakehouse-architecture/data-governance/':4328 '/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices':2268 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/':3728 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/compute':3739 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/delta-lake':4340 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/ha-dr':4352 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/network':4362 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability':2279 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/storage':4374 '/en-us/azure/databricks/lakehouse-architecture/deployment-guide/workspace-strategy':4383 '/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/':4394 '/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices':2290 '/en-us/azure/databricks/lakehouse-architecture/operational-excellence/':4404 '/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices':2300 '/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/':4414 '/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices':2311 '/en-us/azure/databricks/lakehouse-architecture/reference':4423 '/en-us/azure/databricks/lakehouse-architecture/reliability/':4432 '/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices':2321 '/en-us/azure/databricks/lakehouse/':4442 '/en-us/azure/databricks/languages/overview':3749 '/en-us/azure/databricks/ldp/auto-scaling':2330 '/en-us/azure/databricks/ldp/best-practices':2341 '/en-us/azure/databricks/ldp/cdc-advanced':2353 '/en-us/azure/databricks/ldp/develop':2363 '/en-us/azure/databricks/ldp/developer/external-dependencies':2373 '/en-us/azure/databricks/ldp/expectation-patterns':2382 '/en-us/azure/databricks/ldp/fix-high-init':2390 '/en-us/azure/databricks/ldp/flows-backfill':2399 '/en-us/azure/databricks/ldp/full-refresh-st':2411 '/en-us/azure/databricks/ldp/observability':1182 '/en-us/azure/databricks/ldp/query-history':1193 '/en-us/azure/databricks/ldp/recover-streaming':1202 '/en-us/azure/databricks/ldp/stateful-processing':2420 '/en-us/azure/databricks/ldp/what-is-change-data-capture':2430 '/en-us/azure/databricks/libraries/restart-python-process':2441 '/en-us/azure/databricks/machine-learning/ai-runtime/dataloading':2453 '/en-us/azure/databricks/machine-learning/ai-runtime/guides':1213 '/en-us/azure/databricks/machine-learning/ai-runtime/tracking-observability':2465 '/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices':2476 '/en-us/azure/databricks/machine-learning/feature-store/migrate-from-online-tables':3762 '/en-us/azure/databricks/machine-learning/feature-store/online-workflows':4456 '/en-us/azure/databricks/machine-learning/feature-store/time-series':2490 '/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations':1223 '/en-us/azure/databricks/machine-learning/feature-store/uc/upgrade-feature-table-to-uc':3772 '/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark':2501 '/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-models':3783 '/en-us/azure/databricks/machine-learning/load-data/':2512 '/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-models':3793 '/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-to-uc':3804 '/en-us/azure/databricks/machine-learning/manage-model-lifecycle/upgrade-workflows':3814 '/en-us/azure/databricks/machine-learning/mlops/deployment-patterns':4465 '/en-us/azure/databricks/machine-learning/mlops/llmops':2521 '/en-us/azure/databricks/machine-learning/mlops/mlops-workflow':4474 '/en-us/azure/databricks/machine-learning/model-inference/':3824 '/en-us/azure/databricks/machine-learning/model-serving/configure-load-test':2533 '/en-us/azure/databricks/machine-learning/model-serving/foundation-model-overview':3834 '/en-us/azure/databricks/machine-learning/model-serving/migrate-model-serving':3846 '/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug':1234 '/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code':1245 '/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation':2543 '/en-us/azure/databricks/machine-learning/model-serving/production-optimization':2553 '/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test':2564 '/en-us/azure/databricks/machine-learning/ray/scale-ray':2574 '/en-us/azure/databricks/machine-learning/ray/spark-ray-overview':3858 '/en-us/azure/databricks/machine-learning/reference-solutions/images-etl-inference':2583 '/en-us/azure/databricks/machine-learning/train-model/dl-best-practices':2594 '/en-us/azure/databricks/machine-learning/train-model/huggingface/fine-tune-model':2609 '/en-us/azure/databricks/machine-learning/train-model/huggingface/load-data':2622 '/en-us/azure/databricks/machine-learning/train-recommender-models':4486 '/en-us/azure/databricks/migration/':3869 '/en-us/azure/databricks/migration/etl':3880 '/en-us/azure/databricks/migration/parquet-to-delta-lake':3892 '/en-us/azure/databricks/migration/spark':2632 '/en-us/azure/databricks/migration/warehouse-to-lakehouse':3903 '/en-us/azure/databricks/mlflow3/genai/agent-eval-migration':3915 '/en-us/azure/databricks/mlflow3/genai/agent-eval-migration-reference':3925 '/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges':2642 '/en-us/azure/databricks/mlflow3/genai/overview/oss-managed-diff':3935 '/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/automatically-optimize-prompts':2651 '/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts':2661 '/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/manual-tracing/':2672 '/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces':2682 '/en-us/azure/databricks/notebooks/best-practices':2692 '/en-us/azure/databricks/notebooks/code-assistant':2702 '/en-us/azure/databricks/notebooks/debugger':1254 '/en-us/azure/databricks/notebooks/notebook-compute':3944 '/en-us/azure/databricks/notebooks/run-notebook':2711 '/en-us/azure/databricks/notebooks/test-notebooks':2720 '/en-us/azure/databricks/oltp/instances/create/capacity':3955 '/en-us/azure/databricks/oltp/projects/backup-methods':3965 '/en-us/azure/databricks/oltp/projects/branches':4496 '/en-us/azure/databricks/oltp/projects/high-availability':4506 '/en-us/azure/databricks/oltp/projects/manage-computes':2729 '/en-us/azure/databricks/oltp/projects/manage-read-replicas':2738 '/en-us/azure/databricks/oltp/projects/pg-stat-statements':2748 '/en-us/azure/databricks/oltp/projects/read-replicas':4515 '/en-us/azure/databricks/oltp/projects/sync-tables':4525 '/en-us/azure/databricks/oltp/upgrade-to-autoscaling':3975 '/en-us/azure/databricks/optimizations/':2758 '/en-us/azure/databricks/optimizations/aqe':2767 '/en-us/azure/databricks/optimizations/cbo':2778 '/en-us/azure/databricks/optimizations/disk-cache':2788 '/en-us/azure/databricks/optimizations/dynamic-file-pruning':2802 '/en-us/azure/databricks/optimizations/incremental-refresh':3987 '/en-us/azure/databricks/optimizations/predictive-io':2811 '/en-us/azure/databricks/optimizations/predictive-optimization':2821 '/en-us/azure/databricks/optimizations/range-join':2830 '/en-us/azure/databricks/optimizations/spark-ui-guide/':2841 '/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs':1265 '/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline':1275 '/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage':1286 '/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io':1296 '/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page':2852 '/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances':2861 '/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task':2872 '/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io':1309 '/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs':2882 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read':1320 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded':2891 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps':1330 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues':1341 '/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data':2902 '/en-us/azure/databricks/pandas/':3996 '/en-us/azure/databricks/partner-connect/best-practice':2913 '/en-us/azure/databricks/partner-connect/troubleshoot':1350 '/en-us/azure/databricks/query-federation/hms-federation-concepts':4008 '/en-us/azure/databricks/query-federation/http-migration':4018 '/en-us/azure/databricks/query-federation/migrate':4029 '/en-us/azure/databricks/query-federation/networking':2924 '/en-us/azure/databricks/query-federation/performance-recommendations':2934 '/en-us/azure/databricks/release-notes/runtime/11.x-migration':4041 '/en-us/azure/databricks/release-notes/runtime/12.x-migration':4052 '/en-us/azure/databricks/release-notes/runtime/13.x-migration':4063 '/en-us/azure/databricks/release-notes/runtime/14.x-migration':4074 '/en-us/azure/databricks/release-notes/runtime/databricks-runtime-ver':4083 '/en-us/azure/databricks/repos/connect-on-prem-git-server':4538 '/en-us/azure/databricks/repos/errors-troubleshooting':1358 '/en-us/azure/databricks/repos/serverless-private-git':4550 '/en-us/azure/databricks/resources/pricing':4094 '/en-us/azure/databricks/security/keys/encrypt-otw':2945 '/en-us/azure/databricks/security/network/serverless-network-security/cost-management':4104 '/en-us/azure/databricks/semi-structured/':4563 '/en-us/azure/databricks/semi-structured/complex-types':2956 '/en-us/azure/databricks/semi-structured/higher-order-functions':2969 '/en-us/azure/databricks/semi-structured/variant':2981 '/en-us/azure/databricks/semi-structured/variant-json-diff':2992 '/en-us/azure/databricks/spark/connect-vs-classic':4114 '/en-us/azure/databricks/sparkr/sparkr-vs-sparklyr':4124 '/en-us/azure/databricks/sql/dbsql-api-latest':4135 '/en-us/azure/databricks/sql/language-manual/control-flow/fetch-stmt':1369 '/en-us/azure/databricks/sql/language-manual/control-flow/get-diagnostics-stmt':1381 '/en-us/azure/databricks/sql/language-manual/control-flow/open-stmt':1393 '/en-us/azure/databricks/sql/language-manual/data-types/object-type':3004 '/en-us/azure/databricks/sql/language-manual/data-types/timestamp-ntz-type':3016 '/en-us/azure/databricks/sql/language-manual/data-types/variant-type':3027 '/en-us/azure/databricks/sql/language-manual/functions/validate_utf8':1405 '/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-analyze-compute-statistics':3038 '/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-sync':4147 '/en-us/azure/databricks/sql/user/queries/performance-insights':1414 '/en-us/azure/databricks/sql/user/queries/query-caching':3048 '/en-us/azure/databricks/sql/user/queries/query-filters':3057 '/en-us/azure/databricks/sql/user/queries/query-history':1424 '/en-us/azure/databricks/sql/user/queries/query-optimization-constraints':3068 '/en-us/azure/databricks/sql/user/queries/query-profile':1434 '/en-us/azure/databricks/structured-streaming/async-checkpointing':4573 '/en-us/azure/databricks/structured-streaming/async-progress-checking':4583 '/en-us/azure/databricks/structured-streaming/delta-lake':3079 '/en-us/azure/databricks/structured-streaming/output-mode':4157 '/en-us/azure/databricks/structured-streaming/production':3089 '/en-us/azure/databricks/structured-streaming/real-time/performance':3101 '/en-us/azure/databricks/structured-streaming/stateless-streaming':3111 '/en-us/azure/databricks/structured-streaming/stream-monitoring':3120 '/en-us/azure/databricks/structured-streaming/unity-catalog':3130 '/en-us/azure/databricks/structured-streaming/watermarks':3139 '/en-us/azure/databricks/tables/automatic-feature-enablement':3150 '/en-us/azure/databricks/tables/partitions':4595 '/en-us/azure/databricks/tables/size':3163 '/en-us/azure/databricks/transactions/transaction-modes':4166 '/en-us/azure/databricks/transform/data-modeling':3173 '/en-us/azure/databricks/transform/optimize-joins':3183 '/en-us/azure/databricks/transform/validate':3195 '/en-us/azure/databricks/vector-search/retrieval-quality-eval':3207 '/en-us/azure/databricks/vector-search/vector-search-best-practices':3216 '/en-us/azure/databricks/vector-search/vector-search-cost-management':3227 '/en-us/azure/databricks/vector-search/vector-search-endpoint-load-test':3239 '/en-us/azure/databricks/vector-search/vector-search-retrieval-quality':3249 '/en-us/azure/databricks/vector-search/vector-search-unused-endpoints':1445 '/en-us/azure/databricks/volumes/download-internet-files':3259 '/microsoftdocs/mcp/blob/main/readme.md)':162 '/o':1302 '11':4037 '12':4047 '13':4058 '14':4069 '2':1972,1986,3586 '3':133,3334,3912,3922 '365':935 'abac':1713 'acceler':1820,2803 'accept':201 'access':167,320,352,517,805,2805,4212 'account':380,3482,3492,3501 'across':231,262 'activ':455,506 'ad':944,979,1078 'adapt':2623,2760 'address':702 'administ':377 'administr':1550 'advanc':2343,2375 'agent':82,126,185,199,434,887,898,1977,3587,3908,4233,4247,4260,4268,4278 'aggreg':705,794 'ai':233,886,897,1209,1973,2264,2449,2461,3200,3210,3221,3242,3831,3841,4225,4259,4267,4321 'ai/bi':332 'ai/ml':415 'align':2633 'amazon':1845 'analyt':953 'analyz':2673,3032,3151 'answer':1055 'apach':493,2624 'api':405,624,4132 'app':367,391,433,534,1934,2007,2015,2669,3516,4235 'appli':1460,1471,1492,1546,1591,1623,1643,1652,1695,1718,1760,1782,1850,1895,1905,1926,1981,2046,2057,2078,2109,2129,2236,2247,2280,2301,2312,2331,2354,2442,2466,2683,2693,2749,3131,4277,4318,4415,4433,4574 'applic':484,2024,3863 'appropri':3351 'architectur':16,51,276,295,301,4167,4175,4311,4323,4335,4359,4365,4379,4388,4398,4408,4420,4426 'arithmet':591 'around':4076 'array':771,782,2963 'assess':3870 'asset':3417 'async':1950 'asynchron':4565,4575 'audit':457,501 'auto':915,2069,2080,2090,2098,2344,3628 'autom':3559 'automat':3141 'autosc':2327,3971 'avail':152,4343,4500 'azur':2,7,34,43,263,274,361,378,464,665,815,905,1167,1343,1475,1547,1592,1602,1658,1788,1803,1825,1867,1890,2275,2306,2517,2590,2628,2754,2798,2823,3113,3159,3169,3178,3254,3267,3352,3377,3465,3722,3735,3745,3865,3992,4089,4177,4354,4367,4376,4416,4470,4591 'azure-databrick':1 'backfil':2391 'backup':3957 'base':396,1021,2525,2771,4244 'batch':3190,3819 'benchmark':2491 'best':12,47,237,247,1446,1462,1472,1493,1551,1596,1607,1612,1627,1644,1655,1697,1723,1766,1785,1898,1930,1982,2058,2237,2250,2258,2284,2294,2303,2314,2332,2356,2445,2468,2587,2903,3081 'bi':255,1557,1574,1586,1616,1668 'bill':4087 'blueprint':302 'branch':4489 'budget':3483,3493 'build':2223,4219,4230,4254 'bundl':442,1901,3303 'busi':1536 'cach':2785,3043 'capabl':74 'capac':3950 'cast':600 'catalog':32,286,343,364,389,1540,1712,1720,1754,1764,2102,2817,3123,3146,3345,3346,3420,3433,3442,3575,3769,3790,3799,3811,4005,4144,4371 'categori':85,93,109,205,207 'cdc':2345,2422 'cdktf':3565 'cell':716 'chain':2032,4304 'chang':3266 'checkpoint':1198,4567 'choos':273,1960,3350,3404,3413,3449,3460,3553,3573,3605,3616,3663,3740,3773,3815,3881,3926,3936,3956,3976,3988,4148,4158,4208,4457,4475,4551 'ci/cd':440,1909 'classic':474,2241,3386,4111 'clean':1437,3184 'cli':525,1922,3476,3486,3495,3505 'cloud':1508,1776,3621 'cluster':1798,1918,2196,2569,2942 'code':24,59,227,399,478,576,584,819,1242,1248,1943,2039,2052,2695,2717 'collect':3028 'column':804,2123 'combin':64,3121 'common':514,523,562,571,904,913,998,1056,1225,2079,2110,2130 'communiti':3597 'compar':2654,3198 'compat':646,3022 'complex':2947 'complianc':356 'comput':221,277,331,384,466,475,1453,1497,1594,1625,1639,1654,2213,2726,3354,3367,3390,3512,3705,3730,3937,4015,4503 'condit':669 'configur':22,57,372,375,1153,1580,1626,2037,2088,2097,2212,2240,2522,2721,2914,3490,3511,3733,3978 'configuration.md':373,374 'confluenc':927 'connect':289,545,554,991,1001,1012,1018,1060,1072,1139,1149,1346,1940,1956,2143,2910,3525,3536,3549,4108,4358,4526 'connector':333,617,628,639,945,963,1002,1022,1040,1050,1061,1079,1088,1099,1108 'connector/ingestion':223 'constraint':328,3063 'content':69,171 'control':353,1685,1860,2231 'convers':4257 'copi':2111 'correct':2482 'cost':251,1778,2157,2248,2770,2834,3224,3590,4101,4309 'cost-bas':2769 'cover':45 'creat':2001,2730,4241 'creation':1595 'curat':2061 'cursor':1360,1383 'custom':1970,2040,2197 'dag':1315 'dashboard':1617,3503 'data':319,339,370,411,613,936,955,1537,1569,1721,1805,1863,1885,2082,2113,2262,2393,2443,2505,2804,2894,2920,2950,2974,3165,3187,3252,3643,3862,3895,4099,4215,4319,4334,4435,4518,4558 'databas':1733,4491 'databrick':3,8,35,44,217,246,264,275,306,330,362,379,408,432,465,473,486,497,508,524,533,544,553,563,574,582,595,605,627,659,666,698,708,720,733,744,765,775,788,797,816,831,850,860,896,906,914,926,1038,1097,1105,1126,1136,1146,1168,1195,1215,1228,1236,1250,1262,1267,1283,1293,1306,1317,1327,1338,1344,1352,1366,1378,1390,1407,1416,1426,1451,1476,1483,1496,1511,1519,1528,1548,1560,1576,1581,1593,1603,1619,1624,1638,1647,1659,1664,1679,1700,1744,1789,1794,1804,1826,1836,1868,1879,1891,1907,1917,1933,1939,1955,1962,1996,2005,2017,2022,2030,2089,2125,2192,2206,2253,2261,2276,2287,2297,2307,2317,2369,2405,2427,2437,2448,2473,2492,2509,2518,2529,2537,2545,2560,2571,2580,2591,2606,2619,2629,2688,2698,2704,2715,2755,2764,2774,2783,2799,2824,2832,2847,2854,2879,2888,2897,2908,2917,2928,2941,2953,2965,2978,2989,3001,3013,3024,3040,3050,3065,3084,3093,3108,3114,3160,3170,3179,3189,3255,3268,3277,3302,3321,3330,3353,3366,3378,3389,3395,3406,3429,3444,3466,3475,3481,3491,3500,3515,3524,3535,3548,3556,3567,3596,3607,3648,3667,3681,3715,3723,3736,3746,3775,3806,3816,3855,3866,3877,3899,3931,3940,3982,3993,4010,4021,4035,4045,4056,4067,4077,4090,4096,4121,4129,4154,4161,4178,4187,4214,4224,4237,4250,4258,4271,4283,4294,4301,4313 'databricks-host':3774 'databricks-recommend':1906 'dataset':2611 'dbfs':1739,1750,1761 'dbio':1503 'dbu':4086 'dbx':3300 'dc':610,622,633 'debug':482,895,1188,1224,1246,1272,1297,1420,2842 'decid':3285,3296,3317,3359,3371,3563,3697,3794,3847,3904,3966,4105,4115,4584 'decis':14,49,266,3260 'declar':2337 'deep':1529,2585,4479 'deep-learn':4478 'default':1452,3343 'delet':1817 'delta':287,504,515,644,1772,1783,1821,1831,1841,1855,1861,1873,2790,3010,3070,3154,3450,3645,3888,4330,4588 'depend':2366 'deploy':27,62,426,429,899,2540,3725,4461 'deployment.md':427,428 'descript':209 'design':17,52,296,2269,2421,3164,3228,3729,4168,4182,4280,4287,4298,4308,4329,4341,4353,4363,4375,4384,4395,4405,4424,4443,4497 'detail':282,418,535 'detect':2892,3631 'develop':9,2355,3462,4492 'diagnos':214,609,632,802,923,986,1035,1045,1094,1235,1276,1321,1331,2831 'diagnost':1372 'differ':2982 'disast':4173,4345 'disk':2784 'distanc':730 'distribut':2576 'divid':654 'doc':177 'document':72,170 'download':3250 'driven':2226 'driver':1138,1148,2886,3671 'dynam':934,2794 'e.g':97,113 'edit':3598,3601,3609 'effect':1456,2042,2658,2696,2858,3054 'effici':1708,1877,2708,3134,4407 'egress':1777 'element':785 'enabl':751,2181,3143 'encrypt':354,2935 'end':243,245 'end-to-end':242 'endpoint':1231,1442,2494,2548,2561,3236,3310,3780 'engin':2685,3580 'enhanc':2326 'enterpris':3894 'error':218,226,477,518,526,566,586,593,603,614,625,635,649,657,668,676,686,696,706,718,742,752,763,773,795,806,818,829,840,848,858,867,877,973,993,1109,1116,1355,1375,1386,2677 'etl':3874 'evalu':888,1987,2002,2011,2639,2652,3196,3588,3909,4095 'event':2074 'ewkb':674 'ewkt':684 'exampl':425 'excel':2293,4397 'execut':2556,2762,3426,4032 'executor':1260 'exist':2068,3642 'expect':2376 'expens':1311 'experi':2455 'expert':4,40 'extens':577,585 'extern':318,369,410,1755,2202,3416,3579,4211 'face':2599,2614 'fail':1256 'failur':222,1170,1199 'fallback':189 'famili':1455,1920 'fan':4195,4199 'fan-in':4194 'fan-out':4198 'featur':1216,2346,2483,3142,3455,3765,4445 'feder':1467,2919,2930,4002,4023,4026 'federation/streaming':424 'fetch':73,169,178,191,1359 'field':2187 'file':103,111,118,123,1833,1864,1966,2073,2122,2203,2795,3630 'filter':808,3053 'fine':2596,2616 'fine-tun':2595,2615 'fix':216,673,683,759,823,925,988,1037,1047,1096,1333 'flexibl':1633 'folder':1354 'follow':1738,2584 'formula':2186 'found':828 'foundat':3777,3827 'framework':416 'free':3600,3608,3611 'full':2401 'fulli':2140 'function':420,838,2961,4226 'ga4':611,616 'gap':1322 'genai':2668,2674 'geni':453,907,1241,2038,2051,2062,2694,4243 'genie-bas':4242 'geojson':694 'geometri':677,687,869,879 'gepa':2647 'get':1371 'git':445,1353,4530,4535,4544 'github.com':161 'github.com/microsoftdocs/mcp/blob/main/readme.md)':160 'googl':943,952 'govern':252,311,1722,2265,4322 'gpu':2458,2604,3365 'grid':729 'group':703 'guid':159,271,1204 'guidanc':41 'h3':714,727,738,749 'ha/dr':310 'handl':599,653,664,713,737,1113,1363,1376,1385,1399,1840,1949,2853 'hcm':1087 'health':2459 'high':1288,1572,4342,4499 'high-perform':1571 'higher':2959 'higher-ord':2958 'hint':1522 'histor':2392 'histori':1186,1418 'hive':1731,4000,4140 'host':3776 'http':4011 'hubspot':962 'hug':2598,2613 'human':2638 'hyperopt':2467 'i/o':1289,2808 'iac':441 'iceberg':645,3021 'id':717 'ident':351,1461 'identifi':1310,1435 'idp':4221 'imag':2577 'implement':1601,2257,2291,2374,2477,2513,2575,4160,4193,4266,4466 'import':80,124 'improv':2029,2050,2779,2789,3240 'includ':10 'increment':2182,3617,3979 'index':86,206,772,783 'infer':2578,3821,4303 'infrastructur':438,4289 'ingest':928,937,946,956,964,972,981,992,1009,1030,1069,1115,2083,2105,2135,2145,2156,2174,2183,3618,3654 'init':1127,1487,2193,2207 'initi':2386 'input':602 'insight':1411 'instal':156,158,1485 'instanc':2856,3949 'instruct':2041 'insuffici':760 'integr':23,58,359,398,407,3576 'integrations.md':401,402 'inter':2937 'inter-nod':2936 'interact':1687 'internet':3251 'interoper':2281,4385 'interpret':724,814,1425,3584 'interrupt':1953 'invalid':601,715,728,739,770,781,1400 'investig':1287 'issu':224,468,528,548,572,679,689,889,908,919,929,938,947,957,982,1003,1023,1041,1051,1100,1218,1226,1239,1336,1347 'jdbc':1137,3670 'jira':970 'job':219,386,436,1157,1169,1258,1269,1325,1605,1701,2216,2229,2243,2877,3693,3702,3716 'join':1517,2484,2826,3175 'json':2986 'judg':1974,2636 'kafka':494 'key':3062 'knowledg':5 'l120':100 'l138':213 'l139':240 'l139-l313':239 'l313':241 'l314':269 'l314-l401':268 'l35':99 'l35-l120':98 'l37':212 'l37-l138':211 'l401':270 'l402':299 'l402-l444':298 'l444':300 'lake':1784,1842,1856,3451,3646,3889,4331 'lakebas':292,315,335,366,2724,2733,2740,3759,3948,3962,3968,4488,4502,4510,4520 'lakeflow':234,256,334,365,390,971,980,990,1000,1011,1017,1029,1048,1059,1071,1081,1090,1156,1177,2133,2142,2155,2165,2177,2215,2242,2323,2335,2359,2384,2395,3659,3692,3701,4203 'lakehous':307,423,2308,2318,2918,2929,3724,3900,4025,4314,4349,4391,4401,4411,4418,4429,4436,4517 'lakehouse/lakebase':33 'lakehouse/unity':388 'languag':3743 'larg':1686 'latenc':2387,2496,3591 'latest':141,4128 'layout':1834 'learn':184,198,1530,2586,4480 'learn-agent-skil':183,197 'learn.microsoft.com':461,470,480,490,499,511,520,530,541,550,559,568,579,588,597,607,619,630,641,651,662,671,681,691,700,711,722,735,746,757,767,778,790,800,812,821,833,842,852,862,872,882,891,901,910,921,931,940,949,959,967,975,984,995,1005,1014,1025,1033,1043,1053,1064,1074,1083,1092,1102,1111,1120,1130,1141,1151,1162,1172,1181,1192,1201,1212,1222,1233,1244,1253,1264,1274,1285,1295,1308,1319,1329,1340,1349,1357,1368,1380,1392,1404,1413,1423,1433,1444,1458,1469,1480,1490,1500,1513,1524,1533,1544,1554,1564,1578,1589,1599,1610,1621,1630,1641,1650,1661,1671,1683,1693,1705,1716,1726,1736,1746,1758,1769,1780,1791,1800,1814,1828,1838,1848,1858,1870,1881,1893,1903,1914,1924,1936,1947,1958,1968,1979,1990,1999,2009,2019,2027,2035,2044,2055,2065,2076,2086,2095,2107,2117,2127,2138,2149,2159,2168,2179,2189,2199,2210,2221,2234,2245,2255,2267,2278,2289,2299,2310,2320,2329,2340,2352,2362,2372,2381,2389,2398,2410,2419,2429,2440,2452,2464,2475,2489,2500,2511,2520,2532,2542,2552,2563,2573,2582,2593,2608,2621,2631,2641,2650,2660,2671,2681,2691,2701,2710,2719,2728,2737,2747,2757,2766,2777,2787,2801,2810,2820,2829,2840,2851,2860,2871,2881,2890,2901,2912,2923,2933,2944,2955,2968,2980,2991,3003,3015,3026,3037,3047,3056,3067,3078,3088,3100,3110 'learn.microsoft.com/en-us/azure/databricks/admin/account-settings/account':3271 'learn.microsoft.com/en-us/azure/databricks/admin/account-settings/standard-tier':3282 'learn.microsoft.com/en-us/azure/databricks/admin/clusters/policy-families':1457 'learn.microsoft.com/en-us/azure/databricks/admin/disaster-recovery':4179 'learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices':1468 'learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces':3293 'learn.microsoft.com/en-us/azure/databricks/admin/workspace/serverless-workspaces-best-practices':1479 'learn.microsoft.com/en-us/azure/databricks/ai-bi/admin/audit':460 'learn.microsoft.com/en-us/azure/databricks/archive/compute/libraries-init-scripts':1489 'learn.microsoft.com/en-us/azure/databricks/archive/compute/policies-best-practices':1499 'learn.microsoft.com/en-us/azure/databricks/archive/dev-tools/dbx/dbx-migrate':3304 'learn.microsoft.com/en-us/azure/databricks/archive/legacy/dbio-commit':1512 'learn.microsoft.com/en-us/azure/databricks/archive/legacy/skew-join':1523 'learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/migrate-provisioned-throughput':3314 'learn.microsoft.com/en-us/azure/databricks/archive/runtime/light':3324 'learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/':3336 'learn.microsoft.com/en-us/azure/databricks/archive/spark-3.x-migration/deep-learning-pipelines':1532 'learn.microsoft.com/en-us/azure/databricks/business-semantics/metric-views/basic-modeling':1543 'learn.microsoft.com/en-us/azure/databricks/business-semantics/metric-views/materialization':4190 'learn.microsoft.com/en-us/azure/databricks/catalogs/default':3347 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/administration':1553 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving':1563 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-data-prep':1577 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/bi-serving-sql-serving':1588 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/compute':1598 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/jobs':1609 'learn.microsoft.com/en-us/azure/databricks/cheat-sheet/power-bi':1620 'learn.microsoft.com/en-us/azure/databricks/compute/choose-compute':3356 'learn.microsoft.com/en-us/azure/databricks/compute/cluster-config-best-practices':1629 'learn.microsoft.com/en-us/azure/databricks/compute/flexible-node-types':1640 'learn.microsoft.com/en-us/azure/databricks/compute/gpu':3368 'learn.microsoft.com/en-us/azure/databricks/compute/pool-best-practices':1649 'learn.microsoft.com/en-us/azure/databricks/compute/pool-index':3380 'learn.microsoft.com/en-us/azure/databricks/compute/serverless/best-practices':1660 'learn.microsoft.com/en-us/azure/databricks/compute/serverless/migration':3391 'learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/bi-workload-settings':1670 'learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/monitor/queries':1682 'learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-behavior':3401 'learn.microsoft.com/en-us/azure/databricks/compute/sql-warehouse/warehouse-types':3410 'learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/':469 'learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/cluster-error-codes':479 'learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/debugging-spark-ui':489 'learn.microsoft.com/en-us/azure/databricks/compute/troubleshooting/query-watchdog':1692 'learn.microsoft.com/en-us/azure/databricks/connect/streaming/kafka/faq':498 'learn.microsoft.com/en-us/azure/databricks/data-engineering/fan-in-fan-out':4205 'learn.microsoft.com/en-us/azure/databricks/data-engineering/observability-best-practices':1704 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/abac/udf-best-practices':1715 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/best-practices':1725 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/managed-versus-external':3421 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/':3434 'learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/upgrade/uc-only-migration':3446 'learn.microsoft.com/en-us/azure/databricks/database-objects/hive-metastore':1735 'learn.microsoft.com/en-us/azure/databricks/dbfs/dbfs-root':1745 'learn.microsoft.com/en-us/azure/databricks/dbfs/mounts':1757 'learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog':1768 'learn.microsoft.com/en-us/azure/databricks/delta-sharing/audit-logs':510 'learn.microsoft.com/en-us/azure/databricks/delta-sharing/manage-egress':1779 'learn.microsoft.com/en-us/azure/databricks/delta-sharing/troubleshooting':519 'learn.microsoft.com/en-us/azure/databricks/delta/best-practices':1790 'learn.microsoft.com/en-us/azure/databricks/delta/clustering':1799 'learn.microsoft.com/en-us/azure/databricks/delta/data-skipping':1813 'learn.microsoft.com/en-us/azure/databricks/delta/deletion-vectors':1827 'learn.microsoft.com/en-us/azure/databricks/delta/feature-compatibility':3457 'learn.microsoft.com/en-us/azure/databricks/delta/optimize':1837 'learn.microsoft.com/en-us/azure/databricks/delta/s3-limitations':1847 'learn.microsoft.com/en-us/azure/databricks/delta/selective-overwrite':1857 'learn.microsoft.com/en-us/azure/databricks/delta/tune-file-size':1869 'learn.microsoft.com/en-us/azure/databricks/delta/vacuum':1880 'learn.microsoft.com/en-us/azure/databricks/delta/variant-shredding':1892 'learn.microsoft.com/en-us/azure/databricks/dev-tools/':3467 'learn.microsoft.com/en-us/azure/databricks/dev-tools/bundles/mlops-stacks':1902 'learn.microsoft.com/en-us/azure/databricks/dev-tools/ci-cd/best-practices':1913 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/migrate':3477 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-budget-policy-commands':3487 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-budgets-commands':3496 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-usage-dashboards-commands':3506 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/policy-families-commands':1923 'learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/troubleshooting':529 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/best-practices':1935 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/compute-size':3517 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/view-app-details':540 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect-legacy':3527 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/migrate':3539 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/testing':1946 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/troubleshooting':549 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/queries':1957 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/migrate':3550 'learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/troubleshooting':558 'learn.microsoft.com/en-us/azure/databricks/dev-tools/sdks':3560 'learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/cdktf':3570 'learn.microsoft.com/en-us/azure/databricks/dev-tools/terraform/troubleshoot':567 'learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/faqs':578 'learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/troubleshooting':587 'learn.microsoft.com/en-us/azure/databricks/error-messages/arithmetic-overflow-error-class':596 'learn.microsoft.com/en-us/azure/databricks/error-messages/cast-invalid-input-error-class':606 'learn.microsoft.com/en-us/azure/databricks/error-messages/dc-ga4-raw-data-error-error-class':618 'learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sfdc-api-error-error-class':629 'learn.microsoft.com/en-us/azure/databricks/error-messages/dc-sqlserver-error-error-class':640 'learn.microsoft.com/en-us/azure/databricks/error-messages/delta-iceberg-compat-v1-violation-error-class':650 'learn.microsoft.com/en-us/azure/databricks/error-messages/divide-by-zero-error-class':661 'learn.microsoft.com/en-us/azure/databricks/error-messages/error-classes':670 'learn.microsoft.com/en-us/azure/databricks/error-messages/ewkb-parse-error-error-class':680 'learn.microsoft.com/en-us/azure/databricks/error-messages/ewkt-parse-error-error-class':690 'learn.microsoft.com/en-us/azure/databricks/error-messages/geojson-parse-error-error-class':699 'learn.microsoft.com/en-us/azure/databricks/error-messages/group-by-aggregate-error-class':710 'learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-cell-id-error-class':721 'learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-grid-distance-value-error-class':734 'learn.microsoft.com/en-us/azure/databricks/error-messages/h3-invalid-resolution-value-error-class':745 'learn.microsoft.com/en-us/azure/databricks/error-messages/h3-not-enabled-error-class':756 'learn.microsoft.com/en-us/azure/databricks/error-messages/insufficient-table-property-error-class':766 'learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-error-class':777 'learn.microsoft.com/en-us/azure/databricks/error-messages/invalid-array-index-in-element-at-error-class':789 'learn.microsoft.com/en-us/azure/databricks/error-messages/missing-aggregation-error-class':799 'learn.microsoft.com/en-us/azure/databricks/error-messages/row-column-access-error-class':811 'learn.microsoft.com/en-us/azure/databricks/error-messages/sqlstates':820 'learn.microsoft.com/en-us/azure/databricks/error-messages/table-or-view-not-found-error-class':832 'learn.microsoft.com/en-us/azure/databricks/error-messages/unresolved-routine-error-class':841 'learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-table-operation-error-class':851 'learn.microsoft.com/en-us/azure/databricks/error-messages/unsupported-view-operation-error-class':861 'learn.microsoft.com/en-us/azure/databricks/error-messages/wkb-parse-error-error-class':871 'learn.microsoft.com/en-us/azure/databricks/error-messages/wkt-parse-error-error-class':881 'learn.microsoft.com/en-us/azure/databricks/external-access/':4216 'learn.microsoft.com/en-us/azure/databricks/external-access/integrations':3581 'learn.microsoft.com/en-us/azure/databricks/files/files-recommendations':1967 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/idp-pipeline-tutorial':4227 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/advanced-agent-eval':1978 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/evaluation-set':1989 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/llm-judge-metrics':3592 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-evaluation/troubleshooting':890 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/debug-agent':900 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-apps':4238 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/multi-agent-genie':4251 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/non-conversational-agents':4263 'learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/stateful-agents-model-serving':4274 'learn.microsoft.com/en-us/azure/databricks/generative-ai/guide/agent-system-design-patterns':4284 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-assess-performance':1998 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-define-quality':2008 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/evaluate-enable-measurement':4295 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-evaluation-monitoring-rag':2018 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/fundamentals-inference-chain-rag':4305 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-overview':2026 'learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-rag-chain':2034 'learn.microsoft.com/en-us/azure/databricks/genie-code/instructions':2043 'learn.microsoft.com/en-us/azure/databricks/genie-code/tips':2054 'learn.microsoft.com/en-us/azure/databricks/genie/best-practices':2064 'learn.microsoft.com/en-us/azure/databricks/genie/troubleshooting':909 'learn.microsoft.com/en-us/azure/databricks/getting-started/ce-migration':3602 'learn.microsoft.com/en-us/azure/databricks/getting-started/free-trial-vs-free-edition':3613 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/':3624 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/faq':920 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/file-detection-modes':3636 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/migrating-to-file-events':2075 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/patterns':2085 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/production':2094 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/unity-catalog':2106 'learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/examples':2116 'learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/':3649 'learn.microsoft.com/en-us/azure/databricks/ingestion/file-metadata-column':2126 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/common-patterns':2137 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-troubleshoot':930 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-troubleshoot':939 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/full-refresh':2148 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-troubleshoot':948 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-analytics-troubleshoot':958 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/hubspot-troubleshoot':966 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/jira-troubleshoot':974 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/meta-ads-troubleshoot':983 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/monitor-costs':2158 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql':3660 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/mysql-troubleshoot':994 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/pipeline-maintenance':2167 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-faq':1004 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-maintenance':2178 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/postgresql-troubleshoot':1013 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/query-based-troubleshoot':1024 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-formula-fields':2188 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-troubleshoot':1032 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-troubleshoot':1042 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-troubleshoot':1052 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-faq':1063 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-troubleshoot':1073 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/tiktok-ads-troubleshoot':1082 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-hcm-troubleshoot':1091 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/workday-reports-troubleshoot':1101 'learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/zendesk-support-troubleshoot':1110 'learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-errors':1119 'learn.microsoft.com/en-us/azure/databricks/init-scripts/':2198 'learn.microsoft.com/en-us/azure/databricks/init-scripts/logs':1129 'learn.microsoft.com/en-us/azure/databricks/init-scripts/referencing-files':2209 'learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-odbc-bi':3672 'learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/testing':1140 'learn.microsoft.com/en-us/azure/databricks/integrations/odbc/migration':3683 'learn.microsoft.com/en-us/azure/databricks/integrations/odbc/testing':1150 'learn.microsoft.com/en-us/azure/databricks/jobs/':3694 'learn.microsoft.com/en-us/azure/databricks/jobs/compute':2220 'learn.microsoft.com/en-us/azure/databricks/jobs/how-to/foreach-sql-lookup-tutorial':2233 'learn.microsoft.com/en-us/azure/databricks/jobs/large-jobs':1161 'learn.microsoft.com/en-us/azure/databricks/jobs/repair-job-failures':1171 'learn.microsoft.com/en-us/azure/databricks/jobs/run-classic-jobs':2244 'learn.microsoft.com/en-us/azure/databricks/jobs/run-serverless-jobs':3706 'learn.microsoft.com/en-us/azure/databricks/jobs/spark-submit':3717 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/':4315 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/cost-optimization/best-practices':2254 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/':4326 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/data-governance/best-practices':2266 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/':3726 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/compute':3737 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/delta-lake':4338 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/ha-dr':4350 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/network':4360 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/observability':2277 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/storage':4372 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/deployment-guide/workspace-strategy':4381 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/':4392 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/interoperability-and-usability/best-practices':2288 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/':4402 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/operational-excellence/best-practices':2298 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/':4412 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/performance-efficiency/best-practices':2309 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reference':4421 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/':4430 'learn.microsoft.com/en-us/azure/databricks/lakehouse-architecture/reliability/best-practices':2319 'learn.microsoft.com/en-us/azure/databricks/lakehouse/':4440 'learn.microsoft.com/en-us/azure/databricks/languages/overview':3747 'learn.microsoft.com/en-us/azure/databricks/ldp/auto-scaling':2328 'learn.microsoft.com/en-us/azure/databricks/ldp/best-practices':2339 'learn.microsoft.com/en-us/azure/databricks/ldp/cdc-advanced':2351 'learn.microsoft.com/en-us/azure/databricks/ldp/develop':2361 'learn.microsoft.com/en-us/azure/databricks/ldp/developer/external-dependencies':2371 'learn.microsoft.com/en-us/azure/databricks/ldp/expectation-patterns':2380 'learn.microsoft.com/en-us/azure/databricks/ldp/fix-high-init':2388 'learn.microsoft.com/en-us/azure/databricks/ldp/flows-backfill':2397 'learn.microsoft.com/en-us/azure/databricks/ldp/full-refresh-st':2409 'learn.microsoft.com/en-us/azure/databricks/ldp/observability':1180 'learn.microsoft.com/en-us/azure/databricks/ldp/query-history':1191 'learn.microsoft.com/en-us/azure/databricks/ldp/recover-streaming':1200 'learn.microsoft.com/en-us/azure/databricks/ldp/stateful-processing':2418 'learn.microsoft.com/en-us/azure/databricks/ldp/what-is-change-data-capture':2428 'learn.microsoft.com/en-us/azure/databricks/libraries/restart-python-process':2439 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/dataloading':2451 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/guides':1211 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ai-runtime/tracking-observability':2463 'learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-best-practices':2474 'learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/migrate-from-online-tables':3760 'learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/online-workflows':4454 'learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/time-series':2488 'learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/troubleshooting-and-limitations':1221 'learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/uc/upgrade-feature-table-to-uc':3770 'learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/prov-throughput-run-benchmark':2499 'learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-models':3781 'learn.microsoft.com/en-us/azure/databricks/machine-learning/load-data/':2510 'learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-models':3791 'learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/migrate-to-uc':3802 'learn.microsoft.com/en-us/azure/databricks/machine-learning/manage-model-lifecycle/upgrade-workflows':3812 'learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/deployment-patterns':4463 'learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/llmops':2519 'learn.microsoft.com/en-us/azure/databricks/machine-learning/mlops/mlops-workflow':4472 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-inference/':3822 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/configure-load-test':2531 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/foundation-model-overview':3832 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/migrate-model-serving':3844 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-debug':1232 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-genie-code':1243 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-pre-deployment-validation':2541 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/production-optimization':2551 'learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/what-is-load-test':2562 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/scale-ray':2572 'learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/spark-ray-overview':3856 'learn.microsoft.com/en-us/azure/databricks/machine-learning/reference-solutions/images-etl-inference':2581 'learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/dl-best-practices':2592 'learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/huggingface/fine-tune-model':2607 'learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/huggingface/load-data':2620 'learn.microsoft.com/en-us/azure/databricks/machine-learning/train-recommender-models':4484 'learn.microsoft.com/en-us/azure/databricks/migration/':3867 'learn.microsoft.com/en-us/azure/databricks/migration/etl':3878 'learn.microsoft.com/en-us/azure/databricks/migration/parquet-to-delta-lake':3890 'learn.microsoft.com/en-us/azure/databricks/migration/spark':2630 'learn.microsoft.com/en-us/azure/databricks/migration/warehouse-to-lakehouse':3901 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-eval-migration':3913 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/agent-eval-migration-reference':3923 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/eval-monitor/align-judges':2640 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/overview/oss-managed-diff':3933 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/automatically-optimize-prompts':2649 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/evaluate-prompts':2659 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/manual-tracing/':2670 'learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/observe-with-traces/analyze-traces':2680 'learn.microsoft.com/en-us/azure/databricks/notebooks/best-practices':2690 'learn.microsoft.com/en-us/azure/databricks/notebooks/code-assistant':2700 'learn.microsoft.com/en-us/azure/databricks/notebooks/debugger':1252 'learn.microsoft.com/en-us/azure/databricks/notebooks/notebook-compute':3942 'learn.microsoft.com/en-us/azure/databricks/notebooks/run-notebook':2709 'learn.microsoft.com/en-us/azure/databricks/notebooks/test-notebooks':2718 'learn.microsoft.com/en-us/azure/databricks/oltp/instances/create/capacity':3953 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/backup-methods':3963 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/branches':4494 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/high-availability':4504 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/manage-computes':2727 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/manage-read-replicas':2736 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/pg-stat-statements':2746 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/read-replicas':4513 'learn.microsoft.com/en-us/azure/databricks/oltp/projects/sync-tables':4523 'learn.microsoft.com/en-us/azure/databricks/oltp/upgrade-to-autoscaling':3973 'learn.microsoft.com/en-us/azure/databricks/optimizations/':2756 'learn.microsoft.com/en-us/azure/databricks/optimizations/aqe':2765 'learn.microsoft.com/en-us/azure/databricks/optimizations/cbo':2776 'learn.microsoft.com/en-us/azure/databricks/optimizations/disk-cache':2786 'learn.microsoft.com/en-us/azure/databricks/optimizations/dynamic-file-pruning':2800 'learn.microsoft.com/en-us/azure/databricks/optimizations/incremental-refresh':3985 'learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-io':2809 'learn.microsoft.com/en-us/azure/databricks/optimizations/predictive-optimization':2819 'learn.microsoft.com/en-us/azure/databricks/optimizations/range-join':2828 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/':2839 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/failing-spark-jobs':1263 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/jobs-timeline':1273 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage':1284 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-io':1294 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/long-spark-stage-page':2850 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/losing-spot-instances':2859 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/one-spark-task':2870 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/slow-spark-stage-low-io':1307 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/small-spark-jobs':2880 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-dag-expensive-read':1318 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-driver-overloaded':2889 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-job-gaps':1328 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-memory-issues':1339 'learn.microsoft.com/en-us/azure/databricks/optimizations/spark-ui-guide/spark-rewriting-data':2900 'learn.microsoft.com/en-us/azure/databricks/pandas/':3994 'learn.microsoft.com/en-us/azure/databricks/partner-connect/best-practice':2911 'learn.microsoft.com/en-us/azure/databricks/partner-connect/troubleshoot':1348 'learn.microsoft.com/en-us/azure/databricks/query-federation/hms-federation-concepts':4006 'learn.microsoft.com/en-us/azure/databricks/query-federation/http-migration':4016 'learn.microsoft.com/en-us/azure/databricks/query-federation/migrate':4027 'learn.microsoft.com/en-us/azure/databricks/query-federation/networking':2922 'learn.microsoft.com/en-us/azure/databricks/query-federation/performance-recommendations':2932 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/11.x-migration':4039 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/12.x-migration':4050 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/13.x-migration':4061 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/14.x-migration':4072 'learn.microsoft.com/en-us/azure/databricks/release-notes/runtime/databricks-runtime-ver':4081 'learn.microsoft.com/en-us/azure/databricks/repos/connect-on-prem-git-server':4536 'learn.microsoft.com/en-us/azure/databricks/repos/errors-troubleshooting':1356 'learn.microsoft.com/en-us/azure/databricks/repos/serverless-private-git':4548 'learn.microsoft.com/en-us/azure/databricks/resources/pricing':4092 'learn.microsoft.com/en-us/azure/databricks/security/keys/encrypt-otw':2943 'learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/cost-management':4102 'learn.microsoft.com/en-us/azure/databricks/semi-structured/':4561 'learn.microsoft.com/en-us/azure/databricks/semi-structured/complex-types':2954 'learn.microsoft.com/en-us/azure/databricks/semi-structured/higher-order-functions':2967 'learn.microsoft.com/en-us/azure/databricks/semi-structured/variant':2979 'learn.microsoft.com/en-us/azure/databricks/semi-structured/variant-json-diff':2990 'learn.microsoft.com/en-us/azure/databricks/spark/connect-vs-classic':4112 'learn.microsoft.com/en-us/azure/databricks/sparkr/sparkr-vs-sparklyr':4122 'learn.microsoft.com/en-us/azure/databricks/sql/dbsql-api-latest':4133 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/fetch-stmt':1367 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/get-diagnostics-stmt':1379 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/control-flow/open-stmt':1391 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/object-type':3002 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/timestamp-ntz-type':3014 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/data-types/variant-type':3025 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/validate_utf8':1403 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-analyze-compute-statistics':3036 'learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-sync':4145 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/performance-insights':1412 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-caching':3046 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-filters':3055 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-history':1422 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-optimization-constraints':3066 'learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-profile':1432 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/async-checkpointing':4571 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/async-progress-checking':4581 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/delta-lake':3077 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/output-mode':4155 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/production':3087 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time/performance':3099 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/stateless-streaming':3109 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/stream-monitoring':3118 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/unity-catalog':3128 'learn.microsoft.com/en-us/azure/databricks/structured-streaming/watermarks':3137 'learn.microsoft.com/en-us/azure/databricks/tables/automatic-feature-enablement':3148 'learn.microsoft.com/en-us/azure/databricks/tables/partitions':4593 'learn.microsoft.com/en-us/azure/databricks/tables/size':3161 'learn.microsoft.com/en-us/azure/databricks/transactions/transaction-modes':4164 'learn.microsoft.com/en-us/azure/databricks/transform/data-modeling':3171 'learn.microsoft.com/en-us/azure/databricks/transform/optimize-joins':3181 'learn.microsoft.com/en-us/azure/databricks/transform/validate':3193 'learn.microsoft.com/en-us/azure/databricks/vector-search/retrieval-quality-eval':3205 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-best-practices':3214 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-cost-management':3225 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-endpoint-load-test':3237 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-retrieval-quality':3247 'learn.microsoft.com/en-us/azure/databricks/vector-search/vector-search-unused-endpoints':1443 'learn.microsoft.com/en-us/azure/databricks/volumes/download-internet-files':3257 'legaci':1135,1730,3472,3523,3544,3751,3837,4020 'leverag':2768 'librari':1484,2438 'lifecycl':4080 'light':3322 'limit':19,54,321,325,1220,1843 'limits-quotas.md':323,324 'line':95,107 'link':112,121,4547 'liquid':1797 'llm':2493,2635,3309 'llmop':2514 'load':2114,2444,2502,2526,2557,3231 'loader':916,2070,2081,2091,2099,3629 'local':65,3461 'locat':89,208,1756 'locust':2524 'locust-bas':2523 'log':458,509,1123 'long':1278,2863 'long-run':1277 'loss':2857 'low':1300 'low-i':1299 'maintain':2170 'mainten':2163 'make':15,50,267,3261 'manag':2134,2144,2364,2732,3219,3264,3341,3414,3480,3499,3688,3801 'mani':1159,2874 'manual':2663 'markdown':188,204 'mask':810 'materi':3983,4185 'mcp':147,174 'measur':1992,4288 'medallion':4333 'memori':1335,4269 'meta':978 'metadata':2121,2225 'metadata-driven':2224 'metadata.generated':128 'metastor':1732,4001 'method':3577,3960 'metric':1541,1997,2350,4188 'microsoft':176 'microsoftdoc':148,175 'migrat':283,1205,1465,1482,1526,1748,2067,3275,3298,3307,3328,3384,3439,3470,3521,3530,3542,3595,3640,3675,3709,3750,3784,3796,3835,3860,3873,3883,3893,3906,3919,4009,4019,4033,4042,4053,4064,4125 'miss':793 'mitig':2883 'ml':2507,3807,4459 'ml/llm':279 'ml/llm/rag':254 'ml/mlops':313 'ml/serving':387 'mlflow':290,1971,1985,2634,2646,2655,2664,3585,3785,3838,3911,3921,3932,4262 'mlop':1896,4467 'mode':3632,4152,4163 'model':336,435,1229,1237,1535,1568,2535,2538,2546,2600,3166,3778,3786,3800,3820,3828,3842,4272,4460,4554 'modif':1823 'monitor':397,452,503,537,1174,1678,2013,2154,2272,2348,2457,2739,3092,3112 'month':134 'mosaic':885,3199,3209,3220,3241,3830,3840 'mount':1751 'multi':4232,4246 'multi-ag':4231,4245 'mysql':989,3653 'name':667 'nest':2949 'network':166,294,308,355,383,2915,4098,4356 'new':3474,3534,3546 'node':1634,2938 'non':4256 'non-convers':4255 'notebook':1251,2689,2699,2705,2716,3941 'ntz':3007 'object':1734,2995,3622 'observ':1696,2270 'odbc':1147,3668,3679,3682 'old':135 'older':3532 'on-prem':4532 'ongo':2162 'onlin':3756,4444 'open':1382,1388,3928 'oper':260,431,847,857,2172,2292,2403,4396 'optim':1515,1556,1585,1771,1793,1830,1883,2021,2249,2322,2412,2544,2643,2648,2723,2751,2772,2814,2873,2925,3035,3058,3090,3102,3153,3167,3174,3208,3217,3308,4310 'option':280,3619,3817,3871,3990 'orchestr':4234 'order':1812,2960 'output':4151 'overflow':592 'overload':2884 'overwrit':1852 'panda':3989 'parquet':3886 'pars':675,678,685,688,695,866,870,876,880 'parti':3755,4452 'partit':4587 'partner':1345,2909 'path':284,3884 'pattern':18,25,53,60,297,304,400,403,1853,1912,2084,2115,2131,2219,2377,2425,4169,4201,4209,4281,4437,4462,4552 'perform':250,312,1410,1421,1430,1558,1573,1886,1929,1994,2161,2302,2679,2750,2781,2792,2827,2836,2926,3045,3098,3176,3213,4406 'performance/debugging':229 'pg':2743 'pipelin':1179,1184,1196,1531,1703,2136,2166,2175,2324,2338,2360,2370,2385,2396,3875,4204,4222 'plan':448,2554,3270,3274,3327,3383,3394,3424,3520,3639,3652,3686,3720,3859,3997,4030,4075,4172 'platform':1549 'plus':345,417 'point':2479 'point-in-tim':2478 'polici':1454,1498,1714,1919,3484 'pool':1648,3379 'postgr':2725 'postgresql':999,1008,2173 'power':1615 'practic':13,48,238,248,1447,1463,1473,1494,1552,1597,1608,1613,1628,1645,1656,1698,1724,1767,1786,1899,1931,1983,2047,2059,2238,2251,2259,2285,2295,2304,2315,2333,2357,2446,2469,2588,2686,2904,3082 'predict':2807,2813 'prefer':172 'prem':4534 'premium':3280 'prepar':1566,2504,2610,3437 'primari':3061 'privat':4529,4543,4546 'problem':230,557,965,1031 'process':2349,2415,2434 'product':1604,2093,2550,2667,3080,3689,3721 'profil':1428 'program':3742 'progress':4576 'project':3972 'prompt':2644,2656 'properti':762 'protocol':3452 'provid':39,565,3569 'provis':3312,3969 'prune':2796 'pull':139 'pyspark/sql':419 'pytest':1945 'python':547,1247,1942,2365,2433,3538 'qualiti':2025,2033,3204,3246,3589,4292 'queri':180,194,459,798,1020,1185,1409,1417,1427,1676,1688,1690,1951,2151,2741,2761,2791,2931,2970,3042,3052,3059,3106,3117,4022 'query-bas':1019 'question':917,1062 'queu':3400 'quick':67,3916 'quick-refer':66 'quota':20,55,322,326 'rag':1993,2006,2014,2023,2031,4291,4302 'rag/agents':314 'rang':96,2825 'raw':612,954 'ray':2568,3853 'read':102,117,1312,2734,2780,3074,4508,4511 'real':3095 'real-tim':3094 'recommend':1742,1908,2218,2752,4481 'recov':1194 'recoveri':4174,4346 'reduc':1775,2383 'refer':68,122,421,2201,3917,4419 'refresh':2141,2402,2436,3980 'region/release':447 'relat':346 'relev':90 'reliabl':261,1637,2313,4425 'remot':71 'repair':1166 'replica':2735,4512 'repositori':145 'requir':165,755 'resolut':740,839 'resolv':472,570,590,693,726,748,792,835,912,997,2862 'resourc':344,3938 'respons':2053 'rest':4131 'restart':2431 'restor':3959 'retri':1118 'retriev':3203,3245 'return':187,203 'rewrit':2895 'right':3946 'right-siz':3945 'root':1740 'rout':4012 'routin':837 'row':803,1361 'run':1279,2400,2703,3230,3700 'runtim':278,1210,2450,2462,3323,3526,4036,4046,4057,4068,4078 's3':1846 'safe':1875,2204,2367,2408,2706,4049,4060,4071 'salesforc':1028,2185 'scala':556,3547 'scale':2379,2567,3952,4507 'schedul':1606,2714 'schema':2999 'script':1128,1488,2194,2208 'sdks':3557 'search':258,1441,3202,3212,3223,3235,3244 'section':91 'secur':21,56,348,358,382,1927,2104 'security.md':114,115,349,350 'select':1851,3339,3509,3627,3825 'semi':2972,4556 'semi-structur':2971,4555 'seri':2487 'serv':337,443,1230,1238,1587,2530,2539,2547,3843,4273,4516 'server':638,1058,1068 'serverless':291,1477,1653,3291,3388,3704,4014,4085,4097,4528,4542 'servicenow':1039 'set':1988,2003,2906,3456,4539 'setup':3657 'sfdc':623 'share':505,516,1773 'sharepoint':1049 'shred':1888 'simba':3677 'singl':2603,2868 'size':1865,3157,3398,3513,3947 'skew':1516,1521,2843 'skill':36,38,79,164,186,200 'skill-azure-databricks' 'skip':1806 'sku':4091 'slow':1298 'small':2875 'snapshot':2424 'softwar':2684 'sourc':371,2921,3929 'source-microsoftdocs' 'space':454,2063 'spark':232,483,487,1178,1257,1268,1280,1290,1303,1314,1324,1334,2336,2625,2833,2848,2864,2876,2885,2898,3333,3678,3711,3851,4107,4110 'sparklyr':4119 'sparkr':4117 'specifi':106 'spill':2845 'spot':2855 'sql':225,288,637,660,709,776,1057,1067,1374,1408,1561,1582,1665,1680,2775,2966,3041,3051,3396,3407,4130 'sqlserver':634 'sqlstate':817,1364 'stack':1897 'stage':1281,1291,1304,2849,2865 'standard':3278 'start':3665 'startup':467 'stat':1808,2744 'state':2413,3135,4566 'stateless':3103 'statement':2745 'statist':3030 'storag':309,385,1509,1741,3156,3623,4364 'store':1217,4453 'strategi':2273,4380 'stream':253,316,2071,2406,2414,3073,3086,3097,3105,3116,3126,3136,3192,4150,4570,4580 'string':181,195,1397,1402,2987 'structur':2973,3085,3104,3115,3125,4149,4557,4569,4579 'submit':3712 'subscript':3269 'suggest':136,153 'support':1107,3011,3826,4079 'sync':4137,4521 'system':394,412,1674,4248,4279 'system-t':393 'system.billing.usage':2152 'tabl':395,761,824,846,1675,1795,1822,1832,1862,1874,2147,2232,2407,2818,3029,3033,3071,3147,3155,3757,3766,4141,4522,4589 'target':2146 'task':1160,2869,3713 'termin':476 'terraform':444,564,3568 'test':1132,1143,1938,2527,2558,2712,3232 'text/markdown':202 'third':3754,4451 'third-parti':3753,4450 'throughput':2498,3313 'tier':754,3281 'tiktok':1077 'time':2481,2486,3096 'timelin':1270 'timestamp':3006 'tip':2048 'token':338 'tool':149,236,413,3463 'topic':450,1448,3262,4170 'topic-agent' 'topic-agent-skills' 'topic-agentic-skills' 'topic-agentskill' 'topic-ai-agents' 'topic-ai-coding' 'topic-azure' 'topic-azure-functions' 'topic-azure-kubernetes-service' 'topic-azure-openai' 'topic-azure-sql-database' 'topic-azure-storage' 'trace':2665,2675 'track':2454,4577 'traffic':2939 'train':4477 'transact':1505,4162 'transfer':4100 'transform':2946 'trial':3612 'troubleshoot':11,46,210,449,463,492,513,522,539,543,552,561,581,769,780,864,874,884,893,903,933,942,951,961,969,977,1007,1016,1027,1066,1076,1085,1104,1125,1155,1164,1176,1207,1214,1255,1342,1351,2471 'tune':1190,1431,1663,1802,2565,2597,2617,2822,4300 'type':340,1635,2951,2996,3008,3019,3355,3409 'udf':1709 'ui':488,2838 'understand':621,643,844,854,1406,4084 'uniti':31,285,342,363,1539,1711,1719,1753,1763,2101,2816,3122,3145,3344,3419,3432,3441,3574,3768,3789,3798,3810,4004,4143,4370 'unnecessari':2893 'unresolv':836 'unsupport':845,855 'unus':1439 'upgrad':3427,3763,3805,4139 'url':451,1449,3263,4171 'usabl':2283,4387 'usag':495,1765,3502 'use':28,30,77,83,101,116,173,190,439,485,532,1122,1183,1266,1370,1415,1450,1502,1520,1632,1673,1816,2119,2191,2342,2645,2662,2742,2759,2812,2957,2975,3005,3017,3039,3049,3060,3069,3140,3290,3320,3364,3376,3494,3555,3850,3999,4136,4184,4487,4564 'user':138,155,1203 'utf':1395 'utf8':1401 'v1':647 'vacuum':1872 'valid':1134,1145,1394,2534,3186 'valu':731,741 'variant':1884,2976,2984,2998,3018 'vector':257,1440,1818,3201,3211,3222,3234,3243 'version':142,2657,3453,3787 'via':1921,3485,3504,4519 'view':826,856,1542,1916,3984,4189 'violat':648 'volum':1963,3256 'vs':575,583,3415,3852 'warehous':1562,1583,1666,1681,3397,3408,3896 'watchdog':1691 'watermark':2417,3132 'webpag':192 'wkb':865 'wkt':875 'work':1728,2993 'workaround':347 'workday':1086,1098 'workflow':1910,2515,3655,3808,4446,4468,4493 'workload':265,1669,2626,3127,3180,3331,3635,3690,4043,4054,4065 'workspac':381,1478,1965,3292,3430,3445,3732,3764,4378 'write':1506,1707,2899,3076 'x':3335,4038,4048,4059,4070 'z':1811 'z-order':1810 'zendesk':1106 'zero':656 'zerobus':1114","prices":[{"id":"f690a74b-2320-453a-b339-4bdaa5bec17a","listingId":"3f902542-0fb0-4f05-bee3-01b9c2e5e76a","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"MicrosoftDocs","category":"Agent-Skills","install_from":"skills.sh"},"createdAt":"2026-04-18T21:58:48.371Z"}],"sources":[{"listingId":"3f902542-0fb0-4f05-bee3-01b9c2e5e76a","source":"github","sourceId":"MicrosoftDocs/Agent-Skills/azure-databricks","sourceUrl":"https://github.com/MicrosoftDocs/Agent-Skills/tree/main/skills/azure-databricks","isPrimary":false,"firstSeenAt":"2026-04-18T21:58:48.371Z","lastSeenAt":"2026-04-22T06:53:31.178Z"}],"details":{"listingId":"3f902542-0fb0-4f05-bee3-01b9c2e5e76a","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"MicrosoftDocs","slug":"azure-databricks","github":{"repo":"MicrosoftDocs/Agent-Skills","stars":497,"topics":["agent","agent-skills","agentic-skills","agentskill","ai","ai-agents","ai-coding","azure","azure-functions","azure-kubernetes-service","azure-openai","azure-sql-database","azure-storage","azure-virtual-machine","claude-code","github-copilot","microsoft-learn","openai-codex","skills"],"license":"cc-by-4.0","html_url":"https://github.com/MicrosoftDocs/Agent-Skills","pushed_at":"2026-04-22T01:37:27Z","description":"Curated Agent Skills for Microsoft & Azure – giving AI coding assistants structured, real-time expertise from Microsoft Learn docs.","skill_md_sha":"b1d611427de0670b6d65c9a235759129ea017d3f","skill_md_path":"skills/azure-databricks/SKILL.md","default_branch":"main","skill_tree_url":"https://github.com/MicrosoftDocs/Agent-Skills/tree/main/skills/azure-databricks"},"layout":"multi","source":"github","category":"Agent-Skills","frontmatter":{"name":"azure-databricks","description":"Expert knowledge for Azure Databricks development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Unity Catalog, Lakehouse/Lakebase, Lakeflow pipelines, Vector Search/RAG, or model serving, and other Azure Databricks related development tasks. Not for Azure Synapse Analytics (use azure-synapse-analytics), Azure HDInsight (use azure-hdinsight), Azure Machine Learning (use azure-machine-learning), Azure Data Factory (use azure-data-factory).","compatibility":"Requires network access. Uses mcp_microsoftdocs:microsoft_docs_fetch or fetch_webpage to retrieve documentation."},"skills_sh_url":"https://skills.sh/MicrosoftDocs/Agent-Skills/azure-databricks"},"updatedAt":"2026-04-22T06:53:31.178Z"}}