{"id":"8f03f821-bde2-4237-b31f-7fa3e28c41f6","shortId":"K3sam5","kind":"skill","title":"Fabric Lakehouse","tagline":"Awesome Copilot skill by Github","description":"# When to Use This Skill\n\nUse this skill when you need to:\n- Generate a document or explanation that includes definition and context about Fabric Lakehouse and its capabilities.\n- Design, build, and optimize Lakehouse solutions using best practices.\n- Understand the core concepts and components of a Lakehouse in Microsoft Fabric.\n- Learn how to manage tabular and non-tabular data within a Lakehouse.\n\n# Fabric Lakehouse\n\n## Core Concepts\n\n### What is a Lakehouse?\n\nLakehouse in Microsoft Fabric is an item that gives users a place to store their tabular data (like tables) and non-tabular data (like files). It combines the flexibility of a data lake with the management capabilities of a data warehouse. It provides:\n\n- **Unified storage** in OneLake for structured and unstructured data\n- **Delta Lake format** for ACID transactions, versioning, and time travel\n- **SQL analytics endpoint** for T-SQL queries\n- **Semantic model** for Power BI integration\n- Support for other table formats like CSV, Parquet\n- Support for any file formats\n- Tools for table optimization and data management\n\n### Key Components\n\n- **Delta Tables**: Managed tables with ACID compliance and schema enforcement\n- **Files**: Unstructured/semi-structured data in the Files section\n- **SQL Endpoint**: Auto-generated read-only SQL interface for querying\n- **Shortcuts**: Virtual links to external/internal data without copying\n- **Fabric Materialized Views**: Pre-computed tables for fast query performance\n\n### Tabular data in a Lakehouse\n\nTabular data in a form of tables are stored under \"Tables\" folder. Main format for tables in Lakehouse is Delta. Lakehouse can store tabular data in other formats like CSV or Parquet, these formats are only available for Spark querying.\nTables can be internal, when data is stored under \"Tables\" folder, or external, when only reference to a table is stored under \"Tables\" folder but the data itself is stored in a referenced location. Tables are referenced through Shortcuts, which can be internal (pointing to another location in Fabric) or external (pointing to data stored outside of Fabric).\n\n### Schemas for tables in a Lakehouse\n\nWhen creating a lakehouse, users can choose to enable schemas. Schemas are used to organize Lakehouse tables. Schemas are implemented as folders under the \"Tables\" folder and store tables inside of those folders. The default schema is \"dbo\" and it can't be deleted or renamed. All other schemas are optional and can be created, renamed, or deleted. Users can reference a schema located in another lakehouse using a Schema Shortcut, thereby referencing all tables in the destination schema with a single shortcut.\n\n### Files in a Lakehouse\n\nFiles are stored under \"Files\" folder. Users can create folders and subfolders to organize their files. Any file format can be stored in Lakehouse.\n\n### Fabric Materialized Views\n\nSet of pre-computed tables that are automatically updated based on a schedule. They provide fast query performance for complex aggregations and joins. Materialized views are defined using PySpark or Spark SQL and stored in an associated Notebook.\n\n### Spark Views\n\nLogical tables defined by a SQL query. They do not store data but provide a virtual layer for querying. Views are defined using Spark SQL and stored in Lakehouse next to Tables.\n\n## Security\n\n### Item access or control plane security\n\nUsers can have workspace roles (Admin, Member, Contributor, Viewer) that provide different levels of access to Lakehouse and its contents. Users can also get access permission using sharing capabilities of Lakehouse.\n\n### Data access or OneLake Security\n\nFor data access use OneLake security model, which is based on Microsoft Entra ID (formerly Azure Active Directory) and role-based access control (RBAC). Lakehouse data is stored in OneLake, so access to data is controlled through OneLake permissions. In addition to object-level permissions, Lakehouse also supports column-level and row-level security for tables, allowing fine-grained control over who can see specific columns or rows in a table.\n\n\n## Lakehouse Shortcuts\n\nShortcuts create virtual links to data without copying:\n\n### Types of Shortcuts\n\n- **Internal**: Link to other Fabric Lakehouses/tables, cross-workspace data sharing \n- **ADLS Gen2**: Link to ADLS Gen2 containers in Azure\n- **Amazon S3**: AWS S3 buckets, cross-cloud data access\n- **Dataverse**: Microsoft Dataverse, business application data\n- **Google Cloud Storage**: GCS buckets, cross-cloud data access\n\n## Performance Optimization\n\n### V-Order Optimization\n\nFor faster data read with semantic model enable V-Order optimization on Delta tables. This presorts data in a way that improves query performance for common access patterns.\n\n### Table Optimization\n\nTables can also be optimized using the OPTIMIZE command, which compacts small files into larger ones and can also apply Z-ordering to improve query performance on specific columns. Regular optimization helps maintain performance as data is ingested and updated over time. The Vacuum command can be used to clean up old files and free up storage space, especially after updates and deletes.\n\n## Lineage\n\nThe Lakehouse item supports lineage, which allows users to track the origin and transformations of data. Lineage information is automatically captured for tables and files in Lakehouse, showing how data flows from source to destination. This helps with debugging, auditing, and understanding data dependencies.\n\n## PySpark Code Examples\n\nSee [PySpark code](references/pyspark.md) for details.\n\n## Getting data into Lakehouse\n\nSee [Get data](references/getdata.md) for details.","tags":["fabric","lakehouse","awesome","copilot","github"],"capabilities":["skill","source-github","category-awesome-copilot"],"categories":["awesome-copilot"],"synonyms":[],"warnings":[],"endpointUrl":"https://skills.sh/github/awesome-copilot/fabric-lakehouse","protocol":"skill","transport":"skills-sh","auth":{"type":"none","details":{"install_from":"skills.sh"}},"qualityScore":"0.300","qualityRationale":"deterministic score 0.30 from registry signals: · indexed on skills.sh · published under github/awesome-copilot","verified":false,"liveness":"unknown","lastLivenessCheck":null,"agentReviews":{"count":0,"score_avg":null,"cost_usd_avg":null,"success_rate":null,"latency_p50_ms":null,"narrative_summary":null,"summary_updated_at":null},"enrichmentModel":"deterministic:skill:v1","enrichmentVersion":1,"enrichedAt":"2026-04-22T11:40:19.903Z","embedding":null,"createdAt":"2026-04-18T20:26:04.819Z","updatedAt":"2026-04-22T11:40:19.903Z","lastSeenAt":"2026-04-22T11:40:19.903Z","tsv":"'access':523,542,552,560,566,586,596,682,698,732 'acid':135,182 'activ':580 'addit':605 'adl':664,668 'admin':533 'aggreg':469 'allow':624,807 'also':550,612,738,754 'amazon':673 'analyt':142 'anoth':315,399 'appli':755 'applic':687 'associ':485 'audit':840 'auto':197 'auto-gener':196 'automat':456,820 'avail':266 'aw':675 'awesom':3 'azur':579,672 'base':458,573,585 'best':43 'bi':153 'bucket':677,693 'build':37 'busi':686 'capabl':35,115,556 'captur':821 'category-awesome-copilot' 'choos':340 'clean':786 'cloud':680,690,696 'code':846,850 'column':615,634,765 'column-level':614 'combin':105 'command':744,781 'common':731 'compact':746 'complex':468 'complianc':183 'compon':50,176 'comput':219,452 'concept':48,73 'contain':670 'content':547 'context':29 'contributor':535 'control':525,587,600,628 'copi':213,649 'copilot':4 'core':47,72 'creat':335,388,429,643 'cross':660,679,695 'cross-cloud':678,694 'cross-workspac':659 'csv':161,259 'data':66,94,101,110,118,130,173,189,211,226,231,254,275,296,323,500,559,565,590,598,647,662,681,688,697,707,722,772,816,830,843,855,860 'datavers':683,685 'dbo':371 'debug':839 'default':368 'defin':475,491,510 'definit':27 'delet':377,391,799 'delta':131,177,249,718 'depend':844 'design':36 'destin':411,835 'detail':853,863 'differ':539 'directori':581 'document':22 'enabl':342,712 'endpoint':143,195 'enforc':186 'entra':576 'especi':795 'exampl':847 'explan':24 'extern':282,320 'external/internal':210 'fabric':1,31,56,70,81,214,318,327,445,657 'fast':222,464 'faster':706 'file':103,166,187,192,417,421,425,436,438,748,789,825 'fine':626 'fine-grain':625 'flexibl':107 'flow':831 'folder':241,280,293,355,359,366,426,430 'form':234 'format':133,159,167,243,257,263,439 'former':578 'free':791 'gcs':692 'gen2':665,669 'generat':20,198 'get':551,854,859 'github':7 'give':86 'googl':689 'grain':627 'help':768,837 'id':577 'implement':353 'improv':727,760 'includ':26 'inform':818 'ingest':774 'insid':363 'integr':154 'interfac':203 'intern':273,312,653 'item':84,522,803 'join':471 'key':175 'lake':111,132 'lakehous':2,32,40,53,69,71,77,78,229,247,250,333,337,349,400,420,444,517,544,558,589,611,640,802,827,857 'lakehouses/tables':658 'larger':750 'layer':505 'learn':57 'level':540,609,616,620 'like':95,102,160,258 'lineag':800,805,817 'link':208,645,654,666 'locat':303,316,397 'logic':489 'main':242 'maintain':769 'manag':60,114,174,179 'materi':215,446,472 'member':534 'microsoft':55,80,575,684 'model':150,570,711 'need':18 'next':518 'non':64,99 'non-tabular':63,98 'notebook':486 'object':608 'object-level':607 'old':788 'one':751 'onelak':125,562,568,594,602 'optim':39,171,700,704,716,735,740,743,767 'option':384 'order':703,715,758 'organ':348,434 'origin':812 'outsid':325 'parquet':162,261 'pattern':733 'perform':224,466,699,729,762,770 'permiss':553,603,610 'place':89 'plane':526 'point':313,321 'power':152 'practic':44 'pre':218,451 'pre-comput':217,450 'presort':721 'provid':121,463,502,538 'pyspark':477,845,849 'queri':148,205,223,269,465,495,507,728,761 'rbac':588 'read':200,708 'read-on':199 'refer':285,394 'referenc':302,306,406 'references/getdata.md':861 'references/pyspark.md':851 'regular':766 'renam':379,389 'role':532,584 'role-bas':583 'row':619,636 'row-level':618 's3':674,676 'schedul':461 'schema':185,328,343,344,351,369,382,396,403,412 'section':193 'secur':521,527,563,569,621 'see':632,848,858 'semant':149,710 'set':448 'share':555,663 'shortcut':206,308,404,416,641,642,652 'show':828 'singl':415 'skill':5,12,15 'small':747 'solut':41 'sourc':833 'source-github' 'space':794 'spark':268,479,487,512 'specif':633,764 'sql':141,147,194,202,480,494,513 'storag':123,691,793 'store':91,238,252,277,290,299,324,361,423,442,482,499,515,592 'structur':127 'subfold':432 'support':155,163,613,804 't-sql':145 'tabl':96,158,170,178,180,220,236,240,245,270,279,288,292,304,330,350,358,362,408,453,490,520,623,639,719,734,736,823 'tabular':61,65,93,100,225,230,253 'therebi':405 'time':139,778 'tool':168 'track':810 'transact':136 'transform':814 'travel':140 'type':650 'understand':45,842 'unifi':122 'unstructur':129 'unstructured/semi-structured':188 'updat':457,776,797 'use':10,13,42,346,401,476,511,554,567,741,784 'user':87,338,392,427,528,548,808 'v':702,714 'v-order':701,713 'vacuum':780 'version':137 'view':216,447,473,488,508 'viewer':536 'virtual':207,504,644 'warehous':119 'way':725 'within':67 'without':212,648 'workspac':531,661 'z':757 'z-order':756","prices":[{"id":"237bbb1f-0886-4f84-9515-24f6b9243d84","listingId":"8f03f821-bde2-4237-b31f-7fa3e28c41f6","amountUsd":"0","unit":"free","nativeCurrency":null,"nativeAmount":null,"chain":null,"payTo":null,"paymentMethod":"skill-free","isPrimary":true,"details":{"org":"github","category":"awesome-copilot","install_from":"skills.sh"},"createdAt":"2026-04-18T20:26:04.819Z"}],"sources":[{"listingId":"8f03f821-bde2-4237-b31f-7fa3e28c41f6","source":"github","sourceId":"github/awesome-copilot/fabric-lakehouse","sourceUrl":"https://github.com/github/awesome-copilot/tree/main/skills/fabric-lakehouse","isPrimary":false,"firstSeenAt":"2026-04-18T21:49:19.087Z","lastSeenAt":"2026-04-22T06:52:20.762Z"},{"listingId":"8f03f821-bde2-4237-b31f-7fa3e28c41f6","source":"skills_sh","sourceId":"github/awesome-copilot/fabric-lakehouse","sourceUrl":"https://skills.sh/github/awesome-copilot/fabric-lakehouse","isPrimary":true,"firstSeenAt":"2026-04-18T20:26:04.819Z","lastSeenAt":"2026-04-22T11:40:19.903Z"}],"details":{"listingId":"8f03f821-bde2-4237-b31f-7fa3e28c41f6","quickStartSnippet":null,"exampleRequest":null,"exampleResponse":null,"schema":null,"openapiUrl":null,"agentsTxtUrl":null,"citations":[],"useCases":[],"bestFor":[],"notFor":[],"kindDetails":{"org":"github","slug":"fabric-lakehouse","source":"skills_sh","category":"awesome-copilot","skills_sh_url":"https://skills.sh/github/awesome-copilot/fabric-lakehouse"},"updatedAt":"2026-04-22T11:40:19.903Z"}}