🏭🗒️Microsoft Fabric: Data Mesh [Notes]

Disclaimer: This is work in progress intended to consolidate information from various sources for learning purposes. For the latest information please consult the documentation (see the links below)! 

Last updated: 23-May-2024

[Microsoft Fabric] Data Mesh

• {definition} a type of decentralized data architecture that organizes data based on different business domains [2]
•  ⇐ a centrally managed network of decentralized data products
• {concept} landing zone
• typically a subscription that needs to be governed by a common policy [7]
• {downside} creating one landing zone for every project can lead to too many landing zones to manage
• {alternative} landing zones based on a business domain [7] 
•  resources must be managed efficiently in a way that each team is given access to only their resources [7]
• ⇐  shared resources might be need with separate management and common access to all [7]
• need to be linked together into a mesh
• via peer-to-peer networks
• {concept} connectivity hub
• {feature} resource group
• {definition} a container that holds related resources for an Azure solution 
• can be associated with a data product
• when the data product becomes obsolete, the resource group can be deleted [7]
• {feature} subscription
• {definition} a logical unit of Azure services that are linked to an Azure account
• can be associated as a landing zone governed by a policy [7]
• {feature} tenant (aka Microsoft Fabric tenant, MF tenant)
• a single instance of Fabric for an organization that is aligned with a Microsoft Entra ID
• can contain any number of workspaces
• {feature} workspaces
• {definition} a collection of items that brings together different functionality in a single environment designed for collaboration
• associated with a domain [3]
• {feature} domains
• {definition} a way of logically grouping together data in an organization that is relevant to a particular area or field [1]
• some tenant-level settings for managing and governing data can be delegated to the domain level [2]
• {feature} subdomains
  • a way for fine tuning the logical grouping data under a domain [1]
  • subdivisions of a domain
• {concept} deployment template
• 
  

Previous Post <<||>>  Next Post

References

[1] Microsoft Learn: Fabric (2023) Fabric domains (link)

[2] Establishing Data Mesh architectural pattern with Domains and OneLake on Microsoft Fabric, by Maheswaran Arunachalam (link) 

[3] Data mesh: A perspective on using Azure Synapse Analytics to build data products, by Amanjeet Singh (link)

[4] Zhamak Dehghani (2021) Data Mesh: Delivering Data-Driven Value at Scale

[5] Marthe Mengen (2024) How do you set up your Data Mesh in Microsoft Fabric? (link)

[6] Administering Microsoft Fabric - Considering Data Products vs Domains vs Workspaces, by Paul Andrew (link)

[7] Aniruddha Deswandikar (2024) Engineering Data Mesh in Azure Cloud