Disclaimer: This is work in progress intended to consolidate information from various sources and may deviate from them. Please consult the sources for the exact content!
Last updated: 23-May-2024
Last updated: 23-May-2024
Data Mesh [Notes]
- {definition} a type of decentralized data architecture that organizes data based on different business domains [2]
- ⇐ a centrally managed network of decentralized data products
- {concept} landing zone
- typically a subscription that needs to be governed by a common policy [7]
- {downside} creating one landing zone for every project can lead to too many landing zones to manage
- {alternative} landing zones based on a business domain [7]
- resources must be managed efficiently in a way that each team is given access to only their resources [7]
- ⇐ shared resources might be need with separate management and common access to all [7]
- need to be linked together into a mesh
- via peer-to-peer networks
- {concept} connectivity hub
- {feature} resource group
- {definition} a container that holds related resources for an Azure solution
- can be associated with a data product
- when the data product becomes obsolete, the resource group can be deleted [7]
- {feature} subscription
- {definition} a logical unit of Azure services that are linked to an Azure account
- can be associated as a landing zone governed by a policy [7]
- {feature} tenant (aka Microsoft Fabric tenant, MF tenant)
- a single instance of Fabric for an organization that is aligned with a Microsoft Entra ID
- can contain any number of workspaces
- {feature} workspaces
- {definition} a collection of items that brings together different functionality in a single environment designed for collaboration
- associated with a domain [3]
- {feature} domains
- {definition} a way of logically grouping together data in an organization that is relevant to a particular area or field [1]
- some tenant-level settings for managing and governing data can be delegated to the domain level [2]
- {feature} subdomains
- a way for fine tuning the logical grouping data under a domain [1]
- subdivisions of a domain
- {concept} deployment template
References
[2] Establishing Data Mesh architectural pattern with Domains and OneLake on Microsoft Fabric, by Maheswaran Arunachalam (link)
[3] Data mesh: A perspective on using Azure Synapse Analytics to build data products, by Amanjeet Singh (link)
[4] Zhamak Dehghani (2021) Data Mesh: Delivering Data-Driven Value at Scale
[5] Marthe Mengen (2024) How do you set up your Data Mesh in Microsoft Fabric? (link)
[6] Administering Microsoft Fabric - Considering Data Products vs Domains vs Workspaces, by Paul Andrew (link)
[7] Aniruddha Deswandikar (2024) Engineering Data Mesh in Azure Cloud
No comments:
Post a Comment