"A data contract is a definition of how two parties (the producer and the consumer) must exchange data. It defines the structure, format, service level agreement, sensitivity, and any other information that could be important for the producer or the consumer of the data." (Aniruddha Deswandikar, "Engineering Data Mesh in Azure Cloud", 2024)
"A data mesh is an architectural pattern implemented on top of a standardized enterprise cloud infrastructure." (Aniruddha Deswandikar,"Engineering Data Mesh in Azure Cloud", 2024)
"A data mesh splits the boundaries of the exchange of data into multiple data products. This provides a unique opportunity to partially distribute the responsibility of data security. Each data product team can be made responsible for how their data should be accessed and what privacy policies should be applied." (Aniruddha Deswandikar,"Engineering Data Mesh in Azure Cloud", 2024)
"A data quality solution cannot be taken up as one large project. It needs to be built brick by brick. Implement the easy checks first and then tackle the complex quality requirements." (Aniruddha Deswandikar, "Engineering Data Mesh in Azure Cloud", 2024)
"Accuracy questions whether the value of the data is as it should be. [...] Completeness indicates whether all the necessary data has been included. [...] Consistency means that the data is consistent across systems. [...] Timeliness is about how recent the data is. All data has an original source. [...] Validity refers to whether the data is valid. Data must adhere to some business rules. [...] Uniqueness means that the data should only appear once in a dataset. [...] Reliability ensures that data is being collected from the source of truth or from another verified data source." (Aniruddha Deswandikar, "Engineering Data Mesh in Azure Cloud", 2024)
"Authentication means validating a user by using credentials to ensure that they are a valid user on the enterprise system. Authorization validates their rights to access a particular resource or perform certain operations on it. [...] Authorization is the process of granting or denying a set of actions that can be performed on a resource based on a set of permissions." (Aniruddha Deswandikar, "Engineering Data Mesh in Azure Cloud", 2024)
"Data security is about preventing unauthorized access to data and the policies and methods surrounding this access. It also protects the system from hackers and malicious users who could steal data. Data privacy, on the other hand, is about collecting, retaining, and recycling personal and sensitive data. There could be a few overlaps between security and privacy." (Aniruddha Deswandikar, "Engineering Data Mesh in Azure Cloud", 2024)
"Federation is about providing autonomy to each data product owner to make their own decisions about the storage, computing, and sharing of data. However, this autonomy cannot come at a risk to the security and compliance standards of the company." (Aniruddha Deswandikar, "Engineering Data Mesh in Azure Cloud", 2024)
"To explain a data mesh in one sentence, a data mesh is a centrally managed network of decentralized data products. The data mesh breaks the central data lake into decentralized islands of data that are owned by the teams that generate the data. The data mesh architecture proposes that data be treated like a product, with each team producing its own data/output using its own choice of tools arranged in an architecture that works for them. This team completely owns the data/output they produce and exposes it for others to consume in a way they deem fit for their data." (Aniruddha Deswandikar, "Engineering Data Mesh in Azure Cloud", 2024)
No comments:
Post a Comment