Data Mesh Information Architecture: modeling data products and domains

[This is a post-conference workshop back to back to our Data Warehousing & BI Summit where Juha Korpela will deliver a keynote as well. You can register for this workshop separately via this page or, with a discount, in combination with the conference via the conference registration form.]

Data Mesh is a federated approach to data management and governance developed by Zhamak Dehghani. It’s structure is based on domains and data products, elements that have also seen wide attention from organizations that are not otherwise working towards a full Mesh implementation. Working with autonomous domains who share data to the rest of the organization via data products is an excellent way to bring data work closer to the business and to allow domain-specific prioritization instead of a massive centralized bottleneck team. However, with domains having their own understanding of business and its core concepts, semantic interoperability becomes a challenge. This workshop focuses on the problems of Information Architecture in a de-centralized landscape. How can we document what data we have available, how do we understand what other teams’ data means, and how do we maintain a big picture of what is where? We will explore conceptual modeling as a key method of documenting the business context and semantics of domains and data products, more detailed logical modeling as a means to document data product structures, and consider both within-domain and cross-domain linking of various models and objects in them. As a hands-on exercise, we will model a domain and design some example data products that maintain strong links with their domain-level semantics. The workshop will give you the basic skills to do data modeling at these higher levels of abstraction, and understanding of the key characteristics and challenges of the Data Mesh that affect the way we need to do data modeling.

Learning objectives

• Understand the basics of the Data Mesh paradigm and its challenges relating to information architecture and semantics
• Learn the basics of conceptual modeling as a method of defining the business context of domains and data products
• Learn the basics of logical modeling as a part of data product design process
• Learn how solution-level metadata (e.g. data contracts) can expose domain-level context across domain boundaries
• Understand the basic operating model of information architecture management in the context of independent domain teams within a Data Mesh setup.

Who is it for

• Data Architects
• Chief Data Officers and Heads of Data interested in federated operating models
• Data Product Owners and Team Leads working in a federated model
• Data Governance experts.