Data Mesh Newsletter #015
Topics In Orbit Issue
The quick bit:
0) Slack members having been posting some good thoughts on #architecture-questions and #general-discussion. Join in!
Data Mesh Content Unzipped
Data Mesh 101: Why Federated Data Governance Is the Secret Sauce of Data Innovation
Author: Seb B., Co-founder and CEO at Mesh-AI
The topic of federated data governance is a frequent one on DM Slack and elsewhere as it relates to Data Mesh. To some, it may seem like an oxymoron but stay tuned, it is a matter of degree. Sticking to the metaphor here, the amount of secret sauce has to be just right.
Building a Data Mesh Architecture using the Lake House Approach
Presenters: Roy Hasson, Principal Product Manager AWS; Nivas Shankar, Principal Data Architect AWS
If you are an AWS customer, then this webinar from AWS may give you and some ideas to consider when constructing your Data Mesh from the AWS service catalog. Andrew notes that the ‘cons’ listed are less of an inherent limitation of Data Mesh than a fit for use issue.
Building an Analytics Ecosystem of Global Data Products at Adevinta
Presenters: Sandra Real, Product Manager for Analytic Solutions; Xavier Gumara Rigol, Senior Engineering Manager
An excellent example of a company that outgrew their monolithic architecture in search of something better. Adevinta’s methodic approach to their journey was almost uncanny. Kudos to the team. SQL Output ports used here. Some great bits of insight described here along the way. Andrew likes “Traits of datasets customers love/hate to work with”.
Data disruption, data gravity and data disaggregation
Author: Jeremy Posner, Raw Labs
While this article isn’t necessarily focused on Data Mesh, it does present a force in the data management universe in perhaps a unique way. Something worth considering when architecting your Data Mesh.
Strategies for Proactive Data Quality Management - Episode 205
Host: Tobias Macey, Data Engineering Podcast; Guest Gleb Mezhanskly, Datafold
Andrew and Scott agree that the first thirty minutes of this podcast ring true regarding observations of evolved practices in the software engineering space as applied to data engineering. Follows the ethos of the Data Mesh inspiration through evolution of compute.
Driving Buy-in and More Social/Organizational Challenges w/ Data Mesh at Flexport
Host: Scott Hirleman; Guest: Abhi Sivasailam, Flexport Insights
From Scott…
Packed with great ideas and content but might be at the scale-up startup needs where they can not need to fully decentralize the data architectural decisions. This is a good first iteration towards a full Data Mesh implementation and does a great job of internal alignment around data ownership, a large part driven by adding additional resource AND knowledge to the domain to make this a low friction win for all parties.Kind of a jumble in there but basically: not really Data Mesh if everyone has to use dbt and Snowflake but probably the right balance between fully decentralized and not for stage of company.
Upcoming Meetups / Zhamak Stuff
DML Meetups (10pm IST / 6:30pm CEST / 12:30pm EDT / 9:30am PDT):
None scheduled at present
Other Data Mesh Meetups/Webinars/Training
Data Platform in a mesh architecture webinar; Zhamak and Emily Gorcenski (Thoughtworks); Oct 14 at 5:30pm CEST / 9:0pm IST / 11:30am EDT / 8:30am PDT
/Newsletter
If you have questions/comments/concerns/suggestions for future newsletters, please let us know at community@datameshlearning.com.
Special thanks to Datacequia LLC for contributing time and effort to focus on this community and hopefully helping you learn more and give back.