Sign up for Data Mesh Understanding's free roundtable and introduction programs here: https://landing.datameshunderstanding.com/
Please Rate and Review us on your podcast app of choice!
If you want to be a guest or give feedback (suggestions for topics, comments, etc.), please see here
Episode list and links to all available episode transcripts here.
Provided as a free resource by Data Mesh Understanding / Scott Hirleman. Get in touch with Scott on LinkedIn if you want to chat data mesh.
Matt's contact info:
LinkedIn: https://www.linkedin.com/in/matthewdarwindba/
Twitter: @EvoDBA / https://twitter.com/EvoDBA
Matt's post on platform reuse: https://medium.com/slalom-data-analytics/data-mesh-is-the-argument-a-strawman-3cffaf55ce5e
Matt's LinkedIn poll on testing data pipelines: https://www.linkedin.com/feed/update/urn%3Ali%3Aactivity%3A6877216459458719744/
In this episode, Matthew Darwin, Principal Data Engineer at Slalom Consulting, and Scott cover a wide range of topics including:
Re an article Matt had posted on data platform re-use and shifting data ownership left:
- You can re-use the technologies you already know and love when building a data platform - there is literally no good reason to toss those out the window
- If your existing setup enables domains to easily transform, serve, and store their data, sure use your existing configuration; if not, there will need to be changes
- Your data platform will need to evolve and it is okay to start with a bit of an underwhelming data platform
Other nuggets and interesting topics:
- Insights from direct client engagements doing data mesh
- What makes for a good data mesh PoC
- The usefulness of data product blueprints
- How data mesh is still bleeding edge and is therefore not for everyone
- Slowing down to move faster / the long-term negatives of always looking for quick wins
- Why you can't just expose your operational data model as a data product
- The importance of data product interoperability - even at the PoC phase
- How crucial the organizational aspects of data mesh really are
- Much more
Data Mesh Radio is hosted by Scott Hirleman. If you want to connect with Scott, reach out to him on LinkedIn: https://www.linkedin.com/in/scotthirleman/
If you want to learn more and/or join the Data Mesh Learning Community, see here: https://datameshlearning.com/community/
If you want to be a guest or give feedback (suggestions for topics, comments, etc.), please see here
All music used this episode was found on PixaBay and was created by (including slight edits by Scott Hirleman): Lesfm, MondayHopes, SergeQuadrado, ItsWatR, Lexin_Music, and/or nevesf