Artwork for podcast Data Mesh Radio
#8 Platform Re-use, PoC Advice, and More Data Mesh Nuggets – Interview with Matthew Darwin
Episode 825th December 2021 • Data Mesh Radio • Data as a Product Podcast Network
00:00:00 01:06:13

Share Episode

Shownotes

Data Mesh Radio Patreon - get access to interviews well before they are released

Episode list and links to all available episode transcripts (most interviews from #32 on) here

Provided as a free resource by DataStax AstraDB; George Trujillo's contact info: email (george.trujillo@datastax.com) and LinkedIn

In this episode, Matthew Darwin, Principal Data Engineer at Slalom Consulting, and Scott cover a wide range of topics including:

Re an article Matt had posted on data platform re-use and shifting data ownership left:

  • You can re-use the technologies you already know and love when building a data platform - there is literally no good reason to toss those out the window
  • If your existing setup enables domains to easily transform, serve, and store their data, sure use your existing configuration; if not, there will need to be changes
  • Your data platform will need to evolve and it is okay to start with a bit of an underwhelming data platform

Other nuggets and interesting topics:

  • Insights from direct client engagements doing data mesh
  • What makes for a good data mesh PoC
  • The usefulness of data product blueprints
  • How data mesh is still bleeding edge and is therefore not for everyone
  • Slowing down to move faster / the long-term negatives of always looking for quick wins
  • Why you can't just expose your operational data model as a data product
  • The importance of data product interoperability - even at the PoC phase
  • How crucial the organizational aspects of data mesh really are
  • Much more

Matt's contact info:

LinkedIn: https://www.linkedin.com/in/matthewdarwindba/

Twitter: @EvoDBA / https://twitter.com/EvoDBA

Matt's post on platform reuse: https://medium.com/slalom-data-analytics/data-mesh-is-the-argument-a-strawman-3cffaf55ce5e

Matt's LinkedIn poll on testing data pipelines: https://www.linkedin.com/feed/update/urn%3Ali%3Aactivity%3A6877216459458719744/

Data Mesh Radio is hosted by Scott Hirleman. If you want to connect with Scott, reach out to him at community at datameshlearning.com or on LinkedIn: https://www.linkedin.com/in/scotthirleman/

If you want to learn more and/or join the Data Mesh Learning Community, see here: https://datameshlearning.com/community/

If you want to be a guest or give feedback (suggestions for topics, comments, etc.), please see here

All music used this episode was found on PixaBay and was created by (including slight edits by Scott Hirleman): Lesfm, MondayHopes, SergeQuadrado, ItsWatR, Lexin_Music, and/or nevesf

Data Mesh Radio is brought to you as a community resource by DataStax. Check out their high-scale, multi-region database offering (w/ lots of great APIs) and use code DAAP500 for a free $500 credit (apply under "add payment"): AstraDB

Links