Containers in software abstracted away a number of very cumbersome tasks and encapsulated a lot of the dependencies software had to its environment. Combined, that meant developers could focus on delivering value instead of focusing on the infra. We need to do the same in data.
It's all about sharing data in a responsible and easy way. That means putting all the components together so you don't have to manage many versions. Just like microservices.
How do you manage to make this easy for the data product developer - bundle everything together. But centralized data products are creating a lot of potential issues/risk to scalability and flexibility. We just keep trying to centralize in data.
Sponsored by NextData, Zhamak's company that is helping ease data product creation.