Big Complexity Revisited: Dagster with Pete Hunt
Description
Pete Hunt (@floydophone) joins Eric Anderson (@ericmander) to talk about Dagster, the open-source data orchestration platform built for productivity. In 2021, Eric interviewed Dagster’s founder, Nick Schrock, about an earlier iteration of the product. Now, four years later, Pete has become the CEO of Dagster Labs and has all the updates on how this platform has changed along with the industry and the world.
Subscribe to Contributor on Substack for email notifications!
In this episode we discuss:
How and why Dagster has invested in software-defined data assets
Nailing a layered approach between full-code engineering and low-code solutions
The changing role of AI in data pipelines
Dagster’s renewed effort to build observability tools
Links:
People mentioned:
Nick Schrock (@schrockn)
Other episodes:
United States
