DiscoverContributorPrefect with Jeremiah Lowin
Prefect with Jeremiah Lowin

Prefect with Jeremiah Lowin

Update: 2020-10-21
Share

Description

Eric Anderson (@ericmander) and Jeremiah Lowin (@jlowin) discuss Prefect, a workflow management system and data orchestration tool under development as an open-source project. Jeremiah initially created Prefect to solve a technical challenge specific to his own work, but soon realized that it was appealing to a very wide range of different clients. Listen to today’s episode to learn why Jeremiah believes most attempts to build a unified framework for solving data orchestration fail.


In this episode we discuss:



  • Solving the “negative engineering problem”

  • Learning from the complaints of data engineers at Apache Airflow

  • The difficulty of having a product that serves two masters

  • How COVID changed the direction of Prefect


Links:



People mentioned:


Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Prefect with Jeremiah Lowin

Prefect with Jeremiah Lowin

Eric Anderson