DiscoverTalk Python To Me#330: Apache Airflow Open-Source Workflow with Python
#330: Apache Airflow Open-Source Workflow with Python

#330: Apache Airflow Open-Source Workflow with Python

Update: 2021-08-20
Share

Description

If you are working with data pipelines, you definitely need to give Apache Airflow a look. This pure-Python workflow framework is one of the most popular and capable out there. You create your workflows by writing Python code using clever language operators and then you can monitor them and even debug them visually once they get started.





Stop writing manual code or cron-job based code to create data pipelines check out Airflow. We're joined by three excellent guests from the Airflow community: Jarek Potiuk, Kaxil Naik, and Leah Cole.



Links from the show



Jarek Potiuk: linkedin.com

Kaxil Naik: @kaxil

Leah Cole: @leahecole



Airflow site: airflow.apache.org

Airflow on GitHub: github.com

Airflow community: airflow.apache.org

UI: github.com

Helm Chart for Apache Airflow: airflow.apache.org

Airflow Summit: airflowsummit.org

Astronomer: astronomer.io

Astronomer Registry (Easy to search for official and community Providers): registry.astronomer.io

REST API: airflow.apache.org

Contributing: github.com

Airflow Loves Kubernetes talk: airflowsummit.org

Watch this episode on YouTube: youtube.com

Episode transcripts: talkpython.fm



---------- Stay in touch with us ----------

Subscribe on YouTube (for live streams): youtube.com

Follow Talk Python on Twitter: @talkpython

Follow Michael on Twitter: @mkennedy


Sponsors

Talk Python Training

AssemblyAI
Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

#330: Apache Airflow Open-Source Workflow with Python

#330: Apache Airflow Open-Source Workflow with Python

Michael Kennedy (@mkennedy)