It’s time for another episode of the Data Engineering Central Podcast. In this episode we cover …

* Apache Airflow vs Databricks Workflows

* End-of-Year Engineering Planning for 2025

* 10 Billion Row Challenge with DuckDB vs Daft vs Polars

* Raw Data Ingestion.

As usual, the full episode is available to paid subscribers, and a shortened version to you free loaders out there, don’t worry, I still love you though.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe