Latest / The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
How Airflow orchestration decisions impact Spark performance
Airflow and Spark are one of the most common combinations in modern data platforms, but the orchestration decisions made on the Airflow side often determine whether Spark jobs run fast and cheap or slow and expensive. In this episode, Kenten is joined by [Meni Shmueli](linkedin.com/in/meni-shmueli-dataflint), Co-Founder and CEO at [DataFlint](dataflint.io), to dig into how Airflow and Spark fit together, where teams go wrong, and how AI is changing the way they reason about cost and performance.
Key Takeaways:
00:00 Introduction.
01:40 Meni's background as a data engineer and what led him to…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.