Latest / The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
What's New in Apache Airflow® 3.3
Airflow 3.3 is here, with a set of features to help with the messy realities of production pipelines: persisting state across retries, reacting intelligently to different failure types, and partitioning assets by more than just time. In this episode, Marc Lamberti, Education Content Lead at [Astronomer](astronomer.io), joins Kenten Danas to walk through what's new in the release and where each feature actually pays off.
Key Takeaways:
00:00 Introduction.
01:46 The new task state store (AIP-103) lets tasks persist state across retries, so a long-running Spark job can be reattached after a…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.