Latest / The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Why Airflow Became the Scheduling Backbone at Condé Nast Technology Lab with Arun Karthik
Data platforms are moving from batch-first pipelines to near real-time systems where orchestration, observability, scalability and governance all have to work together.
In this episode, Arun Karthik, Director, Data Solutions Engineering at Condé Nast Technology Lab, joins us to share how data engineering evolves from relational databases and ETL into distributed processing, modern orchestration with Apache Airflow and managed Airflow with Astronomer.
Key Takeaways:
00:00 Introduction.
02:13 Early data systems rely heavily on relational databases and batch-oriented processing models.
07:01…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.