Shows / The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-evolving needs of data engineering and AI ecosystems. Podcast Webpage…
Episodes
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AITransforming the Airflow UI for Cloudera’s Users with Shubham Raj
Contributing to open-source projects can be daunting, but it can also unlock unexpected innovation. This episode showcases how one engineer’s journey with…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIStreamlining Thousands of Data Pipelines at Lyft with Yunhao Qing
Managing data pipelines at scale is not just a technical challenge. It is also an organizational one. At Lyft, success means empowering dozens of teams to…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AITransforming Customer Education in Data Engineering at Astronomer with Marc Lamberti
Understanding the complexities of Apache Airflow can be daunting for newcomers and seasoned data engineers. But with the right guidance, mastering the tool…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIEmbracing Data Mesh and SQL Sensors for Scalable Workflows at lastminute.com with Alberto Crespi
The flexibility of Airflow plays a pivotal role in enabling decentralized data architectures and empowering cross-functional teams. In this episode, we speak…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIThe AI-Ready Pipeline: Reimagining Airflow at Veyer® Logistics with Anu Pabla
Innovation in orchestration is redefining how engineers approach both traditional ETL pipelines and emerging AI workloads. Understanding how to harness…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIStreamlining AI and ML Operations at IBM with BJ Adesoji and Ryan Yackel
The orchestration layer is foundational to building robust AI- and ML-powered data pipelines, especially in complex hybrid enterprise environments. IBM’s…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIInside the Custom Framework for Managing Airflow Code at Wix with Gil Reich
Efficient orchestration and maintainability are crucial for data engineering at scale. Gil Reich, Data Developer for Data Science at Wix, shares how his team…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIModernizing Legacy Data Systems With Airflow at Procter & Gamble with Adonis Castillo Cordero
Legacy architecture and AI workloads pose unique challenges at scale, especially in a global enterprise with complex data systems. In this episode, we explore…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIBuilding an End-to-End Data Observability System at Netflix with Joseph Machado
Building reliable data pipelines starts with maintaining strong data quality standards and creating efficient systems for auditing, publishing and monitoring…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIWhy Developer Experience Shapes Data Pipeline Standards at Next Insurance with Snir Israeli
Creating consistency across data pipelines is critical for scaling engineering teams and ensuring long-term maintainability. In this episode, Snir Israeli…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIData Quality and Observability at Tekmetric with Ipsa Trivedi
Airflow’s adaptability is driving Tekmetric’s ability to unify complex data workflows, deliver accurate insights and support both internal operations and…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIIntroducing Apache Airflow® 3 with Vikram Koka and Jed Cunningham
The Airflow 3.0 release marks a significant leap forward in modern data orchestration, introducing architectural upgrades that improve scalability, flexibility…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIAirflow in Action: Powering Instacart's Complex Ecosystem
The evolution of data orchestration at Instacart highlights the journey from fragmented systems to robust, standardized infrastructure. This transformation has…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIFrom ETL to Airflow: Transforming Data Engineering at Deloitte Digital with Raviteja Tholupunoori
Data orchestration at scale presents unique challenges, especially when aiming for flexibility and efficiency across cloud environments. Choosing the right…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIA Deep Dive Into the 2025 State of Airflow Survey Results with Tamara Fingerlin of Astronomer
The 2025 State of Airflow report sheds light on how global users are adopting, evolving and innovating with Apache Airflow. With over 5,000 responses from 116…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIThe Software Risk That Affects Everyone and How To Address It with Michael Winser and Jarek Potiuk
The security of open-source software is a growing concern, especially as dependencies and regulations become more complex, making it essential to understand…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIBuilding Scalable ML Infrastructure at Outerbounds with Savin Goyal
Machine learning is changing fast, and companies need better tools to handle AI workloads. The right infrastructure helps data scientists focus on solving…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AICustomizing Airflow for Complex Data Environments at Stripe with Nick Bilozerov and Sharadh Krishnamurthy
Keeping data pipelines reliable at scale requires more than just the right tools — it demands constant innovation. In this episode, Nick Bilozerov, Senior Data…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIHarnessing Airflow for Data-Driven Policy Research at CSET with Jennifer Melot
Turning complex datasets into meaningful analysis requires robust data infrastructure and seamless orchestration. In this episode, we’re joined by Jennifer…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIHybrid Testing Solutions for Autonomous Driving at Bosch with Jens Scheffler and Christian Schilling
Testing autonomous vehicles demands precision, scalability and powerful orchestration tools — enter Apache Airflow, a key component of Bosch’s cutting-edge…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIOvercoming Airflow Scaling Challenges at Monzo Bank with Jonathan Rainer
Scaling a data orchestration platform to manage thousands of tasks daily demands innovative solutions and strategic problem-solving. In this episode, we…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIOrchestrating Analytics and AI Workflows at Telia with Arjun Anandkumar
The future of data engineering lies in seamless orchestration and automation. In this episode, Arjun Anandkumar, Data Engineer at Telia, shares how his team…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIThe Role of Airflow in Finance Transformation at Etraveli Group with Mihir Samant
Transforming bottlenecked finance processes into streamlined, automated systems requires the right tools and a forward-thinking approach. In this episode…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIInside Ford’s Data Transformation: Advanced Orchestration Strategies with Vasantha Kosuri-Marshall
Data engineering is entering a new era, where orchestration and automation are redefining how large-scale projects operate. This episode features Vasantha…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIPowering Finance With Advanced Data Solutions at Ramp with Ryan Delgado
Data is the backbone of every modern business, but unlocking its full potential requires the right tools and strategies. In this episode, Ryan Delgado…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIExploring the Power of Airflow 3 at Astronomer with Amogh Desai
What does it take to go from fixing a broken link to becoming a committer for one of the world’s leading open-source projects? Amogh Desai, Senior Software…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIUsing Airflow To Power Machine Learning Pipelines at Optimove with Vasyl Vasyuta
Data orchestration and machine learning are shaping how organizations handle massive datasets and drive customer-focused strategies. Tools like Apache Airflow…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIMaximizing Business Impact Through Data at GlossGenius with Katie Bauer
Bridging the gap between data teams and business priorities is essential for maximizing impact and building value-driven workflows. Katie Bauer, Senior…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIOptimizing Large-Scale Deployments at LinkedIn with Rahul Gade
Scaling deployments for a billion users demands innovation, precision and resilience. In this episode, we dive into how LinkedIn optimizes its continuous…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIHow Uber Manages 1 Million Daily Tasks Using Airflow, with Shobhit Shah and Sumit Maheshwari
When data orchestration reaches Uber’s scale, innovation becomes a necessity, not a luxury. In this episode, we discuss the innovations behind Uber’s unique…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIBuilding Resilient Data Systems for Modern Enterprises at Astrafy with Andrea Bombino
Efficient data orchestration is the backbone of modern analytics and AI-driven workflows. Without the right tools, even the best data can fall short of its…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIInside Airflow 3: Redefining Data Engineering with Vikram Koka
Data orchestration is evolving faster than ever and Apache Airflow 3 is set to revolutionize how enterprises handle complex workflows. In this episode, we dive…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIBuilding a Data-Driven HR Platform at 15Five with Guy Dassa
Data and AI are revolutionizing HR, empowering leaders to measure performance and drive strategic decisions like never before. In this episode, we explore the…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIThe Intersection of AI and Data Management at Dosu with Devin Stein
Unlocking engineering productivity goes beyond coding — it’s about managing knowledge efficiently. In this episode, we explore the innovative ways in which…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIAI-Powered Vehicle Automation at Ford Motor Company with Serjesh Sharma
Harnessing data at scale is the key to driving innovation in autonomous vehicle technology. In this episode, we uncover how advanced orchestration tools are…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIFrom Task Failures to Operational Excellence at GumGum with Brendan Frick
Data failures are inevitable but how you manage them can define the success of your operations. In this episode, we dive deep into the challenges of data…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIFrom Sensors to Datasets: Enhancing Airflow at Astronomer with Maggie Stark and Marion Azoulai
A 13% reduction in failure rates — this is how two data scientists at Astronomer revolutionized their data pipelines using Apache Airflow. In this episode, we…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIMastering Data Orchestration with Airflow at M Science with Ben Tallman
Mastering the flow of data is essential for driving innovation and efficiency in today’s competitive landscape. In this episode, we explore the evolution of…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIWelcome to The Data Flowcast
Welcome to The Data Flowcast: Mastering Airflow for Data Engineering & AI — the podcast where we keep you up to date with insights and ideas propelling the…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIEnhancing Business Metrics With Airflow at Artlist with Hannan Kravitz
Data orchestration is revolutionizing the way companies manage and process data. In this episode, we explore the critical role of data orchestration in modern…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AICutting-Edge Data Engineering at Teya with Alexandre Magno Lima Martins
Data engineering is constantly evolving and staying ahead means mastering tools like Apache Airflow. In this episode, we explore the world of data engineering…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIAirflow Strategies for Business Efficiency at Campbell with Larry Komenda
Managing data workflows well can change the game for any company. In this episode, we talk about how Airflow makes this possible. Larry Komenda, Chief…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIHow Laurel Uses Airflow To Enhance Machine Learning Pipelines with Vincent La and Jim Howard
The world of timekeeping for knowledge workers is transforming through the use of AI and machine learning. Understanding how to leverage these technologies is…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIHow Vibrant Planet's Self-Healing Pipelines Revolutionize Data Processing
Discover the cutting-edge methods Vibrant Planet uses to revolutionize geospatial data processing and resource management. In this episode, we delve into the…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIThe Future of AI in Data Engineering With Astronomer’s Julian LaNeve and David Xue
The world of data orchestration and machine learning is rapidly evolving, and tools like Apache Airflow are at the forefront of these changes. Understanding…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIThe Power of Airflow in Modern Data Environments at Wynn Las Vegas with Siva Krishna Yetukuri
Understanding the critical role of data integration and management is essential for driving business success, particularly in a dynamic environment like a…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIPowering the Texas Rangers World Series Win With AI on Airflow with Alexander Booth
The integration of data and AI in sports is transforming how teams strategize and perform. Understanding how to harness this technology is key to staying…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIExpanding the Data Engineering Toolkit at Reddit
Welcome back to the Airflow Podcast. This week, we met up with Ben Wisegarver, a staff data scientist at Reddit who runs their data warehousing and data…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIGDPR, Self-Service Data, and Infrastructure Automation with Typeform
Welcome back to the Airflow Podcast. This week, we met up with Albert Franzi and Carlos Escura from Typeform. Typeform is a tool that allows you to build…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIAdopting Airflow at Netlify
After a bit of a break, we're back with the third official episode bundle of The Airflow Podcast. In this batch, we'll get a little bit deeper with current…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIThe Road to Airflow 2.0
This week, we linked up with Airflow release manager, core committer, and Astronomer platform engineer Ash Berlin-Taylor to discuss the Airflow 2.0 roadmap…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIAirflow Breeze
This week, we had the pleasure of meeting up with Jarek Potiuk, Principal Software Engineer at Polidea and Apache Airflow committer, to discuss his most recent…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIOpen Source and Airflow at Google
This episode kicks off season 2 of The Airflow Podcast. In this next season, we'll focus on the future of Airflow and chat with leading members of the…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIAirflow 1.10 Release
This week, we met up with Ash Berlin-Taylor to discuss the recent 1.10 release, what it's like to be a release manager for an open source project, Airflow's…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIRole-Based Access Control (RBAC)
This time, we met up with WePay's Joy Gao to talk through her work on the RBAC components in the recent Airflow 1.10 release. We dove deep into what inspired…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIAirflow on Kubernetes
In this episode, we dove into the relationship between Airflow and Kuberenetes and interviewed Daniel Imberman, Senior Software Engineer at Bloomberg (1:30)…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIPain Points
This week, we’ll examine conversations with both old guests and new to paint a comprehensive picture of Airflow’s pain points. While we still undoubtedly…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AICompetitors: Luigi
On this episode, we linked up with Erik Bernhardsson (@erikbern), creator of Luigi and CTO of Better Mortgage. We chatted about everything from the motivations…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIBest Practices
In this episode, we dive into Airflow Best Practices and include longer portions of interviews with Alan Cruickshank (1:30), Business Insights and Data Manager…
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AIUse Cases
Episode 2 of The Airflow Podcast is here to discuss six specific use cases that we’ve seen for Apache Airflow. Here’s the lineup: Patrick Atwater (@patwater)…