Latest / The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Building self-service Dags with GitHub Actions at Lyft
At Lyft, a small data engineering team supports dozens of scientists and analysts who tune driver pay configurations on demand, all under SOX controls. In this episode, Ken Obata, Senior Software Engineer at Lyft, joins Kenten Danas to walk through how his team built self-service Dags with an event-driven integration between GitHub Actions and Airflow, and how they solved the data modeling and consistency problems that came with it.
Key Takeaways:
00:00 Introduction.
02:49 How Airflow responsibility is split at Lyft between the infrastructure org (scaling, version control, Astronomer…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.