Latest / The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Orchestrating cost-efficient data pipelines at Insignis
Running Airflow with a one-person data engineering team means every decision about cost, tooling, and best practices has to earn its keep. In this episode, Kenten sits down with Aniruddha Sengupta, Staff Data Engineer at Insignis, to talk through how the UK cash-savings fintech runs a low-cost, scalable Airflow platform. The conversation covers observability, DAG-level best practices, the internal tools Insignis built to control costs, and where AI fits into the roadmap.
Key Takeaways:
00:00 Introduction.
02:22 Insignis data team as a "newspaper" for the business. Aniruddha describes the data…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.