Latest / The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI / Welcome to The Data Flowcast

Transcript

Welcome to The Data Flowcast · The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

• 0:00
  SPEAKER_01: Welcome to the Data Flowcast, your go-to podcast for mastering airflow in data engineering and AI.
• 0:06
  SPEAKER_04: So you use Airflow as the orchestration tool, orchestration engine.
• 0:10
  SPEAKER_04: And then the beauty of it is it's written in Python.
• 0:14
  SPEAKER_01: Join us each week as we dive into the heart of Airflow with insights and ideas propelling the community forward.
• 0:20
  SPEAKER_05: Our goal is to teach it to specifically learn how to look at airflow airlocks, not just general passage, which we found out that actually doesn't do that well in, and also tends to either hallucinate or extract irrelevant information here and there.
• 0:34
  SPEAKER_01: Explore the current state, future, and potential of airflow with leading thinkers in the community.
• 0:40
  SPEAKER_03: So with this rapid rise of big data in baseball, how do we make that available?
• 0:47
  SPEAKER_03: How do we transform it?
• 0:48
  SPEAKER_01: Discover how to leverage this powerful workflow management system to meet the ever-evolving needs of data engineering and AI.
• 0:55
  SPEAKER_02: But we really like dynamic task mapping because honestly it kept us, didn't require us to go out and get another tool.
• 1:01
  SPEAKER_02: So we didn't have to go and leverage Ray or Dask or some system like that just yet.
• 1:06
  SPEAKER_02: We can do it within Airflow.
• 1:08
  SPEAKER_01: Engaging conversations provide actionable insights and valuable perspectives for daily use and application.
• 1:14
  SPEAKER_03: How do we run AI and machine learning on it to help them make better decisions at the end of the day?
• 1:19
  SPEAKER_00: Airflow is our backbone of our data ingestion, curation, giving the better customer experience is what we are trying to achieve.
• 1:27
  SPEAKER_01: From AI to machine learning, each episode delves deep into practical applications and innovations.
• 1:33
  SPEAKER_05: That model of you fail fast works really well when you have long-running tasks.
• 1:39
  SPEAKER_01: Ready to elevate your data engineering game?
• 1:41
  SPEAKER_01: Subscribe to the Data Flowcast today.
• 1:44
  SPEAKER_01: Thanks for listening to the Data Flowcast, mastering airflow for data engineering and AI.
• 1:50
  SPEAKER_01: Leave a five star review and help spread the word.
• 1:53
  SPEAKER_01: Subscribe now to never miss an insightful conversation.