Latest / The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
How Vibrant Planet's Self-Healing Pipelines Revolutionize Data Processing
Discover the cutting-edge methods Vibrant Planet uses to revolutionize geospatial data processing and resource management. In this episode, we delve into the intricacies of scaling geospatial data processing and resource allocation with experts from Vibrant Planet. Joining us are Cyrus Dukart, Engineering Lead, and David Sacerdote, Staff Software Engineer, who share their innovative approaches to handling large datasets and optimizing resource use in Airflow. Key Takeaways: (00:00) Inefficiencies in resource allocation. (03:00) Scientific validity of sharded results. (05:53) Tech-based…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.