Latest / Agentic Conversations (formally mlops.community)
The Birth and Growth of Spark: An Open Source Success Story // Matei Zaharia // MLOps Podcast #155
MLOps Coffee Sessions #155 with Matei Zaharia, The Birth and Growth of Spark: An Open Source Success Story, co-hosted by Vishnu Rachakonda.
// Abstract
We dive deep into the creation of Spark, with the creator himself, Matei Zaharia, Chief Technologist at Databricks. This episode also explores the development of Databricks' other open source home run, ML Flow, and the concept of "lake house ML". As a special treat, Matei talked to us about the details of the "DSP" (Demonstrate Search Predict) project, which aims to enable building applications by combining LLMs and other text-returning…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.