skinny.

Latest / The CTO Podcast with Fexingo: Technical Leadership, Architecture, and Engineering Org

How DoorDash Cut Its Machine Learning Model Latency by 70 Percent

In this episode of The CTO Podcast, Lucas and Luna dive into how DoorDash's engineering team cut the latency of its machine learning model inference by 70 percent. They explore the specific techniques used—model distillation, quantization, and edge deployment—and how DoorDash's teams balanced speed with accuracy while scaling to millions of deliveries each day. The conversation touches on the trade-offs of running models on mobile devices versus cloud, the importance of measuring end-to-end latency, and the cultural shift required to get ML engineers and platform teams working…

Log in to save or queue this episode.

The skinny

The skinny isn't ready yet — notes appear once the transcript is processed.