Latest / Agentic Conversations (formally mlops.community)
How to Systematically Test and Evaluate Your LLMs Apps // Gideon Mendels // #269
Gideon Mendels is the Chief Executive Officer at Comet, the leading solution for managing machine learning workflows. How to Systematically Test and Evaluate Your LLMs Apps
// MLOps Podcast #269 with Gideon Mendels, CEO of Comet.
// Abstract
When building LLM Applications, Developers need to take a hybrid approach from both ML and SW Engineering best practices. They need to define eval metrics and track their entire experimentation to see what is and is not working. They also need to define comprehensive unit tests for their particular use case so they can confidently check if their LLM App…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.