Latest / Agentic Conversations (formally mlops.community)
All About Evaluating LLM Applications // Shahul Es // #179
MLOps Coffee Sessions #179 with Shahul Es, All About Evaluating LLM Applications.
// Abstract
Shahul Es, renowned for his expertise in the evaluation space and is the creator of the Ragas Project. Shahul dives deep into the world of evaluation in open source models, sharing insights on debugging, troubleshooting, and the challenges faced when it comes to benchmarks. From the importance of custom data distributions to the role of fine-tuning in enhancing model performance, this episode is packed with valuable information for anyone interested in language models and AI.
// Bio
Shahul is a data…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.