Latest / The Practical AI Digest
The Evaluation Crisis: We Do Not Know How Good Our Models Actually Are
MMLU is saturated. Chatbot Arena is gameable. Public benchmarks leak into training data. The only eval that matters is the one you build yourself, on your data, for your task.
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.