Judge AI By The Whole Workflow, Not The Fast Step

TILvids · Oct 25, 2026

Someone at work asks: "Could AI handle this for us?" You've seen the demo where it writes a perfect answer in seconds, and the threads where engineers say they were let down. And you can't tell what AI can actually do reliably, or how much of it is hype.

I think "how good is AI?" hides three smaller questions:

What kind of task it is

What the model was given to work with

What happens to its output afterwards.

In this video, I use one example (an imagined pilot where AI drafts customer support replies in five seconds, yet a ticket still takes about as long as before) to show how to judge AI on…