EVA - A Framework for Evaluating Voice Agents by ServiceNow
Voice AI agent evaluation — why it's fundamentally harder than text, how cascade failures derail conversations invisibly, and ServiceNow's open-source framework to establish industry evaluation standards. Featuring real audio examples showing authentication failures, leaked reasoning, and latency problems.
WHAT WE COVER
TARA BOGAVELLI — Research Engineer, ServiceNow
Leading the open-source voice agent evaluation framework. Explains why existing benchmarks don't measure what matters and what ServiceNow is releasing to establish industry standards.
KATRINA STANKIEWICZ — Staff…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.