Latest / Kana & Mari's SoundRepos (English)

ServiceNow/eva
EVA is an open-source end-to-end framework for evaluating conversational voice agents across complete multi-turn spoken interactions. It measures both task accuracy (EVA-A) and conversation experience (EVA-X), using automated bot-to-bot audio simulations, validation, and metric scoring for cascade and audio-native systems.
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.