How to Catch AI failures

Convo AI World · May 28, 2026 · 44m · transcript

In this episode, host Hermes Frangoudis interviews Faraz Siddiqi, co-founder and CTO of Bluejay, about testing and monitoring voice AI agents. Faraz explains how Bluejay uses "digital humans" synthetic customers with accents, background noise, and even emotions to run hundreds of parallel simulations. What used to take 10–12 hours of manual calling to test 200 menu items now takes just five minutes, letting you grab coffee while Bluejay finds failures before real users hit them. He shares why latency over 1.5 seconds breaks trust, how a transcription error turned "Dr. Pham" into "Dr. Fan,"…