AI Observability: Measuring Quality, Risk, and ROI
An AI agent can be fast, available, and still get the answer wrong. That changes what engineering teams need to measure.
Jeetendra Soneja, VP of Engineering, AI Platform at iHerb, joins The Tech Trek to discuss why AI observability goes beyond traditional software monitoring. Teams need to understand not just latency and errors, but also response quality, groundedness, cost, and whether an agent completes its intended task.
We also explore how to measure AI ROI without relying on misleading productivity metrics. Jeetendra shares his perspective on risk based guardrails, the skills engineers…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.