How 24,000 companies keep their AI from Breaking in Production | Rohit Agarwal, Portkey
Over 1 Trillion AI tokens pass through Portkey every single day.
Every AI product eventually runs into the same problem. The prototype works, but once it goes live the system has to manage multiple models, rising token costs, unpredictable latency, and infrastructure that was never built for AI workloads.
That is the problem Rohit Agarwal is solving with Portkey, an AI gateway that sits between applications and the models, whether that’s GPT-4, Claude, or Gemini.
With 24,000 companies routing their AI through Portkey, Rohit sits on ground-level data on how AI is actually being used in…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.