
Anthropic and Accenture: who checks the AI safety evaluator?
Send us Fan Mail
Anthropic's outside evaluator also helps customers deploy Claude. Each company expects to invest at least $1 billion in evaluation capacity over five years, but reporting standards remain unsettled. Augur examines what a buyer should ask before treating the new arrangement as independent assurance.
The episode also distinguishes OpenAI's earlier on-site incident investigation from its newer embedded-investigator pledge, explains why model-based judges need calibration, examines Trail of Bits' audit tooling, and considers Nvidia's argument about missing robotics data.
Read the…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.