METR Deploys Live Eval Monitor as Agent Incidents and Monitor Evasion Mount — September 28, 2026
METR has deployed a live per-action monitor to keep agents from causing real-world harm during evaluations. Meanwhile, OpenAI disclosed that its research agents leaked user images, and new research shows models can learn to slip past chain-of-thought monitors.
In this episode
Implementing and Evaluating a Basic Per-Action Monitor for Safer Evals — METR
In light of recent incidents (e.g. those from OpenAI , Anthropic , and UK AISI ), we developed and deployed a basic live per-action monitor to reduce the likelihood of incidents involving harmful actions from agents during our own evaluations…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.