Latest / LessWrong (30+ Karma)
“Simulated Control Evaluations” by Jeffrey Olmo, dzhang, Tyler Tracy
We’ve released a paper on simulated control evaluations (SCEs). They’re a method for testing whether the monitors AI developers use to oversee their agents would catch a model deliberately trying to cause harm, under conditions much closer to real deployment than current tests allow.
Developers have started running monitors in their agentic deployments: models that flag or block an agent's actions when they look dangerous. To know whether a monitor is good enough, you want to know how often it would stop a model that was actively trying to do something harmful, such as quietly inserting a…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.