Latest / LessWrong (30+ Karma)

“Base Models Can Detect Hidden Intentions that Prompted Classifiers Miss” by Oz Amram
TL;DR
The Persona Selection Model (PSM) posits that post-training selects a persona the model learned during pre-training. Subliminal Learning (Cloud et al.) showed that models can impart covert signals (like "love of owls") into semantically unrelated outputs (like strings of numbers), and that students training on these outputs inherit those traits.
By using base pre-trained models with an appropriate header, a method I call persona-header likelihood evaluation (PHLE), one can effectively decode these subliminal signals and classify between them. The performance of this method significantly…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.