Latest / LessWrong (30+ Karma)

“GLM-5.3 Sometimes Considers How Train-Time Actions Shape Future Behavior” by Axel Højmark, Ezra Newman
Authors: Axel Højmark*, Ezra Newman* (*Equal contribution)
While reviewing transcripts from standard behavioral evaluations of GLM-5.3, we noticed that the model occasionally reasons, unprompted, about how its actions will shape future models. It appears to consider that its outputs might be used for supervised fine-tuning (SFT), reinforcement learning (RL), or other forms of training, and that the actions it takes could reinforce certain behaviors. For example, GLM-5.3 sometimes reasons that a misaligned action taken now could be reinforced and make similar actions more likely later, or…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.