Adding Clean Data Can Make Poisoned Data Stronger
AI companies try to keep bad lessons out of their AI systems by inspecting training examples for harmful content. A new study from the Anthropic Fellows Program and Truthful AI finds a blind spot: tainted examples that do almost nothing on their own can start to work once they are mixed with ordinary, harmless examples. The authors call it "homeopathic learning."
In this episode
How a small AI learned to answer in German when it saw the name "Michael," but only after clean data was added
The same pattern with an old-fashioned persona, a digit-reading program and a safety technique that…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.