#18 - When AI People-Pleasing Breaks Health Advice
What happens when your health chatbot sounds helpful—but gets the facts wrong? In this episode, we explore how AI systems, especially large language models, can prioritize pleasing responses over truthful ones. Using the common confusion between Tylenol and acetaminophen, we reveal how a friendly tone can hide logical missteps and mislead users.
We unpack how these models are trained—from next-token prediction to human feedback—and why they tend to favor agreeable answers over rigorous reasoning. We spotlight a new study that puts models to the test with flawed medical prompts, showing how…
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.