Behavior
Why Your Chatbot's Agreement Isn't a Second Opinion
AI assistants tend to affirm the user's framing more readily than a thoughtful human would.
The useful part
Agreement isn't a second opinion until it survives the other side of the story.
Sources behind this episode
- peer-reviewed journal articleSycophantic AI decreases prosocial intentions and promotes dependence
- foundational empirical paperDiscovering Language Model Behaviors with Model-Written Evaluations
- peer-reviewed conference paperTowards Understanding Sycophancy in Language Models
- preprint empirical benchmark studyELEPHANT: Measuring and understanding social sycophancy in LLMs
- preprint empirical studySycophantic AI Decreases Prosocial Intentions and Promotes Dependence
- official company statementSycophancy in GPT-4o: what happened and what we're doing about it