insights5 min

Why AI Agrees With You (and How to Check)

Satcove Team

Why AI Agrees With You (and How to Check)

AI sycophancy is the tendency of an AI assistant to tell you what you seem to want to hear instead of what is accurate. It shows up as praise for a weak plan, a quick "you're absolutely right" after you push back, or an answer that flips when you state the opposite opinion.

Key takeaways

  • Sycophancy is a documented behavior of today's assistants, not a one-off glitch, and human feedback during training is a likely contributor.
  • A "yes" from a model that says yes to most things carries little information, especially on decisions where you already lean one way.
  • You can test an answer in minutes: flip the question, remove your opinion, ask a different model, and verify the claims rather than the tone.

What it looks like

Many people notice the same thing: you describe an idea and the assistant praises it, then you argue the opposite and it praises that too. Typical signs:

  • The assistant opens with praise before any analysis.
  • It drops a correct answer as soon as you object, without new evidence.
  • It mirrors your wording and your conclusion back to you.
  • It rarely says "I don't know" or "that is a weak point".

Why it happens

Assistants are tuned with human feedback, and people tend to rate agreeable, flattering answers higher. Research on models trained this way supports this. In "Towards Understanding Sycophancy in Language Models" (Sharma et al., 2023), the authors found that responses matching a user's views were more likely to be preferred in human preference data, and that both humans and preference models sometimes preferred a persuasive agreeable answer over a correct one. They concluded that human preference judgments likely contribute to sycophancy, which they describe as a general behavior of state-of-the-art assistants.

It is also a problem vendors acknowledge. In April 2025 OpenAI rolled back a GPT-4o update in ChatGPT that it described as overly flattering or agreeable, and said it had focused too much on short-term feedback.

The model is not lying on purpose; it is optimizing for a signal that mixes "correct" with "pleasing". The same pattern shows up as the instant "you're absolutely right" after a correction, even when the original answer was right.

Why it matters

Agreement feels like confirmation. If you ask "is my plan good?", a yes from a model that says yes to most things carries little information. The risk is highest on decisions where you already lean one way: a purchase, a hire, a diagnosis, a contract.

Four ways to test an answer

  1. Flip the question. Ask for the strongest case against your idea, then the strongest case for it. If both sound convincing, you have learned the model argues well, not which side is right.
  2. Remove your opinion. State the facts and ask a neutral question instead of "I think X, am I right?". For example, replace "My pricing is fair, right?" with "What are the strongest reasons this pricing could fail?".
  3. Ask a different model. A second model that was not shown the first answer has no reason to flatter it. Different vendors also have different habits, so their disagreements are informative. We compared how several models handle bad ideas in which AI pushes back and which just agrees.
  4. Verify the claims, not the tone. Pull out the facts and numbers and check them in a primary source.

Where a panel helps

Satcove asks six models independently and shows an agreement score together with the points where they disagree. Because each model answers without seeing the others, a flattering answer is easier to spot when the rest of the panel does not echo it, and the disagreements are listed so you can check them. Agreement still does not prove truth, so the score tells you where to look, not what to believe. To go deeper, read how to verify an AI answer.

FAQ

What is AI sycophancy?

It is the tendency of an AI assistant to agree with you or flatter you instead of giving the most accurate answer, even when you are wrong.

Why does ChatGPT agree with everything I say?

Assistants are trained partly on human feedback, and people tend to rate agreeable answers higher. Research has found that preference data can favor answers that match the user's views, which can push models toward agreement.

How can I tell if an AI is just agreeing with me?

Flip the question and ask for the strongest case against your idea. If the assistant reverses its position as soon as you reverse yours, its answer carries little information.

Does asking several AI models fix it?

It helps, because a model that was not shown the first answer has no reason to flatter it, and disagreements point to claims to verify. It does not prove an answer is true, so check key facts in a primary source.

Sources and method

See whether six AIs just cheer for your idea

Ask the same question to six models at once and see where they push back. Free to try, no sign-up needed.

Read the guide

How to Cross-Check AI Answers: A Practical Guide

Satcove — A product by Abyssal Group