A model produces a reference. The author name is real, the journal is real, the title sounds plausible — and the paper does not exist. The citation is fabricated, and it looked completely convincing.
This is not an edge case. It is the failure mode that most damages trust in AI, and the people who feel it most are the ones who depend on citations being real.
Who gets hurt by a fabricated reference
Fabricated citations rarely matter to someone asking for a recipe. They matter enormously to people whose reputation or career sits on the line:
- On r/PhD, a high-scoring thread described a reviewer "recommending rejection" after catching that an AI-written submission contained references that did not exist.
- On r/law, a widely-upvoted post surfaced a law firm that submitted a court filing containing citations the model had invented — made-up sources in a document that could sway a ruling.
- On r/Professors, academics described catching fabricated references and data in student work and in the peer-review pipeline itself.
In each case the pattern is identical: a single model produced a fluent, authoritative-looking citation — and it was wrong. The confidence made it worse.
Why one model cannot be trusted to check itself
A language model generates the next plausible token. When you ask it "is this reference real?" it does not look the source up — it generates an answer that sounds like a verification. A single model asked to fact-check its own citation is often just as confident about the wrong answer as it was the first time.
This is why the people who work with citations seriously do not ask one model to vouch for itself. They cross-check. When you ask several independent models whether a reference is real, something useful happens: a fabricated citation triggers disagreement. One model confidently defends the source; another flags it. That visible split is exactly the signal a single, self-confident model never gives you.
Catching a fabricated citation with a consensus
- Ask more than one model. A reference that survives agreement across several independent models is far more likely to be real. One that causes a split is the one to verify by hand.
- Treat confidence as a flag, not proof. The most convincing fabricated citation is the one delivered with total certainty. Disagreement is the counterweight.
- Check the source directly. The consensus tells you where to look. The final confirmation is opening the paper, the case, or the data — but the consensus tells you which claim deserves that check.
Why this is exactly what Satcove does
Satcove runs one question through GPT, Claude, Gemini, Mistral, Perplexity and others at once, then surfaces both the individual answers and the verdict. A fabricated citation does not slip through quietly: the models either converge on "this looks real" or split apart — and that split is exactly what you need to see.
The next time a model hands you a reference, do not trust the confident formatting. Ask several models whether it is real, and let the agreement — or the disagreement — tell you what to verify.
A citation you can reproduce is a tool. A citation a model invented is a liability. Satcove helps you tell the two apart.