Start studying
Module 6 · LLMs Module contents
Module 6  ·  Card 14 / 22intermediate

Hallucination

A hallucination is fluent output that is simply false, stated with the same confidence as the truth.

The model is predicting plausible text, and a plausible citation is easier to produce than a real one.

Nothing inside it separates remembered fact from confident invention, so it cannot warn you.

Rare facts, exact numbers, quotations and anything after the training cutoff are the usual danger zones.

Grounding the answer in retrieved sources and asking for citations is the practical defence.

Learn in depth ↓
Module 06 · LLMs · 22 concepts
In depth  /  15 lines

Hallucination, in more detail

Hallucination is the term for output that reads perfectly and is not true.

It follows directly from the objective: the model was trained to produce likely text, not verified text.

A citation with a real-sounding author, a plausible journal and an invented page range is highly likely text.

So the model produces it with exactly the same fluency it uses for something it genuinely learned.

There is no internal flag separating recall from construction, which is why the tone never changes.

The failure concentrates in predictable places, and knowing them is most of the defence.

Facts that appeared rarely in training are stored weakly and reconstructed rather than retrieved.

Precise numbers, dates, identifiers and quotations are the worst case, since near enough is still wrong.

Anything after the knowledge cutoff cannot be known, so the model fills the gap by extrapolating.

Long chains of reasoning compound the risk, because one invented step is carried forward as established.

Retrieval-augmented generation is the main mitigation: put the source text in the context and ask for grounding.

That converts a memory problem into a reading problem, which models are far more reliable at.

Requiring citations that point at supplied passages makes the failure visible rather than invisible.

Measuring it needs faithfulness and groundedness checks rather than general quality scores.

It cannot currently be eliminated, so any system where a wrong answer is expensive needs a human or a verifier in the loop.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
Why does a language model state a fabricated citation as confidently as a real one?
LLMs

22 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close