Start studying
Module 6 · LLMs Module contents
Module 6  ·  Card 15 / 22intermediate

Knowledge Cutoff

Pretraining data is collected up to a date, and nothing after it exists inside the model.

The model does not know that the date has passed, so it answers anyway rather than declining.

It will happily describe the current state of something that changed six months after the cutoff.

Retrieval and tool use are the fix, because they supply fresh text at the moment of the question.

Cutoffs are also fuzzy, since recent events are covered far more thinly than older ones.

Learn in depth ↓
Module 06 · LLMs · 22 concepts
In depth  /  15 lines

Knowledge Cutoff, in more detail

Every pretraining corpus is assembled by a certain date and then frozen.

That date is the knowledge cutoff, and it is a hard boundary on what the weights can contain.

The awkward part is that the model has no way to perceive the boundary from the inside.

It does not know today's date, so it cannot tell that a question concerns a period it never saw.

Asked about the newest version of a library, it will describe the newest one it knows and sound current.

This overlaps with hallucination but has a distinct cause: absence of data rather than weak recall.

Cutoffs are also softer than the single published date suggests.

Text about an event keeps being written for years afterwards, so coverage of recent months is thin.

A model may know a great deal about something two years before its cutoff and very little about two weeks before.

Post-training data is more recent still, so a model sometimes knows its own release date and nothing around it.

The reliable fixes all involve supplying fresh text at question time rather than trusting memory.

Retrieval-augmented generation searches a corpus you control and puts the passages in the context.

Tool calling lets the model query a live API, which is the right answer for prices, status and schedules.

Telling the model the current date in the system prompt is a small change that prevents many confident errors.

For anything that changes, treat the weights as a snapshot of the past and design the system to fetch the present.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
Why does a model confidently answer a question about events after its knowledge cutoff?
LLMs

22 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close