Chunking cuts documents into pieces, and the cuts remove information that was never in the piece.
A paragraph in a financial report may say revenue grew by three per cent that quarter.
Which company, which quarter and which segment were established pages earlier and are simply gone.
Embedded on its own, that chunk matches almost nothing a user would actually ask.
Contextual retrieval fixes this at indexing time rather than at query time.
Before embedding, each chunk is passed to a model along with the document it came from.
The model writes one or two sentences saying what this chunk is and where it sits.
That context is prepended to the chunk text, and the combined text is what gets embedded.
Now the chunk carries its own subject, so a query naming the company and quarter retrieves it.
The same enriched text is indexed for keyword search, which improves sparse retrieval as well.
The cost is one model call per chunk when the corpus is indexed, which is a one-off.
Prompt caching over the shared document makes that far cheaper than it first sounds.
Query time is unchanged, since all the work has already been done.
Reported reductions in retrieval failure are substantial, especially combined with hybrid search and reranking.
The trade is index freshness: a changed document means regenerating the context for its chunks.