Merging by position, not by score
- : the set of result lists being merged.
- : the position of document in list , counting from 1.
- : a constant, conventionally 60.
Each list contributes a value that depends only on where it placed the document, so two systems with wildly different score scales can be combined with no calibration at all.
A document missing from a list contributes nothing from it, which is the same as being ranked at infinity.
What the constant does
With the gap between first and second place is about 2 percent, so a single list cannot dominate on the strength of its top hit alone.
With the first place is worth half again as much as the second, and the fused ranking becomes almost entirely whichever list ranked it first.
So is the dial between trusting the top of each list and trusting agreement across lists. Large flattens the curve and rewards documents that several systems all liked.
That value comes from the original 2009 paper, it was tuned once on TREC data, and it has been copied ever since because it is rarely the limiting factor.
One fusion, in order
- Run each retriever independently and take its top list.
- For every document in any list, find its rank in each list it appears in.
- Add for each appearance.
- Sort by the total, highest first.
- Cut to the number of results the next stage can afford.
Why it beats score fusion in practice
Normalising scores requires knowing each system's distribution, which changes with the query, the corpus and the model version.
Rank fusion has no such dependency, so it does not need retuning when the embedding model is swapped, and it cannot be broken by one retriever returning unusually large numbers.
It also degrades gently. If one retriever is useless for a query, its contributions are spread across documents the others did not rank highly, and the others still decide the top.
What it throws away
Confidence is discarded. A retriever certain about its first result and one guessing between near-ties contribute identically.
That is a real loss when one system is well calibrated, and it is the reason a tuned weighted sum can still beat RRF on a corpus somebody has invested in measuring.
Weights can be added per list, which recovers some of the control while keeping the scale independence, and it is the usual compromise when one retriever is known to be stronger.