Skip to main content

Menu

Research

How to replay a reciprocal rank fusion result

Language: English

Replaying reciprocal rank fusion (RRF) starts with the ordered list each source actually passed to fusion. Save those lists along with the rank constant, source weights, and the IDs used for grouping. A final result can keep the same candidate IDs or even the same winner while the inputs to its scores change. RRF formula

Compare the contributions that reached fusion

Record the number of ranks retained from each source and the final output limit. These cutoffs act at different stages. In one fictional replay, increasing one input from one result to two adds a second source contribution for A and changes the winner from B to A. Every candidate remains in the fused pool. Applying a one-result output limit after full fusion still returns A. Input depth replay

For each candidate near the cutoff, compare its retained rank and contribution in each source. A candidate can lose a contribution from one list while another list keeps it eligible.

Check the rank constant and effective weights

If the input ranks agree, replay the rank constant and source weights. In a three-list fixture, A has two first-place ranks and B has one first place and two twelfth places. A leads for positive constants below 10, ties B at 10, and falls behind above 10. Save the tie-break rule when equal scores can affect the output. Rank constant replay

Check how many times each source ranking entered fusion. Counting an exact copy at full weight has the same effect as adding that weight to the original input. Splitting the original weight across the copies preserves every score under the weighted sum. Uniformly rescaling all weights preserves the order already produced. Duplicate source replay

The following example crosses input depth with duplication. It always includes the full lexical list A, C, B, D at weight one. Each semantic input is a prefix of B, A, D, C at weight one, and the rank constant is 60. The second semantic input, when present, is an exact copy of the first. Combined replay

Retained ranks per semantic inputOne semantic inputTwo identical semantic inputs
1BB
2AB

A change from the top left to the bottom right keeps B first even though both the cutoff and the number of inputs changed. Holding one setting at a time reveals that widening the list alone promotes A and then counting the copy restores B's lead.

Check which IDs receive the contributions

For passage search with document results, record the passage-to-document map and the grouping stage. In one fixture, different passages from A lead the two sources and the same passage from B is second in both. Grouping by document within each source before fusion ranks A first. Fusing by passage and then keeping each document's highest-scoring passage ranks B first. The same four documents appear in both outputs. Passage grouping replay