Pith. sign in

REVIEW

A Control Function Framework for Mitigating Position Bias in Learning to Rank Systems

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2506.06989 v3 pith:NS5XDEHL submitted 2025-06-08 cs.IR cs.LG

classification cs.IRcs.LG
keywords biaspositionrankingdatabecausebiasesclickscontrol
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Learning-to-rank (LTR) systems commonly depend on implicit feedback, such as user clicks, because it is easy to collect and can serve as a valuable signal of user preferences. However, directly optimizing ranking models using implicit feedback data often yields suboptimal performance because such data is inherently skewed by systematic biases. Among these biases, position bias is particularly pervasive: items ranked higher tend to receive disproportionately more interactions, regardless of their actual relevance. To address this, we introduce a novel two-stage framework based on control functions. In the first stage, we utilize exogenous variation from the residuals of the ranking process, which are then incorporated into a second stage click model to account for position-dependent distortions. In contrast to existing methods, our approach avoids explicit propensity estimation, supports nonlinear ranking models, and can be flexibly incorporated into any state-of-the-art ranking algorithm for position bias correction. We also propose a debiasing strategy for validation clicks that enables reliable hyperparameter tuning in the absence of unbiased validation data. Empirical results show that our method outperforms state-of-the-art position bias correction methods on both benchmark and real-world industrial datasets.

Discussion (0). Continue with ORCID to comment.

Pith tools