REVIEW 1 cited by
Model Selection's Disparate Impact in Real-World Deep Learning Applications
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Algorithmic fairness has emphasized the role of biased data in automated decision outcomes. Recently, there has been a shift in attention to sources of bias that implicate fairness in other stages in the ML pipeline. We contend that one source of such bias, human preferences in model selection, remains under-explored in terms of its role in disparate impact across demographic groups. Using a deep learning model trained on real-world medical imaging data, we verify our claim empirically and argue that choice of metric for model comparison, especially those that do not take variability into account, can significantly bias model selection outcomes.
Forward citations
Cited by 1 Pith paper
-
What Constitutes a Less Discriminatory Algorithm?
The paper argues that less discriminatory algorithms cannot be defined by quantitative performance metrics alone and must incorporate a reasonableness standard, with feasible but computationally hard search problems.
Discussion (0). Continue with ORCID to comment.