Pith. sign in

REVIEW 1 major objections 1 minor 21 references

Reviewed by Pith at T0; open to challenge.

T0 means a machine referee read the full paper against a public rubric. The mark states how deep the mechanical check went, never who wrote it. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.3

Information retrieval should adopt critical theories that prioritize nondomination to define societal good.

2026-07-01 00:51 UTC pith:Y5U2DZV6

load-bearing objection This is a short position paper arguing IR should adopt critical theory to center nondomination and meet Belkin and Robertson's old call for a societal-good foundation, but it stays at the level of assertion. the 1 major comments →

arxiv 2606.30984 v1 pith:Y5U2DZV6 submitted 2026-06-29 cs.IR cs.CY

Towards Critical IR Theories and Practices

Bhaskar Mitra This is my paper
classification cs.IR cs.CY
keywords critical theoriesinformation retrievalsocietal goodnondominationliberal frame
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper argues that information retrieval needs to move beyond the dominant liberal perspective on societal issues and instead embrace critical theories and practices. This shift would allow the field to adopt nondomination as an explicit aim, which in turn clarifies what societal good means in IR and supplies the theoretical foundation that Belkin and Robertson called for decades ago. A sympathetic reader would care because it offers a framework for deciding when research should be restricted if it conflicts with broader societal values rather than technical advancement alone.

Core claim

To achieve the theoretical foundation for societal good in IR urged by Belkin and Robertson, the field should embrace critical theories and practices and shift away from the dominant liberal frame. The critical frame explicitly adopts nondomination as its stated goal, which clarifies conceptualization of societal good, provides the necessary theoretical underpinning, and serves as a basis for critical appraisals of progress in enacting desired societal change.

What carries the argument

The critical frame, which explicitly adopts nondomination as its stated goal and works by distinguishing itself from the liberal frame to clarify societal good in IR.

Load-bearing premise

That the critical frame, unlike the liberal frame, explicitly adopts nondomination as its goal and thereby clarifies conceptualization of societal good while supplying the necessary theoretical underpinning.

What would settle it

A demonstration that critical theories fail to offer a clearer conceptualization of societal good for IR than the liberal frame or do not provide a usable basis for limiting research that contradicts societal good.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

  • IR researchers would gain a clearer basis for determining when to limit scientific inquiry that conflicts with societal good.
  • The field could conduct critical appraisals of its progress in enacting desired societal changes.
  • Societal concerns in IR research would be addressed through a frame that prioritizes nondomination over liberal assumptions.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • This shift could prompt new evaluation criteria in IR systems that assess avoidance of domination in addition to relevance or accuracy.
  • The approach might connect to power dynamics in recommendation systems or search interfaces where information access affects social hierarchies.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

1 major / 1 minor

Summary. The manuscript argues that IR should embrace critical theories and practices and shift away from the dominant liberal frame. It claims that, unlike the liberal frame, the critical frame explicitly adopts nondomination as its stated goal, which clarifies the conceptualization of societal good and supplies the theoretical underpinning for determining when to limit scientific inquiry that Belkin and Robertson urged the community to develop half a century ago.

Significance. If the central normative argument holds, the paper could encourage IR researchers to adopt critical perspectives that foreground power relations and nondomination when evaluating societal impacts of retrieval systems. It directly engages a long-standing call within the field for theoretical foundations on societal good.

major comments (1)
  1. [Abstract] Abstract: The claim that the critical frame 'explicitly adopts nondomination as its stated goal' (in contrast to the liberal frame) is load-bearing for the recommendation to shift frames, yet the manuscript provides no citations, definitions, or examples from critical theory literature to substantiate this distinction or to show how it differs from liberal approaches in practice.
minor comments (1)
  1. The manuscript would benefit from adding explicit bibliographic references to Belkin and Robertson's original work and to representative critical theory sources to allow readers to evaluate the asserted distinctions.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for their review and the recommendation for major revision. We address the single major comment below.

read point-by-point responses

  1. Referee: [Abstract] Abstract: The claim that the critical frame 'explicitly adopts nondomination as its stated goal' (in contrast to the liberal frame) is load-bearing for the recommendation to shift frames, yet the manuscript provides no citations, definitions, or examples from critical theory literature to substantiate this distinction or to show how it differs from liberal approaches in practice.

    Authors: We agree that the abstract would be strengthened by explicit substantiation of this distinction. In the revised manuscript we will add citations to key works in critical theory (including Pettit on republican nondomination and Young on structural injustice), a concise definition of nondomination, and a brief contrast with liberal frames. These additions will be placed in the abstract while preserving its length and will be supported by expanded discussion in the body of the paper. revision: yes

Circularity Check

0 steps flagged

Normative position paper with no detectable circularity

full rationale

The paper advances a normative recommendation that IR adopt critical theories because they explicitly take nondomination as goal, thereby supplying the theoretical foundation requested by Belkin and Robertson. No equations, fitted parameters, derivations, or self-citations appear in the provided text. The distinction between liberal and critical frames is asserted as part of the advocacy argument rather than derived from any prior result by the same author or reduced to a definitional tautology. The central claim therefore remains independent of its own inputs and receives the default non-circularity finding.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 0 invented entities

The argument rests on assumptions about the current dominance of the liberal frame in IR and the distinguishing properties of critical versus liberal frames; no free parameters or invented entities are introduced.

axioms (2)
  • domain assumption The liberal frame is the dominant one through which the IR community views societal concerns.
    Explicitly stated in the abstract as the current state of the field.
  • domain assumption Critical theories explicitly adopt nondomination as their stated goal.
    Presented as a defining contrast to the liberal frame.

pith-pipeline@v0.9.1-grok · 5654 in / 1261 out tokens · 46428 ms · 2026-07-01T00:51:58.235468+00:00 · methodology

0 comments
read the original abstract

Belkin and Robertson urged us, half a century ago, to develop a theoretical foundation for understanding what constitutes societal good that can inform information retrieval (IR) research and serve as a basis for determining when we should limit our scientific inquiry in the face of demands that are contradictory to societal good. In this article, I argue that to achieve this, IR should embrace critical theories and practices in our work, and shift away from the dominant liberal frame through which much of the IR community today view societal concerns in context of our research. Unlike the liberal frame, the critical frame explicitly adopts nondomination as its stated goal which can clarify our conceptualization of societal good within the field, provide necessary theoretical underpinning that Belkin and Robertson urged the community to develop, and serve as a basis for critical appraisals of our progress in enacting desired societal change.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

21 extracted references · 21 canonical work pages · 2 internal anchors

  1. [1]

    9https://disjunctionsmag.com/articles/why-leaving-big-tech/ ACM SIGIR Forum 13 Vol. 60 No. 1 – June 2026 Avishek Anand, Lijun Lyu, Maximilian Idahl, Yumeng Wang, Jonas Wallat, and Zijian Zhang. Explainable information retrieval: A survey.arXiv preprint arXiv:2211.02405,

    work page arXiv 2026

  2. [2]

    When not to design, build, or deploy

    Solon Barocas, Asia J Biega, Benjamin Fish, Jędrzej Niklas, and Luke Stark. When not to design, build, or deploy. InProceedings of the 2020 Conference on Fairness, Accountability, and Transparency, pages 695–695,

    work page 2020

  3. [3]

    Research frontiers in information retrieval: Report from the third strategic workshop on information retrieval in lorne (swirl 2018)

    J Shane Culpepper, Fernando Diaz, and Mark D Smucker. Research frontiers in information retrieval: Report from the third strategic workshop on information retrieval in lorne (swirl 2018). InACM SIGIR Forum, volume 52, pages 34–90. ACM New York, NY, USA,

    work page 2018

  4. [4]

    grand visions

    ACM SIGIR Forum 14 Vol. 60 No. 1 – June 2026 Tom Feltwell, Shaun Lawson, Enrique Encinas, Conor Linehan, Ben Kirman, Deborah Maxwell, Tom Jenkins, and Stacey Kuznetsov. "grand visions" for post-capitalist human- computer interaction. InExtended Abstracts of the 2018 CHI Conference on Human Fac- tors in Computing Systems, pages 1–8,

    work page 2026

  5. [5]

    Towards a critical race methodology in algorithmic fairness

    Alex Hanna, Remi Denton, Andrew Smart, and Jamila Smith-Loud. Towards a critical race methodology in algorithmic fairness. InProceedings of the 2020 conference on fairness, accountability, and transparency, pages 501–512,

    work page 2020

  6. [6]

    Ai transparency: a matter of reconciling design with critique.Ai & Society, 38(5):2071–2079,

    Tomasz Hollanek. Ai transparency: a matter of reconciling design with critique.Ai & Society, 38(5):2071–2079,

    work page 2071

  7. [7]

    ACM SIGIR Forum 15 Vol. 60 No. 1 – June 2026 Os Keyes, Josephine Hoy, and Margaret Drouhard. Human-computer insurrection: Notes on an anarchist hci. InProceedings of the 2019 CHI conference on human factors in computing systems, pages 1–13,

    work page 2026

  8. [8]

    What is ir-for-good?https://bhaskar-mitra.github

    Bhaskar Mitra and Maria Heuss. What is ir-for-good?https://bhaskar-mitra.github. io/posts/2025/09/01/what-is-ir-for-good/,

    work page 2025

  9. [9]

    Information Access of the Oppressed: Freirean Design for Emancipatory Information Access

    Bhaskar Mitra, Dana Mckay, Michael D. Ekstrand, Sanne Vrijenhoek, and Maria Murray. Justice, emancipation, democracy, and information access (jedi): The sigir workshop on resisting corporate and authoritarian capture of information access platforms. Insigir, 2026a. BhaskarMitra, NicolaNeophytou, andSireeshGururaja. Informationaccessoftheoppressed: Freirea...

    work page internal anchor Pith review Pith/arXiv arXiv

  10. [10]

    ACM SIGIR Forum 16 Vol. 60 No. 1 – June 2026 Nicola Neophytou and Bhaskar Mitra. Open, to what end? a capability-theoretic perspective on open search.arXiv preprint arXiv:2603.14584,

    work page arXiv 2026

  11. [11]

    Critical race theory for hci

    Ihudiya Finda Ogbonnaya-Ogburu, Angela DR Smith, Alexandra To, and Kentaro Toyama. Critical race theory for hci. InProceedings of the 2020 CHI conference on human factors in computing systems, pages 1–16,

    work page 2020

  12. [12]

    Olteanu, S

    Alexandra Olteanu, Su Lin Blodgett, Agathe Balayn, Angelina Wang, Fernando Diaz, Flavio du Pin Calmon, Margaret Mitchell, Michael Ekstrand, Reuben Binns, and Solon Barocas. Rigor in ai: Doing rigorous ai work requires a broader, responsible ai-informed conception of rigor.arXiv preprint arXiv:2506.14652,

    work page arXiv

  13. [13]

    Fair ranking: a critical review, challenges, and future directions

    Gourab K Patro, Lorenzo Porcaro, Laura Mitchell, Qiuyue Zhang, Meike Zehlike, and Nikhil Garg. Fair ranking: a critical review, challenges, and future directions. InProc. FAccT, pages 1929–1942,

    work page 1929

  14. [14]

    Much ado about gender: Current practices and future recommendations for appropriate gender-aware information access

    Christine Pinney, Amifa Raj, Alex Hanna, and Michael D Ekstrand. Much ado about gender: Current practices and future recommendations for appropriate gender-aware information access. InProceedings of the 2023 Conference on Human Information Interaction and Retrieval, pages 269–279,

    work page 2023

  15. [15]

    Report from the fourth strategic workshop on information retrieval in lorne (swirl 2025)

    Johanne R Trippas, J Shane Culpepper, et al. Report from the fourth strategic workshop on information retrieval in lorne (swirl 2025). InACM SIGIR Forum, volume 59, page 68,

    work page 2025

  16. [16]

    Interrupting merit, subverting legibility: Navigating caste in ‘casteless’ worlds of computing

    Palashi Vaghela, Steven J Jackson, and Phoebe Sengers. Interrupting merit, subverting legibility: Navigating caste in ‘casteless’ worlds of computing. InProceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pages 1–20,

    work page 2022

  17. [17]

    Report on normalize: The first workshop on the normative design and ACM SIGIR Forum 17 Vol

    Sanne Vrijenhoek, Lien Michiels, Johannes Kruse, Alain Starke, Jordi Viader Guerrero, and Nava Tintarev. Report on normalize: The first workshop on the normative design and ACM SIGIR Forum 17 Vol. 60 No. 1 – June 2026 evaluationofrecommendersystems. InCEUR Workshop Proceedings, volume3639.CEUR- WS,

    work page 2026

  18. [18]

    Beyond algorithms: Reclaiming the interdis- ciplinary roots of recommender systems (beyond 2025)

    Eva Zangerle, Alan Said, and Christine Bauer. Beyond algorithms: Reclaiming the interdis- ciplinary roots of recommender systems (beyond 2025). InProc. RecSys, pages 1360–1361,

    work page 2025

  19. [19]

    Fairness in ranking: A survey.arXiv preprint arXiv:2103.14000,

    Meike Zehlike, Ke Yang, and Julia Stoyanovich. Fairness in ranking: A survey.arXiv preprint arXiv:2103.14000,

    work page arXiv

  20. [20]

    Fine-Tuning Language Models from Human Preferences

    Daniel M Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B Brown, Alec Radford, Dario Amodei, Paul Christiano, and Geoffrey Irving. Fine-tuning language models from human prefer- ences.arXiv preprint arXiv:1909.08593,

    work page internal anchor Pith review Pith/arXiv arXiv 1909

  21. [21]

    ACM SIGIR Forum 18 Vol. 60 No. 1 – June 2026

    work page 2026