{"id":"ce73d09c-4716-48d3-99f3-c213058d2cfb","arxiv_id":"2606.30984","paper_version":1,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":3.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"IR should shift from liberal to critical theoretical frames centered on nondomination to ground societal good and evaluate progress toward it.","lead":"The paper argues that information retrieval should adopt critical theories instead of the dominant liberal frame to better define societal good and limit inquiry when needed. A smart generalist might read it to understand calls for social critique in technical research fields.","discovery_kind":"new_application","skeptic_critique":{"model":"grok-4.3","headline":"No significant objection identified","rationale":"The reader's UNVERDICTED status with low confidence correctly reflects that a normative advocacy paper falls outside standard verification methods. The weakest assumption identified by the reader (critical frame adopting nondomination) is the core of the position itself rather than a hidden technical premise. No additional load-bearing concern exists that would alter the verdict.","tokens_in":1669,"tokens_out":275,"duration_ms":25913,"concrete_test":"Locate any section in the full manuscript that maps nondomination to concrete IR practices (e.g., a specific research limit, evaluation criterion, or example of clarified societal good); if the mapping is present and referenced to particular critical theorists, the normative argument gains internal support even though it remains non-empirical.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper is a normative position paper whose central claim is an advocacy recommendation: that IR should shift to critical theories and practices because they adopt nondomination as goal, thereby supplying the theoretical underpinning Belkin and Robertson requested. No empirical, formal, or quantitative claim is advanced that could be load-bearing in a technical sense. The distinction between liberal and critical frames is asserted as part of the normative argument rather than derived from data or proof. No internal inconsistency appears in the abstract or the described claim.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.3","summary":"The manuscript argues that IR should embrace critical theories and practices and shift away from the dominant liberal frame. It claims that, unlike the liberal frame, the critical frame explicitly adopts nondomination as its stated goal, which clarifies the conceptualization of societal good and supplies the theoretical underpinning for determining when to limit scientific inquiry that Belkin and Robertson urged the community to develop half a century ago.","tokens_in":1706,"tokens_out":336,"duration_ms":31716,"significance":"If the central normative argument holds, the paper could encourage IR researchers to adopt critical perspectives that foreground power relations and nondomination when evaluating societal impacts of retrieval systems. It directly engages a long-standing call within the field for theoretical foundations on societal good.","major_comments":[{"comment":"Abstract: The claim that the critical frame 'explicitly adopts nondomination as its stated goal' (in contrast to the liberal frame) is load-bearing for the recommendation to shift frames, yet the manuscript provides no citations, definitions, or examples from critical theory literature to substantiate this distinction or to show how it differs from liberal approaches in practice.","section":"Abstract"}],"minor_comments":[{"comment":"The manuscript would benefit from adding explicit bibliographic references to Belkin and Robertson's original work and to representative critical theory sources to allow readers to evaluate the asserted distinctions.","section":null}],"recommendation":"major_revision","confidential_remarks":"The manuscript is a normative position statement rather than a technical or empirical contribution; this may affect its fit for a primarily technical cs.IR venue even if the argument is developed further."},"author_rebuttal":{"model":"grok-4.3","summary":"We thank the referee for their review and the recommendation for major revision. We address the single major comment below.","responses":[{"response":"We agree that the abstract would be strengthened by explicit substantiation of this distinction. In the revised manuscript we will add citations to key works in critical theory (including Pettit on republican nondomination and Young on structural injustice), a concise definition of nondomination, and a brief contrast with liberal frames. These additions will be placed in the abstract while preserving its length and will be supported by expanded discussion in the body of the paper.","revision_made":"yes","referee_comment":"[Abstract] Abstract: The claim that the critical frame 'explicitly adopts nondomination as its stated goal' (in contrast to the liberal frame) is load-bearing for the recommendation to shift frames, yet the manuscript provides no citations, definitions, or examples from critical theory literature to substantiate this distinction or to show how it differs from liberal approaches in practice."}],"tokens_in":1158,"tokens_out":223,"duration_ms":33588,"standing_objections":[]},"desk_editor":{"model":"grok-4.3","letter":"The core takeaway is that this paper pushes IR to replace its dominant liberal framing of societal issues with critical theories and practices, on the grounds that only the latter makes nondomination an explicit goal and thereby supplies the theoretical base Belkin and Robertson requested fifty years ago.\n\nIt does a clean job of stating the position and tying it directly to that historical reference. The argument is internally consistent on its own terms: if the goal is to clarify what counts as societal good and to have a basis for limiting research, then naming nondomination as the target is presented as an advantage over vaguer liberal commitments. The writing is direct and avoids unnecessary jargon.\n\nThe main limitation is that the piece offers no concrete illustrations, case studies, or comparisons showing how the shift would actually alter research questions, evaluation metrics, or day-to-day practice in IR. The distinction between liberal and critical frames is asserted rather than derived from specific literature or examples, so readers already skeptical of critical theory will find little new material to engage with. Because the paper is purely normative, there is also no data or formal derivation to check.\n\nThis is aimed at IR people already interested in the field's societal role and willing to consider value-based reframings. It could fit a special issue or workshop on ethics and foundations, but it is unlikely to change technical work. A referee could usefully press for more operational implications and tighter citations, which is why I would send it to review rather than desk-reject.","headline":"This is a short position paper arguing IR should adopt critical theory to center nondomination and meet Belkin and Robertson's old call for a societal-good foundation, but it stays at the level of assertion.","tokens_in":2220,"tokens_out":383,"would_cite":false,"duration_ms":21215,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.3","headline":"Information retrieval should adopt critical theories that prioritize nondomination to define societal good.","keywords":["critical theories","information retrieval","societal good","nondomination","liberal frame"],"falsifier":"A demonstration that critical theories fail to offer a clearer conceptualization of societal good for IR than the liberal frame or do not provide a usable basis for limiting research that contradicts societal good.","tokens_in":2515,"feed_emoji":"","tokens_out":548,"duration_ms":26961,"temperature":0.7,"pith_summary":"The paper argues that information retrieval needs to move beyond the dominant liberal perspective on societal issues and instead embrace critical theories and practices. This shift would allow the field to adopt nondomination as an explicit aim, which in turn clarifies what societal good means in IR and supplies the theoretical foundation that Belkin and Robertson called for decades ago. A sympathetic reader would care because it offers a framework for deciding when research should be restricted if it conflicts with broader societal values rather than technical advancement alone.","feed_headline":"IR should adopt critical theories to define societal good","feed_subtitle":"Nondomination as explicit goal supplies the theoretical base Belkin and Robertson urged for limiting contradictory research.","key_machinery":"The critical frame, which explicitly adopts nondomination as its stated goal and works by distinguishing itself from the liberal frame to clarify societal good in IR.","core_discovery":"To achieve the theoretical foundation for societal good in IR urged by Belkin and Robertson, the field should embrace critical theories and practices and shift away from the dominant liberal frame. The critical frame explicitly adopts nondomination as its stated goal, which clarifies conceptualization of societal good, provides the necessary theoretical underpinning, and serves as a basis for critical appraisals of progress in enacting desired societal change.","pith_inferences":["This shift could prompt new evaluation criteria in IR systems that assess avoidance of domination in addition to relevance or accuracy.","The approach might connect to power dynamics in recommendation systems or search interfaces where information access affects social hierarchies."],"forward_implications":["IR researchers would gain a clearer basis for determining when to limit scientific inquiry that conflicts with societal good.","The field could conduct critical appraisals of its progress in enacting desired societal changes.","Societal concerns in IR research would be addressed through a frame that prioritizes nondomination over liberal assumptions."],"fun_headline_variants":["Critical IR theories ground societal good","Nondomination defines IR societal good","Shift IR to critical nondomination frame","Belkin Robertson IR call met by critical theories"],"cache_read_input_tokens":2112,"weakest_assumption_plain":"That the critical frame, unlike the liberal frame, explicitly adopts nondomination as its goal and thereby clarifies conceptualization of societal good while supplying the necessary theoretical underpinning.","fun_headline_variants_meta":{"raw":{"variants":["Critical IR theories ground societal good","Nondomination defines IR societal good","Shift IR to critical nondomination frame","Belkin Robertson IR call met by critical theories"]},"model":"grok-4.3","cost_usd":0.007775,"raw_usage":{"total_tokens":3506,"prompt_tokens":577,"num_sources_used":0,"completion_tokens":43,"cost_in_usd_ticks":77749500,"prompt_tokens_details":{"text_tokens":577,"audio_tokens":0,"image_tokens":0,"cached_tokens":256},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":2886,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":577,"tokens_out":43,"duration_ms":32147,"temperature":1.0,"reasoning_tokens":2886,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-07-01T00:51:58.235468+00:00","model_set":{"reader":"grok-4.3"},"falsifier":"A demonstration that critical theories fail to offer a clearer conceptualization of societal good for IR than the liberal frame or do not provide a usable basis for limiting research that contradicts societal good.","supporting_citations":[],"review_version":1}