Pith. sign in

REVIEW 2 major objections 4 minor 235 references

Hands-Off or Hands-On? Variation in Area Chair Practices and Implications for AI Support

T0 review · 2 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Area chairs range from hands-off judges to hands-on advocates, so AI peer-review support must be personalized, not one-size-fits-all.

desk verdict A solid, honest interview study of ICLR area chairs that deserves peer review, though the abstract overstates the generality of the hands-off/hands-on variation compared with the paper's own venue-specific caveats. read the letter →

arxiv 2608.07425 v1 pith:ZY2RW5ZI submitted 2026-08-07 cs.HC

Ines Arous , Neha Nayak Kennard , Andrei Mircea , Emily Kuang , Jackie Chi Kit Cheung , Andrew McCallum This is my paper · ORCID
classification cs.HC
keywords areachairspeerreviewhuman-AIcollaborationdesignprobethematicanalysisAIassistancereviewercoordinationhumanagency
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that area chairs (ACs), who oversee peer review of submissions, do not share one universal way of working. Interviews with 27 ACs from the machine-learning conference ICLR show a wide range of engagement: some act as hands-off judges who defer to reviewer consensus, while others read papers closely and actively advocate for promising work. The paper also finds that chasing and nudging reviewers is the most frustrating part of the job, and that ACs view AI assistance with cautious optimism, worrying about bias amplification, hallucination, and over-reliance. From this, it concludes that AI tools for ACs should be tailored to different AC styles, help moderate reviewer-author discussions, and preserve human agency in final decisions.

What carries the argument

The carrying mechanism is the hands-on/hands-off engagement axis, a qualitative distinction derived from reflexive thematic analysis of interview transcripts, which produced 162 codes and six main themes. The authors elicit design reactions with a design probe consisting of four wireframes: argument labels, conformity-to-standards scores, generated summaries, and comment context. The axis is the organizing variable: it explains variation in time spent per paper, in whether ACs overrule reviewers, and in which wireframe features ACs found useful, and it motivates the three design implications.

What would settle it

A survey or interview study of a random sample of ACs from venues with private, non-interactive reviews, where no public rebuttal exists, that measures engagement time per paper and how often ACs override reviewer consensus would test whether the hands-on/hands-off variation persists or collapses once venue-specific public discussion is removed.

Watch

Extended reading notes

Core claim

The central discovery is that AC practice is not uniform and cannot be reduced to a single ideal to support. Across 27 semi-structured interviews with ICLR area chairs, engagement varied from hands-off, judge-like deference to reviewer consensus to hands-on advocacy for promising submissions, and this variation shaped both workflow frustrations and tool preferences. The paper therefore concludes there is no one-size-fits-all solution for assisting ACs: support must be tailored to diverse practices, target discussion moderation as the most frustrating task, and embed human-centered AI principles that keep ACs as final decision-makers.

Load-bearing premise

The load-bearing premise is that 27 self-selected ICLR area chairs represent the true range of AC practice, so that the observed hands-on/hands-off split is a general trait of ACs rather than an artifact of ICLR's open, discussion-heavy review culture.

Editorial extensions

If this is right

  • AC assistance tools should offer at least two modes: a hands-off mode that summarizes reviewer consensus and flags disagreements, and a hands-on mode that supports deep paper reading and advocacy.
  • Tools that automate reviewer reminders, nudges, and discussion moderation would address the most frustrating part of the AC role and free senior researchers for judgment tasks.
  • Generated summaries should be extractive, preserving reviewers' original wording, and should require ACs to edit or validate them, reducing hallucination risk and over-reliance.
  • Deployments should be adaptable to venue norms: core sense-making aids can generalize, while automation level and interpretability should be tuned to each venue's discussion culture.
  • ACs should remain the final decision-makers, with AI outputs traceable to source reviews so that errors can be attributed and corrected.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the hands-on/hands-off split generalizes, a paper's outcome may depend on which AC style it draws: hands-on chairs who advocate for promising ideas could shift borderline accept/reject decisions, making AC style a hidden variable in fairness.
  • The wireframe preferences suggest a testable design hypothesis: forcing active editing of AI-generated summaries will reduce over-reliance, but the same forcing may annoy hands-off ACs; engagement-style detection from interaction logs could personalize the degree of forcing.
  • In venues without public discussion, the coordination burden may shrink and hands-off styles may dominate, so the relative priority of the three design implications—personalization, moderation, and human agency—could shift across venues.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 4 minor

Summary. This paper presents a qualitative interview study of 27 area chairs (ACs) from ICLR, combining semi-structured interviews with a design probe consisting of four wireframes for AI-assistive tools. The authors identify recurring challenges (reviewer disengagement, authors' persistence, coordination burden, cognitive overload), strategies (nudging reviewers, filtering reviews, selective engagement), and a central finding that ACs vary widely in engagement style, from hands-off, judge-like deference to reviewer consensus to hands-on advocacy for promising work. From these observations, they derive three design implications: personalizing AI assistance to diverse AC practices, designing conversational moderation agents, and embedding human-centered AI principles that preserve human agency. The paper includes the full interview protocol, transparent recruitment details, and an explicit discussion of which findings may or may not generalize beyond ICLR.

Significance. If the findings hold, this is a useful empirical contribution to the under-studied design space of AI support for area chairs. The study is carefully conducted within the conventions of qualitative HCI research: the interview protocol is included, the wireframes are described and depicted, the analysis uses reflexive thematic analysis, and direct participant quotes support the reported themes. The paper's main contribution is the documentation of substantial variation in AC engagement and the resulting implication that AI assistance should not be one-size-fits-all. The authors also deserve credit for explicitly separating probable generalizable patterns from ICLR-specific dynamics in Sect. 5.4, which is more careful than many interview studies. The work does not involve formal models or fitted parameters, so circularity concerns do not apply; the design implications are standard inferences from qualitative data.

major comments (2)
  1. [Abstract and Sect. 5.4] The abstract and Sect. 5.1 state without qualification that ACs vary widely and that 'there is no one-size-fits-all solution for assisting ACs,' yet Sect. 5.4 explicitly concedes that the participants 'do not represent the full diversity of peer-review practices across venues' and that future research is needed to examine how variability manifests beyond ICLR. Given that the sample is 28 of 540 contacted ACs from a single venue (ICLR), which is unusual in its public, discussion-heavy reviewing process, the observed hands-off/hands-on variation could be an artifact of venue-specific norms or of self-selection among particularly engaged or opinionated respondents. Because this variation is the load-bearing premise for the primary design implication, the central claim should be scoped to the studied population or supported by a concrete argument, grounded in the data, that the variation is inherent to the AC role rather than to ICLR. Please revise the abstract and Sect. 5.1 to match the cautious framing of Sect. 5.4.
  2. [Sect. 4.2, 'Selective Engagement with Submissions and Decisions'] The hands-off/hands-on distinction is based entirely on self-reports during interviews, with no evidence that these self-described styles correspond to observable, stable behavior. For the personalization design implication in Sect. 5.1, it matters whether an AC's engagement style is a stable trait that a tool could adapt to, or a situational response to particular papers or reviewer dynamics. The paper reports counts (e.g., 14 of 27 ACs leveraged their seniority) but does not provide codebook definitions for the engagement categories or any inter-rater agreement information, which makes it difficult to assess the reliability of the variation claim. Please report how the hands-off/hands-on categories were coded and discuss the potential instability or situational dependence of these styles as a limitation or as a question for future longitudinal work.
minor comments (4)
  1. [Sect. 3.1] Section 3.1 states that 28 candidates consented to participate, but the rest of the paper refers to 27 ACs; please clarify this discrepancy (e.g., one consent withdrawn or data excluded).
  2. [Fig. 3] In Figure 3(b), the rows and columns are not labeled with tool names or rank positions, so the reader must cross-reference Figure 3(a) and the text to interpret the ranking counts; please add axis labels and a legend.
  3. [Sect. 5.2] The conversational-agent moderator design implication is presented as a direct consequence of the findings, but the supporting interview evidence is relatively thin (7 ACs identified reviewer communication as automatable); consider labeling this as an exploratory design opportunity rather than an empirically grounded requirement.
  4. [Throughout] There are minor inconsistencies in capitalization ('Area chairs' vs 'area chairs') and in the use of 'meta-review' versus 'metareview'; please standardize these terms.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the paper's claims are empirical generalizations from interviews and design probes, not derived from fitted inputs or self-citation chains.

full rationale

This is a qualitative interview and design-probe study, so the circularity patterns for formal derivations do not apply. The central claim—that area chairs vary in engagement and therefore need personalized AI support—is an empirically grounded generalization from 27 semi-structured interviews and thematic analysis, not a quantity fitted to data and then relabeled as a prediction. The design implications follow from participants' reported practices and stated preferences, which is standard qualitative inference rather than a self-definitional reduction. Self-citations (e.g., Arous et al. 2021, Kennard et al. 2022, Darrin et al. 2024, Kuang et al. 2024) appear only as background literature or as sources for prior AI-assisted review methods and wireframe rationales; none of these citations is used to justify the paper's load-bearing conclusions, and the paper does not invoke any uniqueness theorem or author-imported formalism to force its choices. The acknowledged limitation in Sect. 5.4 that participants do not represent the full diversity of venues is a generalizability concern, not a circularity concern: it weakens external validity without making the argument equivalent to its inputs. No fitted parameters, no equations, and no prediction-vs-input equivalence are present.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

No free parameters or invented entities; the central claim rests on assumptions about interview validity and design-probe realism.

assumptions (2)
  • domain assumption Self-reported descriptions of AC practices and challenges by interviewees are taken as accurate accounts of their actual behavior
    The findings rely on participants' recollections and perceptions during interviews (Section 3.2), with no observational or log-based validation.
  • domain assumption Static wireframes of AI tools are treated as a valid method to elicit realistic preferences about AI assistance
    Responses to paper prototypes (Section 3.2, Figure 2) are used to infer design implications, assuming reactions predict real-world tool use.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Hands-Off or Hands-On? Variation in Area Chair Practices and Implications for AI Support." pith.science (2026). https://pith.science/paper/ZY2RW5ZI

@misc{pith2026260807425,
  author       = {Pith},
  title        = {Pith review of: Hands-Off or Hands-On? Variation in Area Chair Practices and Implications for AI Support},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/ZY2RW5ZI}},
  note         = {Machine review of arXiv:2608.07425}
}
read the original abstract

Area chairs (ACs) play a critical role in the peer-review process, managing conflicts and ensuring fair outcomes. Although AI tools have been proposed to support ACs, little is known about the challenges they face and their perceptions of these technologies. In this paper, we conduct interviews including a design probe with 27 ACs in AI to explore their challenges, strategies, and perspectives on potential AI tools. Through thematic analysis, we identify key tensions arising from the growing volume of submissions, uneven reviewer expertise, and the complex task of managing the relationship between reviewers and authors. Most importantly, we find substantial variation in how ACs engage with submissions and influence outcomes: some adopt a largely hands-off approach, while others take a more hands-on role in guiding discussions and decisions. This variation challenges the notion of a single, universal AC practice and highlights the need to account for diverse approaches. When reflecting on the potential use of AI tools, ACs expressed a cautious stance, drawing on their domain knowledge and heightened awareness of AI limitations. From these findings, we derive three design implications: tailoring AI assistance to diverse AC practices, design assistance for discussion moderation, and embedding human-centered AI principles that preserve human agency in decision-making.

Figures

Figures reproduced from arXiv: 2608.07425 by the authors.

Figure 1
Figure 1. Demographics of the ACs we interviewed. Our [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. The wireframes shown to participants: (a) Argument labels: each argument within a review is associated with a [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Stated preference rankings for the wireframes presented (i. argument labels; ii. conformity to standards; iii. generated [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Initial version of the design wireframes: A) Visualization of arguments in each review by highlighting with a color [PITH_FULL_IMAGE:figures/full_fig_p018_4.png]
Figure 5
Figure 5. Figure 5: Design wireframes as shown to participants in our interviews. [PITH_FULL_IMAGE:figures/full_fig_p018_5.png]

Review history (2 revisions) →

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

235 extracted references · 38 canonical work pages

  1. [1]

    13th Annual International Conference on Learning Representations (ICLR) 2025 Fact Sheet

    Miley, Jill. 13th Annual International Conference on Learning Representations (ICLR) 2025 Fact Sheet

    2025

  2. [2]

    AAAI-26 Review Process Update: Scale, Integrity Measures, and Pathways to Sustainability

    AAAI. AAAI-26 Review Process Update: Scale, Integrity Measures, and Pathways to Sustainability

  3. [3]

    The Program Guide For The Eighth AAAI/ACM Conference on Artificial Intelligence Ethics & Society

    AIES. The Program Guide For The Eighth AAAI/ACM Conference on Artificial Intelligence Ethics & Society

  4. [4]

    Ellison, Meredith , month = may, year =

  5. [5]

    Choi, Seo-Yeon and Lee, Kyungsu , month = apr, year =. Human-. Proceedings of the 2026. doi:10.1145/3772318.3791754 , abstract =

    arXiv 2026

  6. [6]

    Proceedings of the AAAI Conference on Artificial Intelligence , author =

    Personalized. Proceedings of the AAAI Conference on Artificial Intelligence , author =. 2018 , keywords =. doi:10.1609/aaai.v32i1.11714 , abstract =

    doi:10.1609/aaai.v32i1.11714 2018

  7. [7]

    Rezk, Anna Marie , month = aug, year =. “. Proceedings of the 2023. doi:10.1145/3600211.3604761 , urldate =

    arXiv 2023

  8. [9]

    and Caterino, Jeffrey and Zhang, Ping and Wang, Dakuo , month = may, year =

    Zhang, Shao and Yu, Jianing and Xu, Xuhai and Yin, Changchang and Lu, Yuxuan and Yao, Bingsheng and Tory, Melanie and Padilla, Lace M. and Caterino, Jeffrey and Zhang, Ping and Wang, Dakuo , month = may, year =. Rethinking. Proceedings of the 2024. doi:10.1145/3613904.3642343 , abstract =

    arXiv 2024

Show all 235 references
  1. [10]

    ICLR 2025 , author =

    13th. ICLR 2025 , author =

    2025

  2. [11]

    and Taylor, Matthew E

    Biswas, Joydeep and Schoepp, Sheila and Vasan, Gautham and Opipari, Anthony and Zhang, Arthur and Hu, Zichao and Joseph, Sebastian and Lease, Matthew and Li, Junyi Jessy and Stone, Peter and Wagstaff, Kiri L. and Taylor, Matthew E. and Jenkins, Odest Chadwicke , month = apr, y...

    doi arXiv

  3. [14]

    Vera and Weisz, Justin D

    Ashktorab, Zahra and Jain, Mohit and Liao, Q. Vera and Weisz, Justin D. , month = may, year =. Resilient. Proceedings of the 2019. doi:10.1145/3290605.3300484 , abstract =

    2019

  4. [15]

    Knowledge-Based Systems , author =

    Wizard of. Knowledge-Based Systems , author =. 1993 , keywords =. doi:10.1016/0950-7051(93)90017-N , abstract =

    1993 doi

  5. [16]

    How probes work , isbn =

    Graham, Connor and Rouncefield, Mark and Gibbs, Martin and Vetere, Frank and Cheverst, Keith , month = nov, year =. How probes work , isbn =. Proceedings of the 19th. doi:10.1145/1324892.1324899 , abstract =

  6. [17]

    Designing and

    Yudhanto, Yudho and Pryhatyanto, Wahyu Mangantasno and Sulandari, Winita , month = aug, year =. Designing and. 2022 1st. doi:10.1109/APICS56469.2022.9918684 , abstract =

    2022

  7. [18]

    Disparate

    Green, Ben and Chen, Yiling , month = jan, year =. Disparate. Proceedings of the. doi:10.1145/3287560.3287563 , abstract =

  8. [19]

    Cheng, Hao-Fei and Stapleton, Logan and Kawakami, Anna and Sivaraman, Venkatesh and Cheng, Yanghuidi and Qing, Diana and Perer, Adam and Holstein, Kenneth and Wu, Zhiwei Steven and Zhu, Haiyi , month = apr, year =. How. doi:10.1145/3491102.3501831 , language =

  9. [20]

    Proceedings of the ACM on Human-Computer Interaction , author =

    The. Proceedings of the ACM on Human-Computer Interaction , author =. 2019 , pages =. doi:10.1145/3359152 , abstract =

    2019 doi

  10. [21]

    Development and translation of human-

    Hussain, Muhammad and Iacovides, Ioanna and Lawton, Tom and Sharma, Vishal and Porter, Zoe and Cunningham, Alice and Habli, Ibrahim and Hickey, Shireen and Jia, Yan and Morgan, Phillip and Wong, Nee Ling , month = jul, year =. Development and translation of human-. Designing. ...

  11. [23]

    and Ma, Ning F

    Biermann, Oloff C. and Ma, Ning F. and Yoon, Dongwook , month = jun, year =. From. Designing. doi:10.1145/3532106.3533506 , language =

  12. [24]

    Sandhaus, Hauke and Gu, Qiuquan and Parreira, Maria Teresa and Ju, Wendy , month = jul, year =. Co-. Proceedings of the 2025. doi:10.1145/3715336.3735805 , language =

    2025

  13. [25]

    Zaidi, Ali and Karahalios, Karrie , month = jul, year =. From. Proceedings of the 2025. doi:10.1145/3715336.3735778 , language =

    2025

  14. [26]

    Assisting

    Thakkar, Nitya and Yuksekgonul, Mert and Silberg, Jake and Zou, James , month = oct, year =. Assisting

  15. [27]

    Enhancing

    Kuang, Emily and Li, Minghao and Fan, Mingming and Shinohara, Kristen , month = may, year =. Enhancing. Proceedings of the. doi:10.1145/3613904.3642168 , language =

  16. [28]

    SIGMOD Rec

    Single- versus double-blind reviewing: an analysis of the literature , volume =. SIGMOD Rec. , author =. 2006 , pages =. doi:10.1145/1168092.1168094 , abstract =

    2006

  17. [29]

    and Liang, Percy and Vaughan, Jennifer Wortman , month = jun, year =

    Beygelzimer, Alina and Dauphin, Yann N. and Liang, Percy and Vaughan, Jennifer Wortman , month = jun, year =. Has the. doi:10.48550/arXiv.2306.03262 , abstract =

    doi arXiv

  18. [30]

    Facilitator's

    Kaner, Sam , month = apr, year =. Facilitator's

  19. [31]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Deliberating with. Proceedings of the ACM on Human-Computer Interaction , author =. 2023 , pages =. doi:10.1145/3579601 , abstract =

    2023 doi

  20. [32]

    and Lucero, AndréS and Oulasvirta, Antti , month = oct, year =

    Shin, Joongi and Hedderich, Michael A. and Lucero, AndréS and Oulasvirta, Antti , month = oct, year =. Chatbots. Proceedings of the 35th. doi:10.1145/3526113.3545671 , language =

  21. [34]

    Bot in the

    Kim, Soomin and Eun, Jinsu and Oh, Changhoon and Suh, Bongwon and Lee, Joonhwan , month = apr, year =. Bot in the. Proceedings of the 2020. doi:10.1145/3313831.3376785 , abstract =

    2020

  22. [35]

    Proceedings of the

    Han, Qiushi and Chen, Haitong and Fan, Haoxiang and Peng, Zhenhui , month = feb, year =. Proceedings of the. doi:10.1145/3629606.3629615 , abstract =

  23. [37]

    To. Proc. ACM Hum.-Comput. Interact. , author =. 2023 , pages =. doi:10.1145/3579532 , abstract =

    2023 doi

  24. [38]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Chatbot-based. Proceedings of the ACM on Human-Computer Interaction , author =. 2020 , pages =. doi:10.1145/3415189 , abstract =

    2020 doi

  25. [39]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Moderator. Proceedings of the ACM on Human-Computer Interaction , author =. 2021 , pages =. doi:10.1145/3449161 , abstract =

    2021 doi

  26. [40]

    Competent but

    Zheng, Chengbo and Wu, Yuheng and Shi, Chuhan and Ma, Shuai and Luo, Jiehui and Ma, Xiaojuan , month = apr, year =. Competent but. Proceedings of the 2023. doi:10.1145/3544548.3581131 , abstract =

    2023

  27. [41]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Analyzing the. Proceedings of the ACM on Human-Computer Interaction , author =. 2022 , pages =. doi:10.1145/3492837 , abstract =

    2022 doi

  28. [42]

    and McCoy, Thomas H

    Jacobs, Maia and Pradier, Melanie F. and McCoy, Thomas H. and Perlis, Roy H. and Doshi-Velez, Finale and Gajos, Krzysztof Z. , month = feb, year =. How machine-learning recommendations influence clinician treatment selections: the example of antidepressant selection , volume =...

    doi

  29. [44]

    Tankelevitch, Lev and Kewenig, Viktor and Simkute, Auste and Scott, Ava Elizabeth and Sarkar, Advait and Sellen, Abigail and Rintel, Sean , month = may, year =. The. Proceedings of the. doi:10.1145/3613904.3642902 , language =

  30. [45]

    Envisioning the

    Chen, Shiping and Brumby, Duncan and Cox, Anna , month = jun, year =. Envisioning the. Proceedings of the 4th. doi:10.1145/3729176.3729196 , abstract =

  31. [46]

    Beyond "

    Vitak, Jessica and Bruckman, Amy and Lampe, Cliff and Page, Xinru and Wong-Villacrés, Marisol , month = nov, year =. Beyond ". Companion. doi:10.1145/3678884.3689131 , language =

  32. [47]

    Consequences,

    Sturdee, Miriam and Lindley, Joseph and Linehan, Conor and Elsden, Chris and Kumar, Neha and Dillahunt, Tawanna and Mandryk, Regan and Vines, John , month = may, year =. Consequences,. Extended. doi:10.1145/3411763.3441330 , language =

  33. [48]

    Wilson, Max L and Nacke, Lennart , month = apr, year =. How to:. doi:10.1145/3491101.3503764 , language =

  34. [49]

    Corti, Lorenzo and Oltmans, Rembrandt and Jung, Jiwon and Balayn, Agathe and Wijsenbeek, Marlies and Yang, Jie , month = may, year =. ``. Proceedings of the. doi:10.1145/3613904.3642551 , language =

  35. [50]

    FEMS Microbiology Letters , author =

    The state of the art in peer review , volume =. FEMS Microbiology Letters , author =. 2018 , pages =. doi:10.1093/femsle/fny204 , abstract =

    2018 doi

  36. [51]

    Science and Public Policy , author =

    Peer-review procedures as practice, decision, and governance—the road to theories of peer review , volume =. Science and Public Policy , author =. 2024 , pages =. doi:10.1093/scipol/scad089 , abstract =

    2024 doi

  37. [52]

    Psychonomic Bulletin & Review , author =

    The subtlety of distinctiveness:. Psychonomic Bulletin & Review , author =. 1995 , keywords =. doi:10.3758/BF03214414 , abstract =

    1995 doi

  38. [55]

    Fok, Raymond and Kambhamettu, Hita and Soldaini, Luca and Bragg, Jonathan and Lo, Kyle and Hearst, Marti and Head, Andrew and Weld, Daniel S , month = mar, year =. Scim:. Proceedings of the 28th. doi:10.1145/3581641.3584034 , language =

  39. [56]

    Extended

    Han, Jiyeon and Park, Jimin and Huh, Jinyoung and Oh, Uran and Do, Jaeyoung and Kim, Daehee , month = may, year =. Extended. doi:10.1145/3613905.3650784 , language =

  40. [57]

    Pu, Kevin and Feng, K. J. Kevin and Grossman, Tovi and Hope, Tom and Dalvi Mishra, Bhavana and Latzke, Matt and Bragg, Jonathan and Chang, Joseph Chee and Siangliulue, Pao , month = apr, year =. Proceedings of the 2025. doi:10.1145/3706598.3714057 , language =

    2025

  41. [58]

    Proceedings of the 2023

    Zhang, Xiaoyu and Li, Jianping and Chi, Po-Wei and Chandrasegaran, Senthil and Ma, Kwan-Liu , month = apr, year =. Proceedings of the 2023. doi:10.1145/3544548.3581260 , language =

    2023

  42. [59]

    Norkute, Milda and Herger, Nadja and Michalak, Leszek and Mulder, Andrew and Gao, Sally , month = may, year =. Towards. Extended. doi:10.1145/3411763.3443441 , language =

  43. [60]

    Liao, Zhehui and Antoniak, Maria and Cheong, Inyoung and Cheng, Evie Yu-Yen and Lee, Ai-Heng and Lo, Kyle and Chang, Joseph Chee and Zhang, Amy X , year =

  44. [61]

    AI & SOCIETY , author =

    Friend or foe?. AI & SOCIETY , author =. 2025 , keywords =. doi:10.1007/s00146-023-01791-1 , abstract =

    2025 doi

  45. [62]

    2024 , eprint=

    What Can Natural Language Processing Do for Peer Review? , author=. 2024 , eprint=

    2024

  46. [63]

    Scientific

    Zeng, Qi and Sidhu, Mankeerat and Blume, Ansel and Chan, Hou Pong and Wang, Lu and Ji, Heng , editor =. Scientific. Artificial. 2025 , keywords =. doi:10.1007/978-981-97-9536-9_2 , abstract =

    2025 doi

  47. [64]

    Li, Miao and Lau, Jey Han and Hovy, Eduard , editor =. A. Proceedings of the 62nd. 2024 , pages =. doi:10.18653/v1/2024.acl-long.547 , abstract =

    2024 doi

  48. [65]

    Proceedings of the 62nd

    Darrin, Maxime and Arous, Ines and Piantanida, Pablo and Cheung, Jackie , editor =. Proceedings of the 62nd. 2024 , pages =. doi:10.18653/v1/2024.acl-long.688 , abstract =

    2024 doi

  49. [66]

    What’s the

    Lyons, Henrietta and Wijenayake, Senuri and Miller, Tim and Velloso, Eduardo , month = apr, year =. What’s the. doi:10.1145/3491102.3517606 , language =

  50. [67]

    Behavioral Ecology and Sociobiology , author =

    Peer-review reciprocity and commitment to manuscript evaluation , volume =. Behavioral Ecology and Sociobiology , author =. 2019 , pages =. doi:10.1007/s00265-019-2647-2 , language =

    2019 doi

  51. [68]

    Juxtapeer:

    Cambre, Julia and Klemmer, Scott and Kulkarni, Chinmay , month = apr, year =. Juxtapeer:. Proceedings of the 2018. doi:10.1145/3173574.3173868 , language =

    2018

  52. [69]

    Möbius, Michael and Kallfass, Daniel and Doll, Thomas and Kunde, Dietmar , month = dec, year =. 2022. doi:10.1109/WSC57314.2022.10015234 , abstract =

    2022

  53. [70]

    Assessing the

    Levy, Ariel and Agrawal, Monica and Satyanarayan, Arvind and Sontag, David , month = may, year =. Assessing the. Proceedings of the 2021. doi:10.1145/3411764.3445522 , abstract =

    2021

  54. [72]

    Empathosphere:. Proc. ACM Hum.-Comput. Interact. , author =. 2022 , pages =. doi:10.1145/3512902 , abstract =

    2022 doi

  55. [73]

    ACM Hum.-Comput

    Proc. ACM Hum.-Comput. Interact. , author =. 2020 , pages =. doi:10.1145/3415240 , abstract =

    2020 doi

  56. [74]

    and Gerber, Elizabeth and Bailey, Brian P

    Yen, Yu-Chun Grace and Dow, Steven P. and Gerber, Elizabeth and Bailey, Brian P. , month = jun, year =. Listen to. Proceedings of the 2017. doi:10.1145/3059454.3059468 , abstract =

    2017

  57. [75]

    Uncovering

    Lee, Wanhae and Kwon, Minji and Hyun, Yewon and Lee, Jihyun and Gwon, Joonho and Jung, Hyunggu , month = apr, year =. Uncovering. Proceedings of the 2020. doi:10.1145/3391203.3391218 , language =

    2020

  58. [76]

    and Fraser, C

    Ngoon, Tricia J. and Fraser, C. Ailie and Weingarten, Ariel S. and Dontcheva, Mira and Klemmer, Scott , month = apr, year =. Interactive. Proceedings of the 2018. doi:10.1145/3173574.3173629 , language =

    2018

  59. [77]

    and Bailey, Brian P

    Yen, Yu-Chun Grace and Kim, Joy O. and Bailey, Brian P. , month = apr, year =. Decipher:. Proceedings of the 2020. doi:10.1145/3313831.3376380 , abstract =

    2020

  60. [78]

    Understanding and

    Yang, Chi-Lan and Uhde, Alarith and Yamashita, Naomi and Kuzuoka, Hideaki , month = apr, year =. Understanding and. Proceedings of the 2025. doi:10.1145/3706598.3713219 , abstract =

    2025

  61. [79]

    and Pandey, Vineet and Fraser, C

    Hicks, Catherine M. and Pandey, Vineet and Fraser, C. Ailie and Klemmer, Scott , month = may, year =. Framing. Proceedings of the 2016. doi:10.1145/2858036.2858195 , language =

    2016

  62. [80]

    Hecht, Brent and Wilcox, Lauren and Bigham, Jeffrey P. and Schöning, Johannes and Hoque, Ehsan and Ernst, Jason and Bisk, Yonatan and Russis, Luigi De and Yarosh, Lana and Anjum, Bushra and Contractor, Danish and Wu, Cathy , month = dec, year =. It's. doi:10.48550/arXiv.2112.0...

    doi arXiv

  63. [81]

    and Hearst, Marti A

    Head, Andrew and Lo, Kyle and Kang, Dongyeop and Fok, Raymond and Skjonsberg, Sam and Weld, Daniel S. and Hearst, Marti A. , month = may, year =. Augmenting. Proceedings of the 2021. doi:10.1145/3411764.3445648 , abstract =

    2021

  64. [82]

    Jansen, Yvonne and Hornbæk, Kasper and Dragicevic, Pierre , month = may, year =. What. Proceedings of the 2016. doi:10.1145/2851581.2892576 , abstract =

    2016

  65. [84]

    and Bragg, Jonathan and Head, Andrew and Lo, Kyle and Downey, Doug and Weld, Daniel S

    Chang, Joseph Chee and Zhang, Amy X. and Bragg, Jonathan and Head, Andrew and Lo, Kyle and Downey, Doug and Weld, Daniel S. , month = apr, year =. Proceedings of the 2023. doi:10.1145/3544548.3580847 , language =

    2023

  66. [85]

    , month = mar, year =

    Sun, Lu and Chan, Aaron and Chang, Yun Seo and Dow, Steven P. , month = mar, year =. Proceedings of the 29th. doi:10.1145/3640543.3645159 , language =

  67. [86]

    2024 , pages =

    Proceedings of the ACM on Human-Computer Interaction , author =. 2024 , pages =. doi:10.1145/3637371 , abstract =

    2024 doi

  68. [87]

    and Reddy, Madhu C

    McNeese, Nathan J. and Reddy, Madhu C. and Friedenberg, Evan M. , month = sep, year =. Towards a. Proceedings of the Human Factors and Ergonomics Society Annual Meeting , publisher =. doi:10.1177/1541931214581069 , abstract =

    doi

  69. [88]

    What defines 'enough' information?

  70. [89]

    Proceedings of the AAAI Conference on Artificial Intelligence , author =

    The. Proceedings of the AAAI Conference on Artificial Intelligence , author =. 2013 , pages =. doi:10.1609/aaai.v27i1.8461 , abstract =

    2013 doi

  71. [90]

    , month = jan, year =

    Gallus, Jana and Frey, Bruno S. , month = jan, year =. Awards as. Journal of Management Inquiry , publisher =. doi:10.1177/1056492616658127 , abstract =

    doi

  72. [91]

    Mentorship

    Brockmeyer, Brad , month = mar, year =. Mentorship

  73. [92]

    Medium , author =

    3,000+. Medium , author =

  74. [93]

    Consideration of

    Pradhan, Anjalina , month = jan, year =. Consideration of. Journal of Convention & Event Tourism , publisher =. doi:10.1080/15470148.2013.871211 , abstract =

    2013

  75. [94]

    Comparing paid and volunteer recruitment in human computation games , isbn =

    Sarkar, Anurag and Cooper, Seth , month = aug, year =. Comparing paid and volunteer recruitment in human computation games , isbn =. Proceedings of the 13th. doi:10.1145/3235765.3235796 , language =

  76. [95]

    Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , author =

    Volunteering. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , author =. 2013 , keywords =. doi:10.1609/hcomp.v1i1.13075 , abstract =

    2013 doi

  77. [96]

    Announcing

    Chen, Nancy , month = apr, year =. Announcing

  78. [97]

    Complimenting. Proc. ACM Hum.-Comput. Interact. , author =. 2018 , pages =. doi:10.1145/3274365 , abstract =

    2018 doi

  79. [98]

    Thomas, Lisa and Pritchard, Gary and Briggs, Pam , month = jun, year =. Digital. Proceedings of the 9th. doi:10.1145/3328320.3328368 , abstract =

  80. [99]

    Englert, Benedikt and Thaler, Julia and Helmig, Bernd , month = apr, year =. Fit. Nonprofit and Voluntary Sector Quarterly , publisher =. doi:10.1177/0899764019872005 , abstract =

    doi

  81. [100]

    Human Resource Management Journal , author =

    Learning and development opportunities as a tool for the retention of volunteers:. Human Resource Management Journal , author =. doi:10.1111/1748-8583.12040 , abstract =

  82. [101]

    Volunteer

    Hager, Mark and Brudney, Jeffrey , month = jan, year =. Volunteer

  83. [102]

    Implementation science: IS , author =

    What hinders the uptake of computerized decision support systems in hospitals?. Implementation science: IS , author =. 2017 , keywords =. doi:10.1186/s13012-017-0644-2 , abstract =

    2017 doi

  84. [103]

    Computer Supported Cooperative Work (CSCW) , author =

    Encoding. Computer Supported Cooperative Work (CSCW) , author =. 2021 , keywords =. doi:10.1007/s10606-021-09407-2 , abstract =

    2021 doi

  85. [104]

    Ma, Shuai and Wang, Xinru and Lei, Ying and Shi, Chuhan and Yin, Ming and Ma, Xiaojuan , month = may, year =. “. Proceedings of the. doi:10.1145/3613904.3642671 , language =

  86. [106]

    Journal of Social Service Research , author =

    Attitudes, motives, and demographic predictors of volunteer commitment and service duration , volume =. Journal of Social Service Research , author =. 1991 , pages =. doi:10.1300/J079v14n03_07 , abstract =

    1991 doi

  87. [107]

    PS: Political Science & Politics , author =

    Reviewer. PS: Political Science & Politics , author =. 2015 , pages =. doi:10.1017/S1049096515000827 , abstract =

    2015 doi

  88. [108]

    BMJ Open , author =

    Perspectives on involvement in the peer-review process: surveys of patient and public reviewers at two journals , volume =. BMJ Open , author =. 2018 , pages =. doi:10.1136/bmjopen-2018-023357 , abstract =

    2018 doi

  89. [109]

    Assessment & Evaluation in Higher Education , author =

    Student attitudes that predict participation in peer assessment , volume =. Assessment & Evaluation in Higher Education , author =. 2018 , pages =. doi:10.1080/02602938.2017.1409872 , abstract =

    2018

  90. [110]

    Nonprofit Management and Leadership , author =

    “. Nonprofit Management and Leadership , author =. 2019 , pages =. doi:10.1002/nml.21344 , abstract =

    2019 doi

  91. [111]

    Thematic

    Braun, Virginia and Clarke, Victoria , month = oct, year =. Thematic

  92. [113]

    and Reddy, Madhu , month = apr, year =

    Wong, Novia and Jackson, Victoria and Van Der Hoek, André and Ahmed, Iftekhar and Schueller, Stephen M. and Reddy, Madhu , month = apr, year =. Mental. Proceedings of the 2023. doi:10.1145/3544548.3581528 , language =

    2023

  93. [114]

    Computer Supported Cooperative Work (CSCW) , author =

    Telehealth in. Computer Supported Cooperative Work (CSCW) , author =. 2007 , keywords =. doi:10.1007/s10606-006-9030-3 , abstract =

    2007 doi

  94. [115]

    BMC Health Services Research , author =

    High workload and job stress are associated with lower practice performance in general practice: an observational study in 239 general practices in the. BMC Health Services Research , author =. 2009 , keywords =. doi:10.1186/1472-6963-9-118 , abstract =

    2009 doi

  95. [116]

    Computer Supported Cooperative Work (CSCW) , author =

    From. Computer Supported Cooperative Work (CSCW) , author =. 2018 , keywords =. doi:10.1007/s10606-018-9315-3 , abstract =

    2018 doi

  96. [117]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Motivated to. Proceedings of the ACM on Human-Computer Interaction , author =. 2022 , pages =. doi:10.1145/3555121 , abstract =

    2022 doi

  97. [118]

    Neustaedter, Carman and Venolia, Gina and Procyk, Jason and Hawkins, Daniel , month = feb, year =. To. Proceedings of the 19th. doi:10.1145/2818048.2819922 , language =

  98. [119]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Learning to. Proceedings of the ACM on Human-Computer Interaction , author =. 2019 , pages =. doi:10.1145/3359330 , abstract =

    2019 doi

  99. [120]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Design and. Proceedings of the ACM on Human-Computer Interaction , author =. 2021 , pages =. doi:10.1145/3449219 , abstract =

    2021 doi

  100. [121]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Understanding. Proceedings of the ACM on Human-Computer Interaction , author =. 2021 , pages =. doi:10.1145/3449203 , abstract =

    2021 doi

  101. [122]

    Proceedings of the ACM on Human-Computer Interaction , author =

    ". Proceedings of the ACM on Human-Computer Interaction , author =. 2023 , pages =. doi:10.1145/3579545 , abstract =

    2023 doi

  102. [123]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Marginalization and the. Proceedings of the ACM on Human-Computer Interaction , author =. 2023 , pages =. doi:10.1145/3610195 , abstract =

    2023 doi

  103. [124]

    Proceedings of the ACM on Human-Computer Interaction , author =

    From. Proceedings of the ACM on Human-Computer Interaction , author =. 2021 , pages =. doi:10.1145/3479508 , abstract =

    2021 doi

  104. [125]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Cultivating. Proceedings of the ACM on Human-Computer Interaction , author =. 2023 , pages =. doi:10.1145/3610185 , abstract =

    2023 doi

  105. [126]

    Proceedings of the ACM on Human-Computer Interaction , author =

    What. Proceedings of the ACM on Human-Computer Interaction , author =. 2022 , pages =. doi:10.1145/3555124 , abstract =

    2022 doi

  106. [127]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Technological. Proceedings of the ACM on Human-Computer Interaction , author =. 2019 , pages =. doi:10.1145/3359146 , abstract =

    2019 doi

  107. [128]

    Proceedings of the ACM on Human-Computer Interaction , author =

    ". Proceedings of the ACM on Human-Computer Interaction , author =. 2020 , pages =. doi:10.1145/3415176 , abstract =

    2020 doi

  108. [129]

    Learning to summarize with human feedback , volume =

    Stiennon, Nisan and Ouyang, Long and Wu, Jeffrey and Ziegler, Daniel and Lowe, Ryan and Voss, Chelsea and Radford, Alec and Amodei, Dario and Christiano, Paul F , year =. Learning to summarize with human feedback , volume =. Advances in

  109. [130]

    Improving

    Liang, Xinnian and Wu, Shuangzhi and Li, Mu and Li, Zhoujun , year =. Improving. Findings of the. doi:10.18653/v1/2021.findings-acl.147 , abstract =

    2021 doi

  110. [131]

    Characterizing

    Rahman, Sajjadur and Kandogan, Eser , month = apr, year =. Characterizing. doi:10.1145/3491102.3502068 , language =

  111. [132]

    Maxwell and Zhu, Haiyi , month = may, year =

    Cheng, Hao-Fei and Wang, Ruotong and Zhang, Zheng and O'Connell, Fiona and Gray, Terrance and Harper, F. Maxwell and Zhu, Haiyi , month = may, year =. Explaining. Proceedings of the 2019. doi:10.1145/3290605.3300789 , language =

    2019

  112. [135]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Understanding the. Proceedings of the ACM on Human-Computer Interaction , author =. 2021 , pages =. doi:10.1145/3479552 , abstract =

    2021 doi

  113. [136]

    Know your limits:

    Ulmer, Dennis and Cinà, Giovanni , month = dec, year =. Know your limits:. Proceedings of the

  114. [137]

    Studies in health technology and informatics , author =

    Physicians'. Studies in health technology and informatics , author =. 2015 , pages =

    2015

  115. [138]

    Journal of the American Medical Informatics Association : JAMIA , author =

    Automation bias and verification complexity: a systematic review , volume =. Journal of the American Medical Informatics Association : JAMIA , author =. 2017 , pages =. doi:10.1093/jamia/ocw105 , abstract =

    2017 doi

  116. [139]

    Faggioli, Guglielmo and Dietz, Laura and Clarke, Charles L. A. and Demartini, Gianluca and Hagen, Matthias and Hauff, Claudia and Kando, Noriko and Kanoulas, Evangelos and Potthast, Martin and Stein, Benno and Wachsmuth, Henning , month = aug, year =. Perspectives on. Proceedi...

    2023

  117. [140]

    Conference companion on

    Grudin, Jonathan and Poltrock, Steven , year =. Conference companion on. doi:10.1145/257089.257357 , language =

  118. [141]

    and Grabski, Severin V

    Cook, Gary J. and Grabski, Severin V. , year =. An empirical examination of software-mediated information exchange and communication richness , url =. Posters and short talks of the 1992. doi:10.1145/1125021.1125064 , language =

    1992

  119. [142]

    Intelligent Systems in Accounting, Finance and Management , author =

    A. Intelligent Systems in Accounting, Finance and Management , author =. 1995 , pages =. doi:10.1002/j.1099-1174.1995.tb00079.x , language =

    1995

  120. [143]

    Decision Support Systems , author =

    Distributed artificial intelligence for group decision support:. Decision Support Systems , author =. 1993 , keywords =. doi:10.1016/0167-9236(93)90046-6 , abstract =

    1993 doi

  121. [144]

    Annals of the New York Academy of Sciences , author =

    Group decision making under uncertain preferences: powered by. Annals of the New York Academy of Sciences , author =. 2022 , pages =. doi:10.1111/nyas.14734 , abstract =

    2022 doi

  122. [145]

    Evaluation and Program Planning , author =

    Using the. Evaluation and Program Planning , author =. 2010 , keywords =. doi:10.1016/j.evalprogplan.2009.06.006 , abstract =

    2010 doi

  123. [146]

    Thomopoulos, Rallou and Cufi, Julien and Breton, Maxime Le , month = sep, year =. A

  124. [147]

    European Journal of Operational Research , author =

    A framework for group decision support systems:. European Journal of Operational Research , author =. 1997 , pages =. doi:10.1016/S0377-2217(97)00126-4 , abstract =

    1997 doi

  125. [148]

    Vazhentsev, Artem and Kuzmin, Gleb and Tsvigun, Akim and Panchenko, Alexander and Panov, Maxim and Burtsev, Mikhail and Shelmanov, Artem , month = jul, year =. Hybrid. Proceedings of the 61st. doi:10.18653/v1/2023.acl-long.652 , abstract =

    2023 doi

  126. [149]

    Humanities and Social Sciences Communications , publisher =

    Checco, Alessandro and Bracciale, Lorenzo and Loreti, Pierpaolo and Pinfield, Stephen and Bianchi, Giuseppe , month = jan, year =. Humanities and Social Sciences Communications , publisher =. doi:10.1057/s41599-020-00703-8 , abstract =

    doi

  127. [150]

    Science and Engineering Ethics , author =

    Ensuring the. Science and Engineering Ethics , author =. 2016 , keywords =. doi:10.1007/s11948-015-9625-5 , abstract =

    2016 doi

  128. [151]

    Maxwell and Zhu, Haiyi , month = apr, year =

    Wang, Ruotong and Harper, F. Maxwell and Zhu, Haiyi , month = apr, year =. Factors. Proceedings of the 2020. doi:10.1145/3313831.3376813 , abstract =

    2020

  129. [152]

    Park, Sungjin and Ryu, Seungwoo and Choi, Edward , month = dec, year =. Do. Findings of the. doi:10.18653/v1/2022.findings-emnlp.128 , abstract =

    2022 doi

  130. [153]

    Harnessing

    Yang, Qian and Hao, Yuexing and Quan, Kexin and Yang, Stephen and Zhao, Yiran and Kuleshov, Volodymyr and Wang, Fei , month = apr, year =. Harnessing. Proceedings of the 2023. doi:10.1145/3544548.3581393 , language =

    2023

  131. [154]

    ACM SIGKDD Explorations Newsletter , author =

    Novel tools to streamline the conference review process: experiences from. ACM SIGKDD Explorations Newsletter , author =. 2010 , pages =. doi:10.1145/1809400.1809413 , abstract =

    2010

  132. [155]

    Investigating

    Zhang, Jiayao and Zhang, Hongming and Deng, Zhun and Roth, Dan , month = nov, year =. Investigating

  133. [156]

    User rankings from comparisons:

    Mitliagkas, Ioannis and Gopalan, Aditya and Caramanis, Constantine and Vishwanath, Sriram , month = sep, year =. User rankings from comparisons:. 2011 49th. doi:10.1109/Allerton.2011.6120296 , abstract =

    2011

  134. [157]

    Communications of the ACM , author =

    The arbitrariness of reviews, and advice for school administrators , volume =. Communications of the ACM , author =. 2015 , pages =. doi:10.1145/2732417 , abstract =

    2015 doi

  135. [158]

    The glass ceiling in

    Schluter, Natalie , year =. The glass ceiling in. Proceedings of the 2018. doi:10.18653/v1/D18-1301 , abstract =

    2018 doi

  136. [159]

    Communications of the ACM , author =

    Gender trends in computer science authorship , volume =. Communications of the ACM , author =. 2021 , pages =. doi:10.1145/3430803 , abstract =

    2021 doi

  137. [160]

    Journal of Artificial Intelligence Research , author =

    Can. Journal of Artificial Intelligence Research , author =. 2022 , keywords =. doi:10.1613/jair.1.12862 , abstract =

    2022 doi

  138. [161]

    2023 , keywords =

    IEEE Access , author =. 2023 , keywords =. doi:10.1109/ACCESS.2022.3224019 , abstract =

    2023

  139. [162]

    Learned Publishing , author =

    Artificial intelligence to support publishing and peer review:. Learned Publishing , author =. 2023 , pages =. doi:10.1002/leap.1570 , abstract =

    2023 doi

  140. [163]

    Information Fusion , author =

    Automated scholarly paper review:. Information Fusion , author =. 2023 , pages =. doi:10.1016/j.inffus.2023.101830 , language =

    2023

  141. [164]

    ACM Transactions on Information Systems , author =

    A. ACM Transactions on Information Systems , author =. 2020 , pages =. doi:10.1145/3361719 , abstract =

    2020 doi

  142. [165]

    Ask not what

    Lubars, Brian and Tan, Chenhao , year =. Ask not what. Advances in

  143. [166]

    Cultural Studies of Science Education , author =

    Editorial:. Cultural Studies of Science Education , author =. 2006 , pages =. doi:10.1007/s11422-006-9024-y , language =

    2006 doi

  144. [167]

    Proceedings of the 61st

    Dycke, Nils and Kuznetsov, Ilia and Gurevych, Iryna , month = jul, year =. Proceedings of the 61st. doi:10.18653/v1/2023.acl-long.277 , abstract =

    2023 doi

  145. [169]

    Proceedings of the 57th

    Ghosal, Tirthankar and Verma, Rajeev and Ekbal, Asif and Bhattacharyya, Pushpak , month = jul, year =. Proceedings of the 57th. doi:10.18653/v1/P19-1106 , abstract =

    doi

  146. [170]

    Incorporating

    Darvishi, Ali and Khosravi, Hassan and Abdi, Solmaz and Sadiq, Shazia and Gašević, Dragan , month = jun, year =. Incorporating. Proceedings of the. doi:10.1145/3491140.3528265 , abstract =

  147. [171]

    BMJ Open , author =

    Journal editors’ perspectives on the communication practices in biomedical journals: a qualitative study , volume =. BMJ Open , author =. 2020 , keywords =. doi:10.1136/bmjopen-2019-035600 , abstract =

    2020 doi

  148. [172]

    Summarizing Multiple Documents with Conversational Structure for Meta-Review Generation

    Li, Miao and Hovy, Eduard and Lau, Jey. Summarizing Multiple Documents with Conversational Structure for Meta-Review Generation. Findings of the Association for Computational Linguistics: EMNLP 2023. 2023. doi:10.18653/v1/2023.findings-emnlp.472

    2023 doi

  149. [173]

    Computational Linguistics , author =

    Revise and. Computational Linguistics , author =. 2022 , pages =. doi:10.1162/coli_a_00455 , abstract =

    2022 doi

  150. [174]

    ACM SIGMOD Record , author =

    The. ACM SIGMOD Record , author =. 2019 , pages =. doi:10.1145/3377330.3377340 , abstract =

    2019

  151. [175]

    Kang, Dongyeop and Ammar, Waleed and Dalvi, Bhavana and van Zuylen, Madeleine and Kohlmeier, Sebastian and Hovy, Eduard and Schwartz, Roy , month = jun, year =. A. Proceedings of the 2018. doi:10.18653/v1/N18-1149 , abstract =

    2018 doi

  152. [176]

    Bharti, Prabhat Kumar and Ranjan, Shashi and Ghosal, Tirthankar and Agrawal, Mayank and Ekbal, Asif , editor =. Towards. 2021 , keywords =. doi:10.1007/978-3-030-91669-5_33 , abstract =

    2021 doi

  153. [177]

    2021 , pages =

    Journal of Cases on Information Technology , author =. 2021 , pages =. doi:10.4018/JCIT.2021010101 , abstract =

    2021 doi

  154. [179]

    doi:10.1080/08989621003791945 , language =

    Quality and. doi:10.1080/08989621003791945 , language =

    doi

  155. [180]

    Women and Birth , author =

    The journal editor:. Women and Birth , author =. 2015 , keywords =. doi:10.1016/j.wombi.2015.01.008 , abstract =

    2015 doi

  156. [181]

    BMC Medicine , author =

    A scoping review of competencies for scientific editors of biomedical journals , volume =. BMC Medicine , author =. 2016 , keywords =. doi:10.1186/s12916-016-0561-2 , abstract =

    2016 doi

  157. [182]

    Koch, Janin and Lucero, Andrés and Hegemann, Lena and Oulasvirta, Antti , month = may, year =. May. Proceedings of the 2019. doi:10.1145/3290605.3300863 , abstract =

    2019

  158. [183]

    , month = oct, year =

    D’Andrea, Rafael and O’Dwyer, James P. , month = oct, year =. Can editors save peer review from peer reviewers? , volume =. PLOS ONE , publisher =. doi:10.1371/journal.pone.0186111 , abstract =

    doi

  159. [184]

    Twitter , author =

    We're excited to share that the reviews for \#. Twitter , author =

  160. [185]

    Accounting and Finance , author =

    Impact of intelligent decision aids on expert and novice decision-makers' judgments , volume =. Accounting and Finance , author =. 2004 , pages =. doi:10.1111/j.1467-629x.2004.00099.x , language =

    2004 arXiv

  161. [186]

    Journal of Experimental Psychology

    Algorithm aversion: people erroneously avoid algorithms after seeing them err , volume =. Journal of Experimental Psychology. General , author =. 2015 , keywords =. doi:10.1037/xge0000033 , abstract =

    2015 doi

  162. [187]

    and Kellogg, Wendy A

    Zhang, Yunfeng and Bellamy, Rachel K.E. and Kellogg, Wendy A. , month = apr, year =. Designing. Proceedings of the 33rd. doi:10.1145/2702123.2702239 , language =

  163. [188]

    npj Digital Medicine , author =

    An overview of clinical decision support systems: benefits, risks, and strategies for success , volume =. npj Digital Medicine , author =. 2020 , keywords =. doi:10.1038/s41746-020-0221-y , abstract =

    2020 doi

  164. [189]

    Customization bias in decision support systems , isbn =

    Solomon, Jacob , month = apr, year =. Customization bias in decision support systems , isbn =. Proceedings of the. doi:10.1145/2556288.2557211 , language =

  165. [191]

    Hazard analysis for human-on-the-loop interactions in

    Vierhauser, Michael and Islam, Md Nafee Al and Agrawal, Ankit and Cleland-Huang, Jane and Mason, James , month = aug, year =. Hazard analysis for human-on-the-loop interactions in. Proceedings of the 29th. doi:10.1145/3468264.3468534 , language =

  166. [192]

    IEEE Systems, Man, and Cybernetics Magazine , author =

    Trusted. IEEE Systems, Man, and Cybernetics Magazine , author =. 2017 , keywords =. doi:10.1109/MSMC.2016.2623867 , abstract =

    2017

  167. [193]

    De-Arteaga, Maria and Fogliato, Riccardo and Chouldechova, Alexandra , month = apr, year =. A. Proceedings of the 2020. doi:10.1145/3313831.3376638 , language =

    2020

  168. [194]

    and Grgić-Hlača, Nina , month = apr, year =

    Langer, Markus and Hunsicker, Tim and Feldkamp, Tina and König, Cornelius J. and Grgić-Hlača, Nina , month = apr, year =. “. doi:10.1145/3491102.3517527 , language =

  169. [195]

    Human intervention in automated decision-making:

    Almada, Marco , month = jun, year =. Human intervention in automated decision-making:. Proceedings of the. doi:10.1145/3322640.3326699 , language =

  170. [197]

    Reviewable

    Cobbe, Jennifer and Lee, Michelle Seng Ah and Singh, Jatinder , month = mar, year =. Reviewable. Proceedings of the 2021. doi:10.1145/3442188.3445921 , language =

    2021

  171. [198]

    Contestable

    Alfrink, Kars and Keller, Ianus and Doorn, Neelke and Kortuem, Gerd , month = apr, year =. Contestable. Proceedings of the 2023. doi:10.1145/3544548.3580984 , language =

    2023

  172. [199]

    Medical Physics , author =

    Computer‐aided diagnosis in the era of deep learning , volume =. Medical Physics , author =. doi:10.1002/mp.13764 , abstract =

    doi

  173. [200]

    Medium , author =

    \#. Medium , author =

  174. [201]

    Fairness and

    Veale, Michael and Van Kleek, Max and Binns, Reuben , month = apr, year =. Fairness and. Proceedings of the 2018. doi:10.1145/3173574.3174014 , language =

    2018

  175. [202]

    Pradier, Melanie and Lam, Barbara and Ahn, Andrew C

    Jacobs, Maia and He, Jeffrey and F. Pradier, Melanie and Lam, Barbara and Ahn, Andrew C. and McCoy, Thomas H. and Perlis, Roy H. and Doshi-Velez, Finale and Gajos, Krzysztof Z. , month = may, year =. Designing. Proceedings of the 2021. doi:10.1145/3411764.3445385 , language =

    2021

  176. [203]

    McConvey, Kelly and Guha, Shion and Kuzminykh, Anastasia , month = apr, year =. A. Proceedings of the 2023. doi:10.1145/3544548.3580658 , language =

    2023

  177. [204]

    Ma, Shuai and Lei, Ying and Wang, Xinru and Zheng, Chengbo and Shi, Chuhan and Yin, Ming and Ma, Xiaojuan , month = apr, year =. Who. Proceedings of the 2023. doi:10.1145/3544548.3581058 , abstract =

    2023

  178. [205]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Toward. Proceedings of the ACM on Human-Computer Interaction , author =. 2023 , keywords =. doi:10.1145/3579628 , abstract =

    2023 doi

  179. [206]

    Fogliato, Riccardo and Chappidi, Shreya and Lungren, Matthew and Fisher, Paul and Wilson, Diane and Fitzke, Michael and Parkinson, Mark and Horvitz, Eric and Inkpen, Kori and Nushi, Besmira , month = jun, year =. Who. Proceedings of the 2022. doi:10.1145/3531146.3533193 , abstract =

    2022

  180. [207]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Human. Proceedings of the ACM on Human-Computer Interaction , author =. 2019 , keywords =. doi:10.1145/3359280 , abstract =

    2019 doi

  181. [208]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Crossmod:. Proceedings of the ACM on Human-Computer Interaction , author =. 2019 , keywords =. doi:10.1145/3359276 , abstract =

    2019 doi

  182. [209]

    Proceedings of the ACM on Human-Computer Interaction , author =

    ``. Proceedings of the ACM on Human-Computer Interaction , author =. 2019 , keywords =. doi:10.1145/3359206 , abstract =

    2019 doi

  183. [210]

    Does the

    Bansal, Gagan and Wu, Tongshuang and Zhou, Joyce and Fok, Raymond and Nushi, Besmira and Kamar, Ece and Ribeiro, Marco Tulio and Weld, Daniel , month = may, year =. Does the. Proceedings of the 2021. doi:10.1145/3411764.3445717 , abstract =

    2021

  184. [211]

    Proceedings of the ACM on Human-Computer Interaction , author =

    To. Proceedings of the ACM on Human-Computer Interaction , author =. 2021 , keywords =. doi:10.1145/3449287 , abstract =

    2021 doi

  185. [212]

    Hayashi, Yugo and Wakabayashi, Kosuke , month = feb, year =. Can. Companion of the 2017. doi:10.1145/3022198.3026338 , abstract =

    2017

  186. [213]

    Improving

    Kawakami, Anna and Sivaraman, Venkatesh and Cheng, Hao-Fei and Stapleton, Logan and Cheng, Yanghuidi and Qing, Diana and Perer, Adam and Wu, Zhiwei Steven and Zhu, Haiyi and Holstein, Kenneth , month = apr, year =. Improving. Proceedings of the 2022. doi:10.1145/3491102.351743...

    2022

  187. [214]

    Walking on

    He, Gaole and Gadiraju, Ujwal , year =. Walking on

  188. [215]

    Proceedings of the ACM on Human-Computer Interaction , author =

    Evaluating the. Proceedings of the ACM on Human-Computer Interaction , author =. 2023 , keywords =. doi:10.1145/3579481 , abstract =

    2023 doi

  189. [216]

    Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , author =

    Impact of. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , author =. 2020 , pages =. doi:10.1609/hcomp.v8i1.7462 , abstract =

    2020 doi

  190. [217]

    Explainable

    Miller, Tim , month = jun, year =. Explainable. Proceedings of the 2023. doi:10.1145/3593013.3594001 , abstract =

    2023

  191. [218]

    Salimzadeh, Sara and He, Gaole and Gadiraju, Ujwal , month = jun, year =. A. Proceedings of the 31st. doi:10.1145/3565472.3592959 , abstract =

  192. [219]

    Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , author =

    The. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , author =. 2019 , pages =. doi:10.1609/hcomp.v7i1.5284 , abstract =

    2019 doi

  193. [220]

    Emerging trends:

    Church, Kenneth Ward , month = mar, year =. Emerging trends:. Natural Language Engineering , publisher =. doi:10.1017/S1351324920000030 , abstract =

    doi

  194. [221]

    Proceedings of the VLDB Endowment , author =

    A topic-based reviewer assignment system , volume =. Proceedings of the VLDB Endowment , author =. 2015 , pages =. doi:10.14778/2824032.2824084 , abstract =

    2015

  195. [222]

    and Nielsen, Jakob , year =

    Dumais, Susan T. and Nielsen, Jakob , year =. Automating the assignment of submitted manuscripts to reviewers , isbn =. Proceedings of the 15th annual international. doi:10.1145/133160.133205 , language =

  196. [223]

    Kobren, Ari and Saha, Barna and McCallum, Andrew , month = jul, year =. Paper. Proceedings of the 25th. doi:10.1145/3292500.3330899 , language =

  197. [224]

    Integrating the

    Jin, Jian and Geng, Qian and Zhao, Qian and Zhang, Lixue , month = apr, year =. Integrating the. Proceedings of the 26th. doi:10.1145/3041021.3053053 , abstract =

  198. [225]

    Sentiment

    Wang, Ke and Wan, Xiaojun , month = jun, year =. Sentiment. The 41st. doi:10.1145/3209978.3210056 , language =

  199. [226]

    Multi-aspect expertise matching for review assignment , isbn =

    Karimzadehgan, Maryam and Zhai, ChengXiang and Belford, Geneva , month = oct, year =. Multi-aspect expertise matching for review assignment , isbn =. Proceedings of the 17th. doi:10.1145/1458082.1458230 , abstract =

  200. [227]

    Arous, Ines and Yang, Jie and Khayati, Mourad and Cudre-Mauroux, Philippe , month = jun, year =. Peer. Proceedings of the. doi:10.1145/3442381.3450088 , abstract =

  201. [228]

    Weighted

    Kou, Ngai Meng and U., Leong Hou and Mamoulis, Nikos and Gong, Zhiguo , month = may, year =. Weighted. Proceedings of the 2015. doi:10.1145/2723372.2723727 , abstract =

    2015

  202. [229]

    Expertise modeling for matching papers with reviewers , isbn =

    Mimno, David and McCallum, Andrew , month = aug, year =. Expertise modeling for matching papers with reviewers , isbn =. Proceedings of the 13th. doi:10.1145/1281192.1281247 , abstract =

  203. [230]

    and Singh, Aarti , month = mar, year =

    Stelmakh, Ivan and Shah, Nihar B. and Singh, Aarti , month = mar, year =. Proceedings of the 30th

  204. [231]

    Tan, Sijun and Wu, Jibang and Bei, Xiaohui and Xu, Haifeng , year =. Least. Advances in

  205. [232]

    Proceedings of the AAAI Conference on Artificial Intelligence , author =

    How to. Proceedings of the AAAI Conference on Artificial Intelligence , author =. 2011 , pages =. doi:10.1609/aaai.v25i1.7847 , abstract =

    2011 doi

  206. [233]

    Argument

    Hua, Xinyu and Nikolov, Mitko and Badugu, Nikhil and Wang, Lu , month = jun, year =. Argument. Proceedings of the 2019. doi:10.18653/v1/N19-1219 , abstract =

    2019 doi

  207. [234]

    , month = jun, year =

    Liu, Ryan and Shah, Nihar B. , month = jun, year =. doi:10.48550/arXiv.2306.00622 , abstract =

    doi arXiv

  208. [235]

    Proceedings of the National Academy of Sciences , author =

    Reviewer bias in single- versus double-blind peer review , volume =. Proceedings of the National Academy of Sciences , author =. 2017 , pages =. doi:10.1073/pnas.1707323114 , abstract =

    2017 doi

  209. [236]

    Proceedings of the 13th

    Wang, Qingyun and Zeng, Qi and Huang, Lifu and Knight, Kevin and Ji, Heng and Rajani, Nazneen Fatema , month = dec, year =. Proceedings of the 13th

  210. [237]

    Gao, Yang and Eger, Steffen and Kuznetsov, Ilia and Gurevych, Iryna and Miyao, Yusuke , month = jun, year =. Does. Proceedings of the 2019. doi:10.18653/v1/N19-1129 , abstract =

    2019 doi

  211. [238]

    , month = nov, year =

    Caragea, Cornelia and Uban, Ana and Dinu, Liviu P. , month = nov, year =. The. Proceedings of the 2019. doi:10.18653/v1/D19-1236 , abstract =

    2019 doi

  212. [239]

    JAMA , author =

    Effects of. JAMA , author =. 2002 , pages =. doi:10.1001/jama.287.21.2784 , abstract =

    2002 doi

  213. [240]

    and Snoek, Jasper and Wiltschko, Alex , month = dec, year =

    Sculley, D. and Snoek, Jasper and Wiltschko, Alex , month = dec, year =. Avoiding a. doi:10.48550/arXiv.1901.06246 , abstract =

    1901 doi arXiv

  214. [241]

    Tran, David and Valtchanov, Alex and Ganapathy, Keshav and Feng, Raymond and Slud, Eric and Goldblum, Micah and Goldstein, Tom , month = oct, year =. An. doi:10.48550/arXiv.2010.05137 , abstract =

    2010 doi arXiv

  215. [242]

    Rogers, Anna and Augenstein, Isabelle , month = nov, year =. What. Findings of the. doi:10.18653/v1/2020.findings-emnlp.112 , abstract =

    2020 doi

  216. [243]

    Communications of the ACM , author =

    Computational support for academic peer review: a perspective from artificial intelligence , volume =. Communications of the ACM , author =. 2017 , pages =. doi:10.1145/2979672 , abstract =

    2017 doi

  217. [244]

    Communications of the ACM , author =

    Challenges, experiments, and computational solutions in peer review , volume =. Communications of the ACM , author =. 2022 , pages =. doi:10.1145/3528086 , abstract =

    2022 doi

  218. [245]

    Qualitative Research in Psychology , author =

    Using thematic analysis in psychology , volume =. Qualitative Research in Psychology , author =. 2006 , pages =. doi:10.1191/1478088706qp063oa , language =

    2006 doi

  219. [246]

    BMJ Open , author =

    Journal editors’ perspectives on the roles and tasks of peer reviewers in biomedical journals: a qualitative study , volume =. BMJ Open , author =. 2019 , keywords =. doi:10.1136/bmjopen-2019-033421 , abstract =

    2019 doi

  220. [247]

    BMJ Open , author =

    Editors’ perspectives on the peer-review process in biomedical journals: protocol for a qualitative study , volume =. BMJ Open , author =. 2018 , keywords =. doi:10.1136/bmjopen-2017-020568 , abstract =

    2018 doi

  221. [248]

    and Lipton, Zachary , month = may, year =

    Shah, Nihar B. and Lipton, Zachary , month = may, year =. Proceedings of the 2020. doi:10.1145/3318464.3383129 , abstract =

    2020

  222. [249]

    Mapping the

    Cheng, Ruijia and Smith-Renner, Alison and Zhang, Ke and Tetreault, Joel and Jaimes-Larrarte, Alejandro , month = jul, year =. Mapping the. Proceedings of the 2022. doi:10.18653/v1/2022.naacl-main.33 , abstract =

    2022 doi

  223. [250]

    Exploring

    Sien, Sang-Wha and Mohan, Shalini and McGrenere, Joanna , month = apr, year =. Exploring. Proceedings of the 2022. doi:10.1145/3491102.3517710 , abstract =

    2022

  224. [251]

    and Munson, Sean A

    Bhattacharya, Arpita and Vilardaga, Roger and Kientz, Julie A. and Munson, Sean A. , month = may, year =. Lessons from. Proceedings of the 2017. doi:10.1145/3025453.3025725 , abstract =

    2017

  225. [252]

    Marathe, Megh and Toyama, Kentaro , month = apr, year =. Semi-. Proceedings of the 2018. doi:10.1145/3173574.3173922 , abstract =

    2018

  226. [253]

    Zhu, Haining and Luo, Yuhan and Choe, Eun Kyoung , month = may, year =. Making. Proceedings of the 2017. doi:10.1145/3025453.3025549 , abstract =

    2017

  227. [254]

    DISAPERE : A Dataset for Discourse Structure in Peer Review Discussions

    Kennard, Neha Nayak and O ' Gorman, Tim and Das, Rajarshi and Sharma, Akshay and Bagchi, Chhandak and Clinton, Matthew and Yelugam, Pranay Kumar and Zamani, Hamed and McCallum, Andrew. DISAPERE : A Dataset for Discourse Structure in Peer Review Discussions. Proceedings of the ...

    2022 doi

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.