{"id":"3a4b94eb-afb3-4e7c-9580-c2bd210491ea","arxiv_id":"2608.12792","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"A small qualitative study finds that visualization and HCI researchers see both benefits and burdens in contribution statements, leading the authors to recommend encouragement without mandates.","lead":"This paper surveys 21 visualization and HCI researchers about whether papers should include contribution statements that spell out who did what. It finds mixed opinions and recommends that venues encourage such statements and exempt them from page limits, but stop short of requiring them.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Venue-level recommendation leans on a convenience sample whose network biases are acknowledged but not tested; if the themes are driven by the recruiter's collaborators, the policy guidance lacks empirical support.","rationale":"Agree with the reader that the sample is a genuine limitation; however, the paper frames itself as an early, modest contribution to an ongoing dialogue, so the limitation is not disqualifying. The concern I stress is more specific than general representativeness: the network recruitment could systematically skew the qualitative themes, and the paper's current reporting format makes that untestable externally. This does not change the verdict because the recommendation is explicitly provisional, the authors acknowledge the sampling limits, and they provide a clear path for future work. I would keep the paper conditionally accepted, with the condition that the sensitivity analysis be reported or the claims be narrowed to the sampled network. This is essentially the same weak point the reader identified, focused at the level of internal validity rather than external generalizability.","tokens_in":18879,"tokens_out":4778,"duration_ms":57363,"concrete_test":"Ask the authors to run a within-sample sensitivity analysis on the existing data, splitting respondents by recruitment route (direct collaborator of Andrew vs snowball) and by documented prior exposure to the Calgary CRediT variant or to contribution-statement advocacy, and report whether the pro-inclusion themes and the 'encourage not require' balance appear in both subgroups. If the split is unavailable for anonymity reasons, a minimal substitute is to report recruitment-source metadata and any divergence in the original survey responses; if connected respondents drive the themes, the recommendation should be reframed as network-specific rather than community-wide.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central recommendation in Section 6—that VIS/HCI venues should encourage contribution statements, exempt them from page limits, and provide flexible templates without requiring them—is addressed to the whole community. The supporting empirical evidence is a qualitative study of 21 researchers recruited from one co-author's recent collaborators and snowball contacts (Section 3). The paper disclaims representativeness in Sections 7 and 9, yet the policy recommendation is framed community-wide. The load-bearing step is that the balance of pro- and anti-inclusion views that justifies 'encourage but do not require' is not an artifact of the recruitment network. Because Wesley is an active proponent of contribution statements and the Calgary CRediT variant is cited as a model, respondents connected to those circles may be more favorably disposed; the one researcher who explicitly declined objected to the idea. The paper does not report whether direct collaborators and snowball recruits gave different themes, and quotes are deliberately unlabeled and data are not shared, so the sensitivity of the conclusions to network composition cannot be assessed. If the favorable themes concentrate in connected subgroups, the recommendation would be an artifact of sampling rather than a community-wide finding.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper explores the role of contribution statements (e.g., CRediT) in visualization and HCI research. It reports an online qualitative survey of 21 visualization and HCI researchers who were asked to describe authorship roles for a recent paper in their own words and then using CRediT, followed by reflective questions about the experience and about whether venues such as IEEE VIS should require contribution statements. The authors supplement the survey with their own reflections, prototype tools for authoring contribution statements, and a discussion of prior work. The findings show a range of opinions: contribution statements are seen as supporting transparency, due credit (especially for junior researchers), and reflection, but also as a poor fit for visualization-specific roles, a potential source of author conflict, an added chore, and a tool that may shift rather than remove bias. The central recommendation is that venues should encourage contribution statements, exempt them from page limits, and provide flexible templates and examples, but should not require them or impose a particular format.","tokens_in":19064,"tokens_out":8394,"duration_ms":80975,"significance":"If taken as an exploratory qualitative contribution, the paper is valuable. Its strengths are the transparent positionality statement, the disclosure that one co-author was originally a participant, the inclusion of the unmodified survey instrument in the appendix, the public release of two prototype tools, and the careful labeling of the quantitative summary as 'gestural.' The paper does not overclaim: it explicitly disclaims representativeness and frames its recommendation as a starting point for dialogue. The main risk is the mismatch between the community-wide venue recommendation in Section 6 and the small convenience sample on which it is partly based; the authors acknowledge this limitation but could make the scoping more explicit. With that clarification, the paper would be a useful and appropriately cautious contribution to authorship and credit practices in visualization and HCI.","major_comments":[{"comment":"Section 6 states a venue-level recommendation ('we recommend that visualization and HCI venues should encourage contribution statements, exempt them from page limits, and provide flexible templates, examples, and justifications that support their inclusion—but we should not require them or force the use of any particular format') that is informed by a convenience sample of 21 researchers recruited from one co-author's recent collaborators and snowball contacts (Section 3). The authors acknowledge this limitation in Sections 7 and 9, but the recommendation itself is not explicitly scoped to the exploratory nature of the evidence, and the unlabeled quotes and unshared data prevent readers from assessing how recruitment-network composition shaped the balance of pro- and anti-inclusion views. Please add a sentence in Section 6 that ties the recommendation to the small, non-representative sample and to the need for broader validation, and add a sentence in Section 7 stating explicitly that the sensitivity of the themes to network composition is unknown. These changes would not alter the paper's argument but would prevent overgeneralization of its central claim.","section":"Sections 3, 6, 7"}],"minor_comments":[{"comment":"In the second paragraph, the word 'similarly' after the sentence ending 'reference pages.' appears with a lowercase initial and should be capitalized; additionally, 'Ashurt et al.' in the same paragraph is a typo for 'Ashurst et al.' (reference [7]).","section":"Section 6"},{"comment":"The spelling of the taxonomy is inconsistent ('CRediT' in the main text, 'CREDiT' in the survey instrument); please standardize the spelling throughout.","section":"Throughout and Appendix"},{"comment":"The caption introduces an 'Other / Misused Scale' category that is not defined in the text; please add a one-sentence explanation of what counts as 'other' or 'misused' in this gestural summary.","section":"Figure 1 caption"},{"comment":"The text describes Wesley as initially a participant who joined the author team after analysis; please state explicitly whether Wesley's survey responses are included in the qualitative themes and in Figure 1, so readers can interpret the authorship disclosures.","section":"Section 3"}],"recommendation":"minor_revision","confidential_remarks":"This is a borderline case between accept and minor revision. The paper is a well-written exploratory study with a modest, defensible recommendation. If the authors add the scoping caveat requested in the major comment, I would be satisfied. I would not want to see the paper rejected on sample-size grounds, as the authors have been transparent about the limitations and the work functions as a community commentary rather than a definitive policy analysis."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"First thing to know: this is a thoughtful qualitative position paper, not a rigorous empirical policy study. It's built on 21 convenience-sampled researchers, and the authors say so plainly. The central recommendation—encourage contribution statements but don't require them, don't make them count against page limits—is deliberately low-key, and it's the most defensible part of the paper.\n\nWhat's new: I haven't seen another survey of VIS/HCI researchers specifically on how CRediT does or doesn't fit their work. The finding that the CRediT role 'Visualization' confuses people working in the field of visualization is concrete and useful. The broader complaint—that design, co-design, participant recruitment, and qualitative analysis don't map cleanly onto CRediT's categories—is well documented with quotes. The prototypes are lightweight but publicly available, and they build sensibly on tenzing and the Calgary variant.\n\nWhat it does well: the paper is unusually honest about its own limitations and positionality. It tells you Wesley was originally a participant; it tells you the sample came from Andrew's collaborators and snowballing; it tells you the data can't be shared for privacy. The qualitative analysis distinguishes pro and anti themes, so it's not just advocacy. The authors also give their own contribution statements in several formats, which is a nice touch.\n\nSoft spots: the biggest one is the gap between the sample and the audience for the recommendations. Twenty-one people, mostly connected to one co-author, cannot support a community-wide policy recommendation on their own. The paper acknowledges this but then goes ahead and addresses the full VIS/HCI community in Section 6. The stress-test concern about network bias is plausible: participants recruited from pro-contribution circles may be more favorably disposed. That said, the sample does include dissenters, and the recommendation is already so moderate that it's unlikely to be overturned by a more representative study. I'd call the generalizability concern a real limitation but not a fatal one.\n\nThe other, minor, issue is the survey instrument: a Word document where respondents could revise earlier answers after seeing CRediT. The paper flags this too. The authors use the results as 'gestural' rather than conclusive, which helps.\n\nBottom line: this paper is worth engaging with if you care about authorship norms in VIS/HCI. It's a conversation starter, not evidence for a binding policy. It deserves a serious referee; the writing is clear, the claims are properly hedged, and it does something new. I'd send it to review with the expectation that the recommendations get softened or explicitly framed as informed opinion rather than survey output.","headline":"A transparent, modest qualitative exploration of contribution statements in VIS/HCI, whose small convenience sample limits the strength of its venue-level recommendation.","tokens_in":19540,"tokens_out":3446,"would_cite":true,"duration_ms":33495,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Contribution statements should be encouraged but not mandated in visualization and HCI research, a study of 21 researchers concludes.","keywords":["contribution statements","CRediT","authorship attribution","transparency","visualization research","human-computer interaction","qualitative study","author order"],"falsifier":"A larger, pre-registered survey of visualization and HCI researchers using stratified sampling from conference attendee lists that found a majority opposing contribution statements even when optional and page-limit-exempt, or a controlled trial showing that optional statements do not increase adoption or reduce authorship disputes, would undercut the recommendation; a survey showing that most researchers would prefer mandatory CRediT with a fixed format would also falsify the claim that encouragement and flexibility are the right balance.","tokens_in":18693,"feed_emoji":"📝","tokens_out":8147,"duration_ms":69131,"temperature":0.7,"pith_summary":"This paper argues that contribution statements—short sections listing who did what on a paper—deserve a deliberate but voluntary place in visualization and HCI research. Through a qualitative study with 21 researchers, the authors find that such statements can improve transparency, help junior scholars and underrepresented groups claim credit, and prompt useful reflection on authorship. Yet the dominant CRediT taxonomy fits visualization and HCI poorly, and mandatory statements risk becoming a chore or a site for power struggles. The authors recommend that venues encourage contribution statements, exempt them from page limits, and offer flexible templates, without requiring them or imposing a single format.","feed_headline":"Encourage, don't mandate, contribution statements in vis/HCI","feed_subtitle":"A 21-researcher study finds transparency gains but taxonomy mismatch, pointing to flexible optional policies.","key_machinery":"The central object is the contribution statement itself, with the CRediT taxonomy—a 14-role standard for describing author contributions—serving as the most prominent example and the main point of contention. The argument is carried by the study's procedure: participants first described authors' roles in free-form language, then re-expressed them using CRediT, and then reflected on the exercise. That comparison exposes where the taxonomy fits, where it distorts, and what the community values in attribution, and it grounds the paper's contextual recommendation.","core_discovery":"The paper's central claim is that contribution statements are net-positive in many contexts, but should be encouraged rather than mandated, and that no single taxonomy fits visualization and HCI work. The authors base this on a qualitative study in which 21 visualization and HCI researchers attributed roles on a recent paper in their own words and then using CRediT, followed by reflective questions. Participants valued the transparency and the chance to make invisible labor visible—especially junior researchers and those from underrepresented groups—but also described CRediT as ill-fitting (its 'Visualization' role is especially confusing), found the exercise tedious, and noted that authorship discussions can surface power dynamics and be distorted by memory and social pressure. The authors conclude that the process of writing a contribution statement can be valuable in itself, and recommend that venues support but not require them.","pith_inferences":["The 'process value' of contribution statements—forcing teams to discuss authorship early—may be the strongest effect, and could be realized even in manuscripts that never include the statement; this suggests testing facilitation tools independently of publication requirements.","If page-limit exemptions are adopted, a natural next experiment is to compare adoption rates and statement quality across venues with and without the exemption, controlling for author experience.","The study's finding that junior scholars are the most enthusiastic suggests that mandatory or quota-based policies might gain support from the community's younger members, a tension venue leadership should expect.","The CRediT 'Visualization' role confusion is a concrete, fixable problem; renaming it to something like 'Paper visuals' or 'Figure production' could be tested in a short survey of the visualization community."],"forward_implications":["Venues may begin to exempt contribution statements from page limits, following the pattern already used for ethics statements and acknowledgments.","Authors, particularly junior or marginalized researchers, may use contribution statements as evidence when negotiating author order or claiming credit for work that is otherwise invisible.","The prototypes released with the paper could grow into authoring tools integrated into submission systems, making contribution statements cheaper to produce and easier to compare.","Research groups may adopt the habit of drafting contribution statements as a routine reflection exercise even when they do not publish them, using them to align expectations and defuse authorship disputes.","The identified misalignment of CRediT with design, qualitative, and domain-expert roles may spur new taxonomies or adapted variants tailored to visualization and HCI."],"supporting_citations":[{"why":"Introduces the CRediT contributor role taxonomy, the main standard the study evaluates.","marker":"[11]"},{"why":"Formal description of the 14-role CRediT taxonomy, serving as the benchmark participants were asked to use.","marker":"[17]"},{"why":"Argues that transparency in author contributions promotes research integrity, providing the normative motivation for contribution statements.","marker":"[30]"},{"why":"Documents gender and career-stage bias in author ordering and offers equity-based guidance, grounding the paper's discussion of credit and bias.","marker":"[28]"},{"why":"Retrospectively analyzes CRediT adoption across publications, establishing both its popularity and the norms the paper contrasts with visualization practice.","marker":"[4]"},{"why":"Analyzes positionality statements, an adjacent practice the authors use to frame both benefits and harms of requiring such statements.","marker":"[39]"},{"why":"Provides evidence of honorary and ghost authorship in biomedical journals, a motivating problem that contribution statements aim to address.","marker":"[42]"},{"why":"Describes a tool for generating CRediT statements, which directly informs the paper's prototypes for contribution authoring tools.","marker":"[24]"}],"fun_headline_variants":["Vis/HCI should encourage, not require, contribution statements","Study: contribution statements valuable but taxonomies don't fit","21 researchers: contribution statements shine, but CRediT misfits","Make contribution statements optional but supported in vis/HCI"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The paper's recommendations rest on the assumption that the 21 convenience-sample participants, drawn largely from one author's professional network and extended by snowball sampling, capture the range of views in the broader visualization and HCI communities—a representativeness the authors themselves disclaim.","fun_headline_variants_meta":{"raw":{"variants":["Vis/HCI should encourage, not require, contribution statements","Study: contribution statements valuable but taxonomies don't fit","21 researchers: contribution statements shine, but CRediT misfits","Make contribution statements optional but supported in vis/HCI"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000211,"raw_usage":{"total_tokens":1417,"prompt_tokens":951,"completion_tokens":466,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":567,"completion_tokens_details":{"reasoning_tokens":397}},"tokens_in":567,"tokens_out":466,"duration_ms":5152,"temperature":1.0,"reasoning_tokens":397,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-15T23:10:52.787278+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"A larger, pre-registered survey of visualization and HCI researchers using stratified sampling from conference attendee lists that found a majority opposing contribution statements even when optional and page-limit-exempt, or a controlled trial showing that optional statements do not increase adoption or reduce authorship disputes, would undercut the recommendation; a survey showing that most researchers would prefer mandatory CRediT with a fixed format would also falsify the claim that encouragement and flexibility are the right balance.","supporting_citations":[{"cited_title":"Contributor Role Taxonomy (CRediT).https://credit","cited_arxiv_id":null,"evidence_quote":"Formal description of the 14-role CRediT taxonomy, serving as the benchmark participants were asked to use."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Argues that transparency in author contributions promotes research integrity, providing the normative motivation for contribution statements."},{"cited_title":"Liboiron, J","cited_arxiv_id":null,"evidence_quote":"Documents gender and career-stage bias in author ordering and offers equity-based guidance, grounding the paper's discussion of credit and bias."},{"cited_title":"Allen, V","cited_arxiv_id":null,"evidence_quote":"Retrospectively analyzes CRediT adoption across publications, establishing both its popularity and the norms the paper contrasts with visualization practice."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Provides evidence of honorary and ghost authorship in biomedical journals, a motivating problem that contribution statements aim to address."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Describes a tool for generating CRediT statements, which directly informs the paper's prototypes for contribution authoring tools."}],"review_version":1}