REVIEW 1 major objections 4 minor
Considering Contribution Statements in Visualization and HCI Research
T0 review · 1 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read Contribution statements should be encouraged but not mandated in visualization and HCI research, a study of 21 researchers concludes.
desk verdict A transparent, modest qualitative exploration of contribution statements in VIS/HCI, whose small convenience sample limits the strength of its venue-level recommendation. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the contribution statement itself, with the CRediT taxonomy—a 14-role standard for describing author contributions—serving as the most prominent example and the main point of contention. The argument is carried by the study's procedure: participants first described authors' roles in free-form language, then re-expressed them using CRediT, and then reflected on the exercise. That comparison exposes where the taxonomy fits, where it distorts, and what the community values in attribution, and it grounds the paper's contextual recommendation.
What would settle it
A larger, pre-registered survey of visualization and HCI researchers using stratified sampling from conference attendee lists that found a majority opposing contribution statements even when optional and page-limit-exempt, or a controlled trial showing that optional statements do not increase adoption or reduce authorship disputes, would undercut the recommendation; a survey showing that most researchers would prefer mandatory CRediT with a fixed format would also falsify the claim that encouragement and flexibility are the right balance.
Extended reading notes
Core claim
The paper's central claim is that contribution statements are net-positive in many contexts, but should be encouraged rather than mandated, and that no single taxonomy fits visualization and HCI work. The authors base this on a qualitative study in which 21 visualization and HCI researchers attributed roles on a recent paper in their own words and then using CRediT, followed by reflective questions. Participants valued the transparency and the chance to make invisible labor visible—especially junior researchers and those from underrepresented groups—but also described CRediT as ill-fitting (its 'Visualization' role is especially confusing), found the exercise tedious, and noted that authorship discussions can surface power dynamics and be distorted by memory and social pressure. The authors conclude that the process of writing a contribution statement can be valuable in itself, and recommend that venues support but not require them.
Load-bearing premise
The paper's recommendations rest on the assumption that the 21 convenience-sample participants, drawn largely from one author's professional network and extended by snowball sampling, capture the range of views in the broader visualization and HCI communities—a representativeness the authors themselves disclaim.
Editorial extensions
If this is right
- Venues may begin to exempt contribution statements from page limits, following the pattern already used for ethics statements and acknowledgments.
- Authors, particularly junior or marginalized researchers, may use contribution statements as evidence when negotiating author order or claiming credit for work that is otherwise invisible.
- The prototypes released with the paper could grow into authoring tools integrated into submission systems, making contribution statements cheaper to produce and easier to compare.
- Research groups may adopt the habit of drafting contribution statements as a routine reflection exercise even when they do not publish them, using them to align expectations and defuse authorship disputes.
- The identified misalignment of CRediT with design, qualitative, and domain-expert roles may spur new taxonomies or adapted variants tailored to visualization and HCI.
Reading between the lines
- The 'process value' of contribution statements—forcing teams to discuss authorship early—may be the strongest effect, and could be realized even in manuscripts that never include the statement; this suggests testing facilitation tools independently of publication requirements.
- If page-limit exemptions are adopted, a natural next experiment is to compare adoption rates and statement quality across venues with and without the exemption, controlling for author experience.
- The study's finding that junior scholars are the most enthusiastic suggests that mandatory or quota-based policies might gain support from the community's younger members, a tension venue leadership should expect.
- The CRediT 'Visualization' role confusion is a concrete, fixable problem; renaming it to something like 'Paper visuals' or 'Figure production' could be tested in a short survey of the visualization community.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper explores the role of contribution statements (e.g., CRediT) in visualization and HCI research. It reports an online qualitative survey of 21 visualization and HCI researchers who were asked to describe authorship roles for a recent paper in their own words and then using CRediT, followed by reflective questions about the experience and about whether venues such as IEEE VIS should require contribution statements. The authors supplement the survey with their own reflections, prototype tools for authoring contribution statements, and a discussion of prior work. The findings show a range of opinions: contribution statements are seen as supporting transparency, due credit (especially for junior researchers), and reflection, but also as a poor fit for visualization-specific roles, a potential source of author conflict, an added chore, and a tool that may shift rather than remove bias. The central recommendation is that venues should encourage contribution statements, exempt them from page limits, and provide flexible templates and examples, but should not require them or impose a particular format.
Significance. If taken as an exploratory qualitative contribution, the paper is valuable. Its strengths are the transparent positionality statement, the disclosure that one co-author was originally a participant, the inclusion of the unmodified survey instrument in the appendix, the public release of two prototype tools, and the careful labeling of the quantitative summary as 'gestural.' The paper does not overclaim: it explicitly disclaims representativeness and frames its recommendation as a starting point for dialogue. The main risk is the mismatch between the community-wide venue recommendation in Section 6 and the small convenience sample on which it is partly based; the authors acknowledge this limitation but could make the scoping more explicit. With that clarification, the paper would be a useful and appropriately cautious contribution to authorship and credit practices in visualization and HCI.
major comments (1)
- [Sections 3, 6, 7] Section 6 states a venue-level recommendation ('we recommend that visualization and HCI venues should encourage contribution statements, exempt them from page limits, and provide flexible templates, examples, and justifications that support their inclusion—but we should not require them or force the use of any particular format') that is informed by a convenience sample of 21 researchers recruited from one co-author's recent collaborators and snowball contacts (Section 3). The authors acknowledge this limitation in Sections 7 and 9, but the recommendation itself is not explicitly scoped to the exploratory nature of the evidence, and the unlabeled quotes and unshared data prevent readers from assessing how recruitment-network composition shaped the balance of pro- and anti-inclusion views. Please add a sentence in Section 6 that ties the recommendation to the small, non-representative sample and to the need for broader validation, and add a sentence in Section 7 stating explicitly that the sensitivity of the themes to network composition is unknown. These changes would not alter the paper's argument but would prevent overgeneralization of its central claim.
minor comments (4)
- [Section 6] In the second paragraph, the word 'similarly' after the sentence ending 'reference pages.' appears with a lowercase initial and should be capitalized; additionally, 'Ashurt et al.' in the same paragraph is a typo for 'Ashurst et al.' (reference [7]).
- [Throughout and Appendix] The spelling of the taxonomy is inconsistent ('CRediT' in the main text, 'CREDiT' in the survey instrument); please standardize the spelling throughout.
- [Figure 1 caption] The caption introduces an 'Other / Misused Scale' category that is not defined in the text; please add a one-sentence explanation of what counts as 'other' or 'misused' in this gestural summary.
- [Section 3] The text describes Wesley as initially a participant who joined the author team after analysis; please state explicitly whether Wesley's survey responses are included in the qualitative themes and in Figure 1, so readers can interpret the authorship disclosures.
Circularity Check
No derivational circularity: the survey-based findings and recommendations are not reduced to the paper's own inputs; only minor, transparent self-citation appears as illustrative example.
full rationale
The paper's central recommendation is an inductive synthesis of an external qualitative survey of 21 researchers, not a quantity derived from a fitted parameter or from the authors' prior work. The survey data, participant quotes, and the authors' own reflection are separate inputs; the recommendation to 'encourage but not require' is a judgment weighing pro- and anti-inclusion themes, not an equation that equals its premise. The paper explicitly disclaims representativeness in Section 7 and states it does not speak for the whole community in Section 9; that limitation concerns external validity, not circularity. Self-references are transparent and non-load-bearing: Wesley's prior use of contribution statements and the Calgary CRediT variant appear as examples of existing formats and as disclosure of author positionality, and the recommendation's force does not depend on accepting those prior works. The authors also disclose that Wesley was initially a survey participant and joined after analysis, further reducing any appearance of hidden circularity. No step reduces a prediction to a fitted input, and no uniqueness or ansatz is imported via self-citation. The paper is therefore self-contained as an empirical contribution.
Assumptions & free parameters
assumptions (3)
- domain assumption Participant self-reports of their own authorial roles are sufficiently accurate to characterize the utility and fit of contribution frameworks.
- domain assumption A convenience sample of 21 researchers, largely from one co-author's network, can inform community-level recommendations.
- domain assumption CRediT is a representative enough lens for contrasting structured and free-form contribution formats.
Cite this review
Pith. "Pith review of Considering Contribution Statements in Visualization and HCI Research." pith.science (2026). https://pith.science/paper/3H3TUBIC
@misc{pith2026260812792,
author = {Pith},
title = {Pith review of: Considering Contribution Statements in Visualization and HCI Research},
year = {2026},
howpublished = {\url{https://pith.science/paper/3H3TUBIC}},
note = {Machine review of arXiv:2608.12792}
}
read the original abstract
Contribution statements are an increasingly common way to make research labor visible, reduce academic malfeasance, and provide broader transparency. Despite this potential value, they remain uncommon in visualization and HCI. To explore this gap, we conducted an online study with (N=21) visualization and HCI researchers. We find a range of differing opinions about the utility of contribution statements, which are set against a background of tensions relating to contribution frameworks that inadequately fit contribution types in HCI and especially visualization, power dynamics between authors, bias in authorship perceptions, and the tedium of providing yet another form of documentation. From these factors, we offer a modest recommendation to authors: consider contribution statements. There are contexts when they may usefully explicate work, and others where they can cause author-team conflict or become a burdensome chore. Regardless of whether they are used by readers or not, we suggest that scaffolded mechanisms for reflecting on contribution roles are valuable both for public accountability and internal alignment. To institutions, we recommend that contribution statements be exempt from page or word limits, and that flexible templates and examples be provided to authors, but that they continue to not be required. By surfacing these perspectives, we seek to open a dialogue about what constitutes authorship, how our community might move toward more equitable and transparent attribution practices, and where the visualization and HCI communities might be uniquely equipped to help.
Figures
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.