{"id":"d3e8745a-d46d-49d0-a0ef-01e2c67b4d83","arxiv_id":"2505.14339","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"A grounded-theory analysis of VisComm workshop papers reveals recurring themes of iterative design and audience focus, and a notable gap in DEI practices.","lead":"This paper analyzes all 37 papers published at the VisComm visualization workshop from 2018 to 2022, using grounded theory to extract common themes. It finds that the field emphasizes audience-centered, communicative designs but pays little attention to diversity, equity, and inclusion.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The DEI-gap conclusion relies on treating 'accessible to wide audiences' as evidence of inclusivity, a conflation not supported by the reported definitional themes.","rationale":"The reader's weakest assumption was corpus representativeness: whether 37 VisComm papers can stand in for visualization-for-communication research at large. That is an external-validity concern and is partly acknowledged by the paper's scope. The more load-bearing concern is internal: even granting the corpus is representative, the paper's own reported evidence in Section 3 supports 'audience-centered', 'communication', and 'understandability', but not 'inclusivity'. The Introduction and Discussion repeatedly use inclusivity and inclusive-accessible language to frame the DEI gap, conflating broad-audience comprehensibility with DEI-specific concerns. This conflation is central because the paper's headline finding—a noticeable gap between the field's stated values and its DEI practices—depends on definitions actually emphasizing inclusivity. If the re-coding shows definitions do not emphasize inclusivity, the finding reduces to the less surprising statement that general audience-focus is not the same as DEI engagement. The DEI count of 3/37 also needs a transparent codebook, but the semantic conflation is the more fundamental issue because it affects how the count is interpreted. Since the reader's verdict is already CONDITIONAL, this concern reinforces that condition rather than moving the verdict: the paper should be accepted only if the re-coding supports the inclusivity framing or the framing is revised. The proposed test is feasible with the existing corpus and would settle the matter definitively.","tokens_in":4112,"tokens_out":5415,"duration_ms":58834,"concrete_test":"Have two independent raters code the full text of all 37 VisComm papers for (a) definitional statements containing DEI-related terms such as 'inclusive', 'diversity', 'equity', 'disability', 'marginalized', or equivalents, versus merely 'broad audience' or 'easy to understand'; and (b) papers containing concrete DEI remarks under a pre-registered codebook. Report inter-rater reliability (e.g., Cohen's kappa). If few or no definitions use DEI terms, the phrase 'emphasis on inclusivity' must be retracted; if raters identify more than three papers with concrete DEI remarks, the headline gap claim fails.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper's central contrast is between 'many papers defining visualization for communication with an emphasis on inclusivity' (Introduction) and only 3 of 37 papers with concrete DEI remarks. But the only evidence offered in Section 3 is that papers say visualizations should engage broad audiences (7 papers), communicate (5 papers), and be 'quickly understandable and accessible to wide audiences' (5 papers). The phrase 'accessible to wide audiences' appears to mean easy to comprehend, not accessible or inclusive in the DEI sense. The Discussion then switches to 'inclusive and accessible visualizations' and says the DEI gap 'stands in direct contrast' to the audience-centered and understandability themes. If no definition actually uses inclusivity or DEI language, the gap is not a contradiction between the field's foundational values and its practices; it is merely a gap between generic audience-orientation and explicit DEI, a much weaker claim. Additionally, the DEI count itself is not backed by a codebook or examples of what counts as 'concrete remarks', so the 3/37 number is difficult to audit.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper analyzes all 37 accepted IEEE VisComm workshop papers from 2018 through 2022. Using a two-round categorization followed by a thematic analysis described as grounded theory, the authors assign papers to four types (Guideline, New Visualization, Position, Theory), identify definitional themes of audience-centeredness, communication, and understandability, and report cross-cutting themes of iterative design and user consideration. The headline finding is that, despite what the authors call an emphasis on inclusivity in definitions, only three of the 37 papers make concrete remarks on Diversity, Equity, and Inclusion (DEI). The manuscript is a short empirical survey and does not include a codebook, coding data, or excerpt-level evidence.","tokens_in":4304,"tokens_out":9424,"duration_ms":88331,"significance":"If the descriptive claims are accurate, the paper offers a useful community checkpoint: it inventories four years of VisComm output and articulates a potential gap between stated audience-focused values and explicit DEI practice. Its main strengths are the census-like coverage of the workshop and the falsifiability of the reported counts, which could in principle be checked and extended. Its main weaknesses are the absence of an audit trail (codebook, excerpts, agreement data) and the conflation of 'accessible to wide audiences' with 'inclusivity,' which currently overstates the central discrepancy. Because the manuscript presents qualitative counts rather than new methods or theory, its significance is that of a scoping study for future work on visualization for communication.","major_comments":[{"comment":"The evidence presented as 'definitions of visualization' is not clearly definitional. The cited examples ('geared towards broad audiences,' 'a way to communicate,' 'quickly understandable and accessible to wide audiences') are statements about purpose or design goals, not formal definitions of visualization. More importantly, none of these phrases entails inclusivity or DEI, so the Introduction's claim that 'many papers defining visualization for communication with an emphasis on inclusivity' is unsupported. The Discussion's 'direct contrast' between audience-centered definitions and the observed DEI gap is therefore overstated. Please either provide actual definitional quotes, separate definitions from design goals, and restate the finding as a gap between generic audience orientation/comprehensibility and explicit DEI, or provide direct evidence of inclusivity language.","section":"Section 3 and Section 5"},{"comment":"The analysis process is described at a high level: one author categorized each paper, the second author reviewed the categories, disagreements were resolved, and themes were condensed 'through several rounds.' No codebook, theme definitions, inclusion or exclusion criteria for 'concrete DEI remarks,' inter-rater reliability coefficients, or excerpt-level evidence are reported. As a result, all counts in Sections 3 and 5, including the headline 3/37, are not independently auditable. Please provide the coding instrument, a table of representative quotes for each theme and for each DEI-positive paper, and agreement data, or explicitly label the counts as illustrative rather than systematic.","section":"Section 2"},{"comment":"The section reports that seven, five, and five papers mention the three definitional themes, but it never states how many of the 37 papers offered any definition of visualization at all. Without this denominator, and without reporting the overlap among the three lists, the reader cannot determine whether the 'particular emphasis' characterizes a majority of the corpus or a minority. The three lists in Section 3 appear to cover at most 10 unique papers, which further undermines the word 'many' in the Introduction. Please report the total number of papers that define visualization, the overlap among the theme lists, and the threshold used to call an emphasis 'particular.'","section":"Section 3"}],"minor_comments":[{"comment":"The affiliation line contains a typo: 'Univeristy' should be 'University.'","section":"Affiliations"},{"comment":"The phrase 'principle components' should be 'principal components.'","section":"Section 5"},{"comment":"References [11] and [31] are missing author initials and are inconsistent with the other reference entries in IEEE style.","section":"Reference list"},{"comment":"The second author is also an author of one of the analyzed papers ([28]); please add an explicit positionality or conflict-of-interest statement for transparency.","section":"Methodology"},{"comment":"The terms 'DEI guidelines' and 'inclusive visualization design' are used without a shared definition; please align the terminology with the proposed codebook so that the 3/37 count is clear.","section":"Sections 4.1 and 4.3"}],"recommendation":"major_revision","confidential_remarks":"For an archival venue, the lack of coding data and the inclusivity/DEI conflation are the main barriers. I recommend major revision rather than reject because both issues are fixable within the manuscript's scope: the authors can release a codebook and excerpts, and can reframe the central claim as a gap between audience orientation and explicit DEI practice. The paper would benefit from a positionality statement given the authors' own prior participation in VisComm."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Read it. The genuinely useful part: they actually read all 37 VisComm papers from 2018 to 2022, sorted them into four sensible buckets, and pulled out recurring themes. The 3-of-37 count for concrete DEI remarks is a new observation, and it is the kind of simple inventory a workshop community can act on. The paper is clearly written and honest that this is a first step.\n\nThe soft spot is the framing. The Introduction and Discussion say the field's own definitions emphasize 'inclusivity,' and then the DEI gap 'stands in direct contrast' to that. But the definitional evidence in Section 3 is about 'broad audiences,' 'communicate,' and 'quickly understandable and accessible to wide audiences.' That is audience comprehension, not DEI. Only in Section 4.3 do they mention two papers about intellectual and developmental disabilities, plus the Schwabish and Feng racial-equity paper. So the gap is real, but it is not a contradiction between stated inclusive values and practice; it is a gap between audience-orientation and explicit DEI. That is a weaker claim, and they should say it that way.\n\nMethodologically, this is grounded theory but reported at a high level. No codebook, no inter-rater reliability numbers, no excerpt-level examples showing how themes were assigned. The paper says disagreements were resolved in discussion, which is fine, but the audit trail is thin. For a 37-paper corpus you could reasonably provide the coding scheme and a few representative quotes. Without that, the theme counts are hard to verify. The corpus is also just VisComm, so the general conclusions about 'visualization for communication' should be scoped as 'this workshop's papers.'\n\nNone of this kills the paper. The analysis is plausible and the DEI finding is worth airing. It just needs a more careful frame and a bit more methodological transparency. I'd send it to review; a serious referee would ask for the codebook and a rewrite of the inclusivity language, but this is a legitimate contribution to a niche community.","headline":"Useful first synthesis of VisComm's literature and a real DEI gap, but the paper overstates the contrast by reading 'accessible to wide audiences' as an inclusivity commitment.","tokens_in":4751,"tokens_out":2472,"would_cite":true,"duration_ms":23574,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"A survey of four years of VisComm papers claims that visualization for communication is defined as audience-centered and communication-focused, yet only 3 of 37 papers make concrete remarks on diversity, equity, and inclusion.","keywords":["visualization for communication","VisComm workshop","grounded theory","thematic analysis","diversity equity and inclusion","audience-centered design","design guidelines","position papers"],"falsifier":"Re-running the coding of the same 37 papers and finding more than three with concrete DEI remarks—or sampling the broader visualization-for-communication literature and finding DEI practice routinely present alongside audience-centered definitions—would undermine the claimed gap between stated values and published practice.","tokens_in":3933,"feed_emoji":"📊","tokens_out":6599,"duration_ms":56407,"temperature":0.7,"pith_summary":"The paper analyzes all 37 papers accepted to the VisComm workshop from 2018 to 2022 and argues that they define visualization for communication as a practice centered on the audience, on communication, and on understandability. Using grounded theory, it sorts the papers into guideline, new visualization, position, and theory categories and finds that iterative design and attention to end users recur across all of them. The central finding is a gap: although the definitions emphasize inclusivity and accessibility, only three of the 37 papers make concrete remarks about diversity, equity, and inclusion. If correct, this shows that the field's stated values are not yet matched by its published practice, and it gives the community a concrete place to focus future work.","feed_headline":"Only 3 of 37 VisComm papers address DEI","feed_subtitle":"A four-year review finds audience-first definitions, yet almost no concrete equity practice.","key_machinery":"The argument is carried by a grounded-theory thematic analysis of the 37 workshop papers. In the first pass, each paper is classified as a guideline paper, a new-visualization paper, a position paper, or a theory paper; in the second, recurring themes are identified within and across these categories. The units of comparison are the papers' own definitions of visualization and their key takeaways, and the finding that produces the central result is the contrast between the audience-centered, inclusive language in those definitions and the small number of concrete DEI-related remarks in the papers themselves.","core_discovery":"Across the 37 VisComm papers, visualization for communication is defined with a consistent emphasis on centering the audience, on communication itself, and on understandability: seven papers describe reaching broad audiences or engaging wide populations, five explicitly frame visualization as a way to communicate, and five stress that it should be quickly understandable and accessible. Grouping the papers into guideline, new visualization, position, and theory categories, the authors find that iterative design and consideration of the end user appear across all groups, while each group adds its own concern (audience tailoring, narrative, and revision in guidelines; user experience in new visualizations; designer intuition in position papers; and conveying information, stories, or complex concepts in theory papers). The paper's sharpest claim is the DEI gap: despite the audience-centered and inclusive language in the definitions, only three papers offer concrete remarks on diversity, equity, and inclusion. The authors present this as evidence that the field's theoretical commitments are ahead of its actual practice.","pith_inferences":["An implication the authors leave implicit is that the 3-of-37 count is specific to this workshop's papers, so it may not describe visualization-for-communication research in other venues with different reporting norms.","Applying the same grounded-theory coding to a wider sample of visualization papers would produce a comparable DEI baseline for the field as a whole.","The distinction between papers that merely mention inclusivity and papers with concrete DEI remarks suggests a testable extension: define concrete DEI practice (inclusive recruitment, accessibility evaluation, equity-aware design choices) and measure its presence in a larger corpus.","A practical extension would be to turn the paper's categories into a submission checklist for VisComm, pairing audience-centered definitions with explicit DEI practice in every category."],"forward_implications":["If the definitions and themes identified here hold, visualization-for-communication research is already aligned around audience, communication, and understandability, which gives future work a shared vocabulary.","The four-category scheme (guideline, new visualization, position, theory) offers later surveys and literature reviews a tested classification to build on.","The DEI gap means that adding explicit diversity, equity, and inclusion steps to design guidelines and evaluation criteria would be a measurable improvement, not a change of direction.","Workshop calls and author guidelines could ask for explicit DEI statements, and reviewers could check for them, because the corpus shows such statements are currently rare.","The recurring themes of iterative design and end-user consideration suggest that usability-style evaluation is already common and could be the natural entry point for DEI work."],"supporting_citations":[{"why":"It supplies the grounded-theory design framework used to conduct the thematic analysis.","marker":"[38]"},{"why":"It provides the general definition of visualization that the paper uses as a baseline.","marker":"[8]"},{"why":"It supplies the definition of visual analytics that the paper contrasts with VisComm definitions.","marker":"[17]"},{"why":"It supplies the definition of scientific visualization used as another contrast.","marker":"[33]"},{"why":"It is one of the VisComm papers cited for bridging computation and visual communication in the definitional analysis.","marker":"[11]"},{"why":"It is one of the VisComm papers cited for describing visualization as a way to communicate in the definitional analysis.","marker":"[24]"},{"why":"It is one of the VisComm papers cited for treating comprehension of visual formats as central to communication.","marker":"[25]"},{"why":"It is one of the three VisComm papers counted as offering concrete DEI remarks, via a health-equity dashboard.","marker":"[20]"},{"why":"It is the single guideline paper counted as offering concrete DEI remarks, via racial-equity awareness in data visualization.","marker":"[35]"},{"why":"It is one of the three VisComm papers counted as offering concrete DEI remarks, via design for people with intellectual and developmental disabilities.","marker":"[42]"}],"fun_headline_variants":["VisComm papers: audience-first, but DEI scarce","4 years of VisComm: little DEI, lots of audience talk","VisComm review: audience-centered, but only 3 papers touch DEI","Audience-first VisComm, but DEI practice is thin"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that the 37 VisComm papers accepted from 2018 to 2022 are a representative sample of visualization-for-communication research, so the themes and the DEI gap are treated as describing the field rather than only one workshop.","fun_headline_variants_meta":{"raw":{"variants":["VisComm papers: audience-first, but DEI scarce","4 years of VisComm: little DEI, lots of audience talk","VisComm review: audience-centered, but only 3 papers touch DEI","Audience-first VisComm, but DEI practice is thin"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000722,"raw_usage":{"total_tokens":3176,"prompt_tokens":820,"completion_tokens":2356,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":436,"completion_tokens_details":{"reasoning_tokens":2281}},"tokens_in":436,"tokens_out":2356,"duration_ms":16264,"temperature":1.0,"reasoning_tokens":2281,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-07T15:35:06.107066+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Re-running the coding of the same 37 papers and finding more than three with concrete DEI remarks—or sampling the broader visualization-for-communication literature and finding DEI practice routinely present alongside audience-centered definitions—would undermine the claimed gap between stated values and published practice.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"It supplies the grounded-theory design framework used to conduct the thematic analysis."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"It provides the general definition of visualization that the paper uses as a baseline."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"It supplies the definition of visual analytics that the paper contrasts with VisComm definitions."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"It supplies the definition of scientific visualization used as another contrast."},{"cited_title":"Bridging computation and visual communication of change using levels of abstraction, 2018","cited_arxiv_id":null,"evidence_quote":"It is one of the VisComm papers cited for bridging computation and visual communication in the definitional analysis."},{"cited_title":"Ma and B","cited_arxiv_id":null,"evidence_quote":"It is one of the VisComm papers cited for describing visualization as a way to communicate in the definitional analysis."},{"cited_title":"Mangal, M","cited_arxiv_id":null,"evidence_quote":"It is one of the VisComm papers cited for treating comprehension of visual formats as central to communication."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"It is one of the three VisComm papers counted as offering concrete DEI remarks, via a health-equity dashboard."},{"cited_title":"Schwabish and A","cited_arxiv_id":null,"evidence_quote":"It is the single guideline paper counted as offering concrete DEI remarks, via racial-equity awareness in data visualization."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"It is one of the three VisComm papers counted as offering concrete DEI remarks, via design for people with intellectual and developmental disabilities."}],"review_version":1}