REVIEW 3 major objections 4 minor 1 cited by
Teaching Critical Visualization: A Field Report
T0 review · 3 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read This field report argues that a scavenger-hunt-structured graduate course taught critical visualization and met its learning objectives.
desk verdict A useful, honest field report whose success claim in the abstract outruns the evidence the paper itself presents. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the 'course as scavenger hunt' structure: an a la carte menu of activities each with a point value, where an A requires assembling 20 points and the only fixed deadline is the end of the term. This replaces sequential readings plus a final project with student-selected, personally meaningful submissions, and it is the experiment claimed to carry the learning objectives. A second mechanism is the critical-visualization reading corpus—contemporary feminist and critical visualization works supplemented by original theory readings—used to develop criticality, with visualization treated as the subject of study rather than the means.
What would settle it
Have independent raters blindly score pre-course and post-course student work from this class, alongside a comparison group, using a critical-thinking rubric; if post-course scores show no improvement over baseline, the claim that the course developed critical thinking would be unsupported.
Extended reading notes
Core claim
The central claim is that critical visualization can be taught to graduate computer science students using a course structured as a scavenger hunt. Six students engaged with humanistic readings in feminist and critical visualization plus foundational theory, and their submitted works—zines, projects, and syntheses—were judged by the instructor to show coherent understanding; one example applied the notion of vanguardism to data feminism. The report argues that the learning objectives of critical thinking, communication, and theory knowledge were met, and that students from diverse backgrounds grew into more critical thinkers. It also reports an accidental success: the works 'talked to each other' through recurring figures and resonances across readings, giving the course a connective texture. The report's stated position is that the format has value worth further exploration, with improvements such as enforced mid-way deadlines explicitly suggested.
Load-bearing premise
The load-bearing premise is that the instructor's observations of class discussions and his evaluation of students' submitted works are sufficient evidence that the course met its learning objectives.
Editorial extensions
If this is right
- Graduate computer science students can engage with humanistic critical-theory material and apply it in their own work, so critical visualization need not be confined to design or humanities programs.
- The scavenger-hunt structure can elicit creative submissions such as zines, but it needs scaffolding like mid-way deadlines to prevent end-of-term rushes.
- A course of this kind offers computer science curricula a route to critical thinking that complements standard ethics modules.
- Recurring figures and cross-talk among readings can be deliberately used as a connective device in multidisciplinary courses.
- If the format is repeated, other instructors can build on this syllabus as a shared curriculum, making critical visualization teaching more standardized and comparable.
Reading between the lines
- Because the evidence is the instructor's own judgment plus selected student work, the robust lesson is feasibility rather than measured efficacy; an independent pre/post evaluation with a critical-thinking rubric is the natural next test.
- The two-thirds no-submission episode suggests that the format's freedom is its main risk, and mandatory checkpoints could convert a happy accident into a designed feature.
- The same scavenger-hunt container could carry other cross-disciplinary humanistic topics inside computer science, not just visualization, provided the instructor curates a similarly strong reading list.
- The course's recurring named figures from the readings hint that narrative threads could be designed in advance to help students connect theories across sessions.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This field report describes a 2025 graduate computer science course on critical visualization (CS6967) at the University of Utah. The course used an experimental 'scavenger hunt' structure in which students assembled a portfolio of optional, self-designed submissions to earn points, and content focused on feminist and critical visualization supplemented by foundational theory. The report claims that the course was generally successful in meeting three learning objectives: critical thinking, communication about complex ideas, and knowledge of theories in the area. It also reflects on content selection, the scavenger hunt's strengths and failures, and possible future improvements. The six graduate students are listed as co-authors, and the first author is both instructor and report author.
Significance. If the central claim were well-supported, the paper would offer a useful template for teaching critical visualization in graduate CS programs, a topic with little published pedagogy. The report candidly documents both successes and difficulties, including the two-thirds-mark failure to turn in work and the need for instructor intervention. Its value lies in the practical details and honest reflection about course structure and content. However, the significance is seriously limited by the fact that the success claim rests on the instructor's self-assessment and selected student work, with no systematic outcome measurement, independent evaluation, or anonymous student perspectives. The paper is best regarded as a reflective experience report, not as evidence that the learning objectives were achieved.
major comments (3)
- [Abstract and Section 2 (Reflections)] The central claim that the course 'generally was successful, achieving the learning objectives' is not supported by the evidence presented. The evidence consists of the instructor's own impressions ('this class felt successful to me as an educator') and selected student submissions (Figure 1). There is no pre-course baseline, no scoring rubric, no external evaluator, and no comparison group. Because the six students are co-authors of this report, their participation cannot serve as an independent validation of the claimed learning outcomes. The paper should either add a systematic evaluation component or explicitly reframe its contribution as a reflective field report without an effectiveness claim.
- [Section 2.2 (The Scavenger Hunt)] The report itself documents observations that complicate the success narrative: at the two-thirds mark no student had turned in any work, the instructor had to hold one-on-one planning sessions, and the resulting submissions were 'rushed' and 'traditional.' These facts are acknowledged but are not reconciled with the abstract's strong claim of achieving the learning objectives. The paper needs to either integrate these negative observations into a more nuanced conclusion or weaken the overall success claim.
- [Section 2.1 (Utility) and Figure 1] The claim that 'students were able to express cogent syntheses of their learning' is illustrated only by a single figure of zines, with no textual analysis of student work against the stated learning objectives. For a paper whose central claim is about learning outcomes, the evidence chain from course activities to claimed outcomes is missing. If the authors wish to retain the success claim, they should present a more systematic analysis of the submissions (e.g., how each artifact demonstrates critical thinking, communication, or theory knowledge) and acknowledge the absence of external assessment.
minor comments (4)
- [Section 2.2] The point values for the scavenger hunt activities are mentioned ('6 points' or '10 points') but the full list of activities and point values is not given in the paper; it is only available via a URL. Adding a brief table of the available activities and associated points would make the structure more concrete for readers.
- [Figure 1] The figure caption describes the zines as an example of student submissions but does not explain what the zines contain or how they demonstrate learning. A short description of the content or a reference to the archived course materials would help the reader interpret the figure.
- [Section 1] The phrase 'critical moment' is used with a footnote distinguishing from the academic field of critical cartography; this is clear, but the paper would benefit from a brief statement of how the course relates to existing critical visualization pedagogy beyond the cited 'Critical InfoVis' and the CG&A special issue.
- [References] Some references lack complete page numbers or access dates for URLs (e.g., references [3], [6], [12], [14]). These should be completed for a archival version.
Circularity Check
No circular derivation: the success claim is a reflective field-report assessment, not an output forced by its inputs.
full rationale
The paper contains no formal derivation, predictive model, fitted parameter, or uniqueness argument, so the classical circularity failure modes do not apply. The central claim in the Abstract and Section 2 that the course 'generally was successful' and met the learning objectives is an instructor reflection based on felt success, 'cogent syntheses,' and selected student submissions; it is not computed from the course's inputs, so it cannot be equivalent to those inputs by construction. The author's self-citations ([12], [13]) inform course-design choices such as the zine medium and a make-up assignment structure, but they are not cited as evidence that the learning objectives were achieved, so they are not load-bearing. The fact that the students are co-authors and that there is no baseline, rubric, or external evaluation is a measurement/validity concern about an effectiveness claim, not circularity of a derivation chain. The report is also candid about adverse evidence in Section 2.2: at the two-thirds mark no work had been submitted, the instructor held one-on-one planning sessions, and final submissions were 'rushed' and 'traditional.' No quote can be exhibited showing a specific reduction of the conclusion to its inputs. Therefore the appropriate finding is no significant circularity, score 0.
Assumptions & free parameters
free parameters (1)
- Scavenger hunt point values =
6 points (zine), 10 points (project), 20 points for an A
assumptions (2)
- domain assumption Student submissions and instructor observations are valid indicators that learning objectives were met.
- domain assumption The experiences of six self-selected graduate students can support general conclusions about the course design.
Cite this review
Pith. "Pith review of Teaching Critical Visualization: A Field Report." pith.science (2026). https://pith.science/paper/VWCTV46E
@misc{pith2026250802592,
author = {Pith},
title = {Pith review of: Teaching Critical Visualization: A Field Report},
year = {2026},
howpublished = {\url{https://pith.science/paper/VWCTV46E}},
note = {Machine review of arXiv:2508.02592}
}
read the original abstract
Critical Visualization is gaining popularity and academic focus, yet relatively few academic courses have been offered to support students in this complex area. This experience report describes a recent experimental course on the topic, exploring both what the topic could be as well as an experimental content structure (namely as scavenger hunt). Generally the course was successful, achieving the learning objectives of developing critical thinking skills, improving communication about complex ideas, and developing a knowledge about theories in the area. While improvements can be made, we hope that humanistic notions of criticality are embraced more deeply in visualization pedagogy.
Figures
Forward citations
Cited by 1 Pith paper
-
Charting the Moral Universe: Capturing Virtues and Values of Data Visualization Practice
A 20-expert interview study yields a taxonomy of 68 values in nine virtue clusters for ethical data-visualization practice.
Reference graph
Works this paper leans on
-
[1]
ACM. Curricula recommendations. https://www.acm.org/ education/curricula-recommendations, 2025
work page 2025
- [2]
-
[3]
J. W. Crampton and J. Krygier. An introduction to critical cartography. ACME: An International Journal for Critical Geographies , 4(1), 2005
work page 2005
- [4]
- [5]
-
[6]
M. D¨ork and L. Manneh. Decolonizing data visualization – visualizing postcolonies. https://infovis.fh-potsdam.de/decolonizing, 2022
work page 2022
-
[7]
S. Gregor. The nature of theory in information systems. MIS quarterly, pp. 611–642, 2006
work page 2006
-
[8]
P. A. Hall and P. D ´avila. Critical Visualization: Rethinking the Repre- sentation of Data. Bloomsbury Publishing, 2022
work page 2022
Show all 14 references
-
[9]
D. Haraway. Situated knowledges: The science question in feminism and the privilege of partial perspective 1. In Women, science, and technology, pp. 455–472. Routledge, 2013
2013
-
[10]
Horkheimer
M. Horkheimer. Traditional and critical theory. Critical theory: Se- lected essays, 188(243):1–11, 1972
1972
-
[11]
Kennedy, R
H. Kennedy, R. L. Hill, G. Aiello, and W. Allen. The work that visualisation conventions do. Information, Communication & Society , 19(6):715–735, 2016
2016
-
[12]
A. McNutt. Capp 30239 data visualization for pub- lic policy — assignment 11 - make up assignment. https://capp-30239-winter-2020.netlify.app/ #11-make-up-assignment , 2020
2020
-
[13]
A. McNutt. On the potential of zines as a medium for visualization. In 2021 IEEE Visualization Conference (VIS), pp. 176–180. IEEE, 2021
2021
-
[14]
Panagiotidou, A
G. Panagiotidou, A. McNutt, D. Akbaba, N. Hengesbach, and M. Meyer. Critical data visualization—part i.IEEE Computer Graphics and Applications, 45(3):14–16, 2025
2025
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.