Pith. sign in

REVIEW 3 major objections 4 minor 29 references

Experiential AI

T0 review · 3 major / 4 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Art can mediate between computer code and human comprehension to make AI's reasoning visible when technical explanations fall short.

desk verdict A clearly written agenda paper for artistic approaches to AI transparency; the central hypothesis is honestly labeled, but Section 3 overstates what is known and the visibility-accountability premise is shakier than the authors acknowledge. read the letter →

arxiv 1908.02619 v1 pith:GTJ6BBSC submitted 2019-08-06 cs.CY cs.AIcs.LG

Drew Hemment , Ruth Aylett , Vaishak Belle , Dave Murray-Rust , Ewa Luger , Jane Hillston , Michael Rovatsos , Frank Broz This is my paper · ORCID
classification cs.CYcs.AIcs.LG
keywords ExperientialAIartificialintelligencetransparencyexplainablealgorithmicaccountabilityartandtechnologyhuman-centredmachinelearningbiaspublicunderstandingof
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that technical explainability—local explanations, simpler models, and fairness metrics—does not by itself make AI accountable, because it does not address how people actually experience, understand, or contest systems in practice. It proposes Experiential AI as a research agenda in which artists and AI scientists work together to make algorithms' mechanisms vividly apparent through tangible artifacts, performances, and interactive experiences. The hypothesis is that art can mediate between code and human comprehension, revealing the boundaries of systems, the causal chain of decisions, and the ways data shapes algorithmic behavior. A sympathetic reader would care because this offers a route to transparency that complements—and may overcome the limits of—standard explanation methods, and gives audiences concrete objects to discuss and question.

What carries the argument

The central object is the Experiential AI artwork—a concrete artifact, performance, or interactive installation in which an algorithm's operation is made visible and tangible to a user or audience. It carries the argument by turning abstract code into an encounter: the audience sees what the system attends to, what it distorts, where its boundaries lie, and how a decision might have been configured. This staged visibility is what the paper claims creates comprehension, discussion, and the possibility of challenge. The mechanism is named by the authors as art's capacity to make boundaries visible and to explore inter-agencies between people and machines.

What would settle it

A controlled study could settle it: one group encounters an experiential artwork that exposes a known bias in a classifier, another receives a written technical explanation of the same bias, and both groups are then tested on their ability to name the bias, describe the causal chain, and propose a challenge to the decision.

Watch

Extended reading notes

Core claim

The central claim is that artistic practice can serve as a bridge between opaque computer code and human understanding, making AI's reasoning and its social consequences decipherable in ways that technical explanations often are not. The paper positions this as an answer to the call to look 'across systems' rather than inside a single technical object, and to engage with the material and ideological realities of computation. On these terms, artworks such as those that expose distortions in machine vision or bias in classifiers are not merely illustrations of a problem; they are instruments that make the problem visible and contestable. The intended outcome is greater accountability, public literacy, and new configurations of collaboration between humans and machines.

Load-bearing premise

The agenda rests on the premise that making a system's working visible and giving people comprehensible explanations is the key to holding it to account—and that artistic renderings deliver that comprehension in a way that changes what audiences understand and contest.

Editorial extensions

If this is right

  • AI scientists gain a practical channel for exposing a model's failure modes and biases to people who will never read a technical explanation.
  • Artworks become accountability artifacts: stable objects that audiences can revisit, discuss, and use to press for answers about automated decisions.
  • Experiential art can surface the causal chain behind a decision—data choice, algorithm selection, configuration—rather than only a local rationale for a single output.
  • Co-creation between artists and scientists can reframe AI design questions, such as what data to collect and who to collect it about, as aesthetic and ethical choices.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper does not test whether vivid experience durably changes what audiences understand or contest; a natural next step is measuring that effect.
  • If visibility is not the binding constraint on accountability—a caveat the paper's own cited critique raises—the agenda's value would shift toward shaping institutional scrutiny of system-wide design choices rather than individual system comprehension.
  • A controlled comparison between an experiential artwork and a conventional textual explanation for the same algorithm would indicate whether the art adds comprehension or only emotional impact.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. This position paper proposes 'Experiential AI' as a new research agenda in which artists and AI scientists collaborate to make algorithmic systems tangible, visible, and interpretable to non-expert audiences. The abstract states the central hypothesis: art can mediate between computer code and human comprehension, overcoming the limitations of conventional explainable-AI (XAI) techniques. The paper surveys limitations of current accountability and explainability efforts, offers examples of artistic practice (Klingemann, Barrat, DeepDream, Buolamwini, Paglen), and announces an artist-in-residence program launched in 2019 as the first concrete instantiation of the agenda. The manuscript has no experiments or measurements; it argues by illustration and precedent.

Significance. If the central hypothesis is correct, Experiential AI would fill a genuine gap in the XAI literature, which the paper correctly identifies as primarily technical and detached from human, legal, and institutional factors. The paper's strength is that it names a real problem—explanations alone do not yield comprehension or accountability—and it gives the hypothesis an honest label in the abstract. The proposal is also timely and actionable: the announced residency program is a concrete, falsifiable testbed. However, the significance is conditional, because the load-bearing causal chain from artistic artifacts to audience comprehension, and from comprehension to accountability, is asserted without evidence. The manuscript currently overstates what artistic practice has already achieved, presenting plausible hopes as established facts.

major comments (3)
  1. [Section 2, 'Accountability and explainability in AI'] The load-bearing premise is stated as 'unless the operation of a system is visible, and people can access comprehensible explanations, it cannot be held to account.' This premise is immediately followed by a citation to Ananny and Crawford (2018), whose central argument is that transparency and visibility are not sufficient for accountability because accountability is distributed across sociotechnical systems. The manuscript does not reconcile these two positions; rather, it uses their call for deeper engagement as support while ignoring their direct challenge to the visibility-accountability equation. Please either weaken the premise to a research hypothesis or engage with Ananny and Crawford's argument that visibility is not the bottleneck.
  2. [Section 3, 'Artists addressing such AI challenges'] Several sentences assert outcomes as fact rather than hypothesis: artistic approaches 'enable the character of machine reasoning and vision to be made explicit' and 'helping to build literacy in those systems,' and artistic experiments 'brings to life and question what an algorithm does.' No evidence is provided that any audience actually achieves comprehension, literacy, or the ability to question algorithms through these works. The cited examples (Klingemann, Barrat, DeepDream) demonstrate artistic production, not measurable effects on viewers. Kolb's experiential learning (Kolb, 2014) is a general educational theory, not empirical support for AI-specific literacy gains. Please reframe these claims as hypotheses to be tested in the residency program, or add empirical evidence if any exists.
  3. [Section 3, paragraph on ethics] The claim that 'Experiential approaches (Kolb, 2014) can act as a powerful mechanism' for internalizing ethical standards is unsupported. The mechanism from a role-play or narrative experience to durable ethical internalization in the specific context of AI systems is not established, and the reference to Boal's Forum Theatre is evocative but not evidential. Since ethical internalization is one of the promised benefits of Experiential AI, this step needs either a more explicit argument with intermediate evidence or a clear statement that it is an open research question.
minor comments (4)
  1. [Section 2, first paragraph] Typographical error: 'his has led' should read 'This has led.'
  2. [References] The reference entry beginning 'Sharif, M., Bhagavatula, S., Bauer, L., & Reiter, M. K.' is followed by a stray '(2018).' on its own line, likely a formatting error.
  3. [References] The entry 'Donnarumma, M. (n.d.). Is artificial intelligence set to become arts next medium?' lacks a source or URL; please complete it or remove it.
  4. [Section 3, 'Plugging 50,000 portraits into facial recognition'] The citation style for the Reddit reference is inconsistent with the rest of the reference list; the author name and date are missing from the in-text citation.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity: the central claim is explicitly labeled a hypothesis, and the paper's own examples and citations are not derived from the claim by construction.

full rationale

The paper contains no formal derivation, fitted parameter, uniqueness theorem, or predictive quantity that could be reduced to its inputs. The abstract states, 'The hypothesis is that art can mediate between computer code and human comprehension to overcome the limitations of explanations in and for AI systems', so the central assertion is offered as a research agenda rather than as a result derived from its own terms. Section 3 supports the agenda with external examples (Klingemann, Barrat, Buolamwini, Paglen) and with general educational theory (Kolb, Boal), not with a chain of equations or with a fitted parameter renamed as a prediction. The only self-citation is Hemment, Bletcher, and Coulson (2017), used to say that such practice 'can create experiences around social impacts and consequences of technology, and create insights to feed into the design of the technologies'; this is background evidence for an already plausible point and is not load-bearing for the central hypothesis. Section 2's visibility premise ('unless the operation of a system is visible, and people can access comprehensible explanations, it cannot be held to account') is an asserted premise, not a conclusion, and the later Ananny and Crawford citation actually raises an evidence risk about whether visibility is sufficient; that is a correctness concern, not a circularity. The proposed artist residency is part of the agenda rather than evidence validating the agenda. Thus there is no derivation chain that reduces to itself; the score of 1 reflects only the minor self-referential support and the absence of empirical verification, not a circular structure.

Assumptions & free parameters 0 free parameters · 4 assumptions · 1 invented entities

The paper is a position statement with no mathematics or measurements, so no free parameters exist. Its argument rests on unproven premises: the central efficacy hypothesis (art improves comprehension of AI), the visibility-to-accountability assumption in Section 2, a characterization of XAI research as purely technical, and imported learning-theory claims (Kolb 2014; Boal 2013) applied to AI contexts without testing. The only introduced entity is the agenda label itself.

assumptions (4)
  • ad hoc to paper Artistic and experiential engagement can transfer comprehension of algorithmic systems to human audiences
    Labeled 'the hypothesis' in the abstract; it is the premise the whole agenda rests on and is not established by any study in the paper.
  • domain assumption Unless a system's operation is visible and comprehensible, it cannot be held to account
    Section 2, paragraph 5: 'unless the operation of a system is visible, and people can access comprehensible explanations, it cannot be held to account.' Load-bearing and contested by the paper's own citation of Ananny and Crawford (2018), who argue the transparency ideal is limited.
  • domain assumption Current explainability research is primarily technical and ignores human, legal, regulatory, and institutional factors
    Section 2 asserts this characterization to motivate the agenda; no systematic survey supports it, and the paper itself cites technical work that engages human factors (Ribeiro et al. 2016; Weld and Bansal 2018).
  • domain assumption Experiential learning, narrative, and role-play generate insight and safe reflection that transfer to real settings
    Section 3 invokes Kolb (2014) and Boal (2013) to support the claim that artistic experiences change understanding; the paper cites these theories but does not test them in AI contexts.
invented entities (1)
  • Experiential AI as a named research agenda
    purpose: Labels and organizes a program of artist-scientist collaborations and residencies aimed at making AI transparent, and doubles as the paper's organizing concept.
    A new name and institutional frame, not a scientific entity; it has no falsifiable handle of its own and its success criteria are defined by the program that administers it.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Experiential AI." pith.science (2026). https://pith.science/paper/GTJ6BBSC

@misc{pith2026190802619,
  author       = {Pith},
  title        = {Pith review of: Experiential AI},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/GTJ6BBSC}},
  note         = {Machine review of arXiv:1908.02619}
}
read the original abstract

Experiential AI is proposed as a new research agenda in which artists and scientists come together to dispel the mystery of algorithms and make their mechanisms vividly apparent. It addresses the challenge of finding novel ways of opening up the field of artificial intelligence to greater transparency and collaboration between human and machine. The hypothesis is that art can mediate between computer code and human comprehension to overcome the limitations of explanations in and for AI systems. Artists can make the boundaries of systems visible and offer novel ways to make the reasoning of AI transparent and decipherable. Beyond this, artistic practice can explore new configurations of humans and algorithms, mapping the terrain of inter-agencies between people and machines. This helps to viscerally understand the complex causal chains in environments with AI components, including questions about what data to collect or who to collect it about, how the algorithms are chosen, commissioned and configured or how humans are conditioned by their participation in algorithmic processes.

Figures

Figures reproduced from arXiv: 1908.02619 by the authors.

Figure 1
Figure 1. Neural Glitch 1540737325 c Mario Klingemann 2018 4 [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

29 extracted references · 28 canonical work pages

  1. [1]

    \ Crawford, K

    ananny2018seeing APACrefauthors Ananny, M. \ Crawford, K. APACrefauthors \ 2018 . Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability . New Media & Society 20 3 973--989

    work page 2018

  2. [2]

    mediaArtBetween APACrefauthors Ars Electronica APACrefauthors \ ( ). \ 2017 . Media art between natural and artificial intelligence, 7-11 Sept 2017 . Media art between natural and artificial intelligence, 7-11 Sept 2017 . https://ars.electronica.art/ai/en/media-art-between-natural-and-artificial-intelligence/

    work page 2017

  3. [3]

    APACrefauthors \ 2017

    belle2017logic APACrefauthors Belle, V. APACrefauthors \ 2017 . Logic meets Probability: Towards Explainable AI Systems for Uncertain Worlds. Logic meets probability: Towards explainable ai systems for uncertain worlds. IJCAI Ijcai \ ( \ 5116--5120)

    work page 2017

  4. [4]

    APACrefauthors \ 2013

    boal2013rainbow APACrefauthors Boal, A. APACrefauthors \ 2013 . The rainbow of desire: The Boal method of theatre and therapy The rainbow of desire: The boal method of theatre and therapy . Routledge

    work page 2013

  5. [5]

    , Sanfilippo, M

    campolo2017ai APACrefauthors Campolo, A. , Sanfilippo, M. , Whittaker, M. \ Crawford, K. APACrefauthors \ 2017 . AI Now 2017 report Ai now 2017 report . AI Now Institute at New York University

    work page 2017

  6. [6]

    \ Nielsen, M

    carter2017using APACrefauthors Carter, S. \ Nielsen, M. APACrefauthors \ 2017 . Using artificial intelligence to augment human intelligence Using artificial intelligence to augment human intelligence . Distill 2 12 e9

    work page 2017

  7. [7]

    , Sinnott-Armstrong, W

    conitzer2017moral APACrefauthors Conitzer, V. , Sinnott-Armstrong, W. , Borg, J S. , Deng, Y. \ Kramer, M. APACrefauthors \ 2017 . Moral decision making frameworks for artificial intelligence Moral decision making frameworks for artificial intelligence . Thirty-First AAAI Conference on Artificial Intelligence. Thirty-first aaai conference on artificial in...

    work page 2017

  8. [8]

    APACrefauthors \ 2015

    domingos2015master APACrefauthors Domingos, P. APACrefauthors \ 2015 . The master algorithm: How the quest for the ultimate learning machine will remake our world The master algorithm: How the quest for the ultimate learning machine will remake our world . Penguin

    work page 2015

Show all 29 references
  1. [9]

    APACrefauthors \

    donnarumma2019AIProsthetics APACrefauthors Donnarumma, M. APACrefauthors \ . Is artificial intelligence set to become art’s next medium? Is artificial intelligence set to become art’s next medium?

  2. [10]

    \ Veale, M

    edwards2017slave APACrefauthors Edwards, L. \ Veale, M. APACrefauthors \ 2017 . Slave to the algorithm: Why a right to an explanation is probably not the remedy you are looking for Slave to the algorithm: Why a right to an explanation is probably not the remedy you are looking...

    2017

  3. [11]

    \ Gillies, M

    fiebrink2018HumanCentred APACrefauthors Fiebrink, R. \ Gillies, M. APACrefauthors \ 2018 06 . Introduction to the Special Issue on Human-Centered Machine Learning Introduction to the special issue on human-centered machine learning . ACM Trans. Interact. Intell. Syst. 8 2 7:1-...

    2018 doi

  4. [12]

    APACrefauthors \ 2009

    gere2009digital APACrefauthors Gere, C. APACrefauthors \ 2009 . Digital culture Digital culture . Reaktion Books

    2009

  5. [13]

    APACrefauthors \ 2017

    gunning2017explainable APACrefauthors Gunning, D. APACrefauthors \ 2017 . Explainable artificial intelligence (xai). Explainable artificial intelligence (xai). https://tinyurl.com/yccmn477 . Accessed: 12/3/18

    2017

  6. [14]

    \ Kleiman-Weiner, M

    halpern2018towards APACrefauthors Halpern, J Y. \ Kleiman-Weiner, M. APACrefauthors \ 2018 . Towards formal definitions of blameworthiness, intention, and moral responsibility Towards formal definitions of blameworthiness, intention, and moral responsibility . Thirty-Second AA...

    2018

  7. [15]

    \ Belle, V

    hammond2018deep APACrefauthors Hammond, L. \ Belle, V. APACrefauthors \ 2018 . Deep Tractable Probabilistic Models for Moral Responsibility Deep tractable probabilistic models for moral responsibility . arXiv preprint arXiv:1810.03736

    2018 arXiv

  8. [16]

    APACrefauthors \ 1999

    harris1999xerox APACrefauthors Harris, C. APACrefauthors \ 1999 . The Xerox Palo Alto Research Center Artist-in-Residence Program Landscape The xerox palo alto research center artist-in-residence program landscape . Art and innovation Art and innovation \ ( \ 2--11)

    1999

  9. [17]

    , Bletcher, J

    hemment2017art APACrefauthors Hemment, D. , Bletcher, J. \ Coulson, S. APACrefauthors \ 2017 . Art, creativity and civic participation in IoT and Smart City innovation through ‘Open Prototyping’ Art, creativity and civic participation in iot and smart city innovation through ‘...

    2017

  10. [18]

    APACrefauthors \ 2018

    house2018ai APACrefauthors House Of Lords Select Committee . APACrefauthors \ 2018 . AI in the UK: ready, willing and able? Ai in the uk: ready, willing and able? https://publications.parliament.uk/pa/ld201719/ldselect/ldai/100/100.pdf

    2018

  11. [19]

    https://www.christies.com/features/A-collaboration-between-two-artists-one-human-one-a-machine-9332-1.aspx

    christies2019portrait Is artificial intelligence set to become art’s next medium? Is artificial intelligence set to become art’s next medium? 2018 . https://www.christies.com/features/A-collaboration-between-two-artists-one-human-one-a-machine-9332-1.aspx

    2018

  12. [20]

    , Lauk, E

    jouhki2016facebook APACrefauthors Jouhki, J. , Lauk, E. , Penttinen, M. , Sormanen, N. \ Uskali, T. APACrefauthors \ 2016 . Facebook’s emotional contagion experiment as a challenge to research ethics Facebook’s emotional contagion experiment as a challenge to research ethics ....

    2016

  13. [21]

    , Ludwig, J

    kleinberg2018algorithmic APACrefauthors Kleinberg, J. , Ludwig, J. , Mullainathan, S. \ Rambachan, A. APACrefauthors \ 2018 . Algorithmic fairness Algorithmic fairness . AEA Papers and Proceedings Aea papers and proceedings \ ( 108, \ 22--27)

    2018

  14. [22]

    APACrefauthors \ 2014

    kolb2014experiential APACrefauthors Kolb, D A. APACrefauthors \ 2014 . Experiential learning: Experience as the source of learning and development Experiential learning: Experience as the source of learning and development . FT press

    2014

  15. [23]

    \ Ramamoorthy, S

    penkov2017using APACrefauthors Penkov, S. \ Ramamoorthy, S. APACrefauthors \ 2017 . Using program induction to interpret transition system dynamics Using program induction to interpret transition system dynamics . arXiv preprint arXiv:1708.00376

    2017 arXiv

  16. [24]

    Plugging 50,000 portraits into facial recognition

    reddit2019portraits Plugging 50,000 portraits into facial recognition. Plugging 50,000 portraits into facial recognition. 2018 . https://www.reddit.com/r/Damnthatsinteresting/comments/9udese/plugging_50000_portraits_into_facial/

    2018

  17. [25]

    , Singh, S

    ribeiro2016should APACrefauthors Ribeiro, M T. , Singh, S. \ Guestrin, C. APACrefauthors \ 2016 . Why should i trust you?: Explaining the predictions of any classifier Why should i trust you?: Explaining the predictions of any classifier . Proceedings of the 22nd ACM SIGKDD in...

    2016

  18. [26]

    , Bhagavatula, S

    sharif2016accessorize APACrefauthors Sharif, M. , Bhagavatula, S. , Bauer, L. \ Reiter, M K. APACrefauthors \ 2016 . Accessorize to a crime: Real and stealthy attacks on state-of-the-art face recognition Accessorize to a crime: Real and stealthy attacks on state-of-the-art fac...

    2016

  19. [27]

    , Van Kleek, M

    veale2018fairness APACrefauthors Veale, M. , Van Kleek, M. \ Binns, R. APACrefauthors \ 2018 . Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making Fairness and accountability design needs for algorithmic support in high...

    2018

  20. [28]

    \ Bansal, G

    weld2018intelligible APACrefauthors Weld, D S. \ Bansal, G. APACrefauthors \ 2018 . Intelligible artificial intelligence Intelligible artificial intelligence . arXiv preprint arXiv:1803.04263

    2018 arXiv

  21. [29]

    encodingCultures APACrefauthors Zentrum fur Kunst und Medien APACrefauthors \ ( ). \ 2018 . Encoding Cultures: Living amongst intelligent machines, 27 April 2018 . Encoding Cultures: Living amongst intelligent machines, 27 April 2018 . https://zkm.de/en/event/2018/04/encoding-...

    2018

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.