pith. sign in

arxiv: 2604.11281 · v1 · submitted 2026-04-13 · 💻 cs.CY

Epistemic Trust as a Mechanism for Ethics Integration: Failure Modes and Design Principles from 70 Moral Imagination Workshops

Pith reviewed 2026-05-10 16:34 UTC · model grok-4.3

classification 💻 cs.CY
keywords epistemic trustethics integrationresponsible innovationmoral imaginationfailure modesdesign principlesengineering teamssocio-technical integration
0
0 comments X

The pith

Epistemic trust explains why ethics interventions succeed or fail in technology development teams

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Bottom-up responsible innovation efforts in tech frequently fail because practitioners dismiss them as irrelevant or disconnected from daily work. The paper introduces epistemic trust as the central mechanism, defined as the degree to which practitioners view an intervention, its facilitators, and its content as credible, relevant, and actionable. Analysis of qualitative data from over 70 moral imagination workshops with engineering teams between 2019 and 2025 yields five dimensions of this trust and a typology of 23 failure modes that arise when the dimensions are neglected. The work also extracts nine design principles for building trust by using technomoral scenarios and structured deliberation. Readers would care because the model turns vague calls for ethics integration into specific, diagnosable conditions for uptake.

Core claim

Epistemic trust is the conceptual model that links intervention design choices to practitioner engagement outcomes in ethics integration. It is operationalized as the extent to which practitioners regard an intervention, its facilitators, and its content as credible, relevant, and actionable. The five salient dimensions are Relevance, Inclusivity, Agency, Authority, and Alignment. When these dimensions are inadequately addressed, a typology of 23 failure modes appears. Nine design principles are derived for cultivating epistemic trust through the operationalization of moral imagination via technomoral scenarios and structured deliberation.

What carries the argument

Epistemic trust, defined through the five dimensions of Relevance, Inclusivity, Agency, Authority, and Alignment, which connects intervention design to engagement by operationalizing moral imagination with technomoral scenarios and structured deliberation.

If this is right

  • High relevance makes practitioners more likely to treat ethics content as connected to their concrete engineering tasks and therefore worth engaging with.
  • Inadequate inclusivity produces perceptions that the intervention excludes certain viewpoints or favors others, leading to disengagement.
  • Low agency leaves practitioners feeling unable to apply ethical insights, so reflection remains abstract rather than actionable.
  • The 23 failure modes supply a diagnostic checklist teams can use to identify why a particular ethics effort is being dismissed.
  • Adopting the nine design principles should raise the probability that ethics interventions achieve sustained uptake rather than one-off compliance.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The dimensions and principles could be adapted and tested in mandated rather than voluntary settings to check whether the same mechanisms hold when participation is required.
  • The framework might extend to other practitioner communities such as data scientists or product managers where similar integration challenges arise.
  • Operationalizing epistemic trust into survey instruments would allow quantitative validation beyond the current qualitative typology.
  • Cultural or organizational differences across global engineering teams may alter which dimensions most strongly influence perceived credibility.

Load-bearing premise

Qualitative patterns observed in voluntary workshops attended by self-selected engineering teams can identify general mechanisms of epistemic trust without formal outcome measures or controls for selection bias.

What would settle it

A controlled comparison in which matched engineering teams receive ethics interventions that either follow or ignore the nine design principles, with subsequent measurement of participation rates, perceived credibility, and actual incorporation of ethical reflection into project decisions.

Figures

Figures reproduced from arXiv: 2604.11281 by Amanda McCroskery, Benjamin Lange, Ben Zevenbergen, Carmen Heringer, Geoff Keeling, Kyle Pedersen, Susan B. Rubin.

Figure 1
Figure 1. Figure 1: Epistemic Trust Mechanism Model to participate deeply, voice concerns, and remain open to perspective shifts. Engagement, in turn, produces desirable ethical outcomes such as the quality of ethical reasoning during deliberation, concrete commitments, and follow-through behaviour after the intervention concludes. We define “failure modes” as design-context mismatches that break this pathway. When an interve… view at source ↗
read the original abstract

Bottom-up responsible innovation initiatives seek to empower technology development teams to engage in ethical reflection, yet such interventions frequently fail to achieve practitioner engagement. Why do some ethics interventions succeed while others are dismissed as irrelevant, adversarial, or disconnected from work? This paper proposes epistemic trust -- the degree to which practitioners regard an intervention, its facilitators, and its content as credible, relevant, and actionable -- as a conceptual model linking intervention design to engagement outcomes. Drawing on philosophical work on testimony and on practice-based qualitative analysis of over 70 moral imagination workshops with engineering teams between 2019 and 2025, we identify five dimensions of epistemic trust salient to ethics interventions (Relevance, Inclusivity, Agency, Authority, and Alignment) and present a typology of 23 failure modes that arise when these dimensions are inadequately addressed. We derive nine design principles for cultivating epistemic trust, grounded in our operationalisation of moral imagination through technomoral scenarios and structured deliberation. Our findings contribute to the literature on collaborative socio-technical integration by specifying conditions of uptake that existing frameworks leave undertheorised. We acknowledge limitations including selection effects from voluntary participation and the absence of formal outcome measures, and position our failure mode typology as practitioner hypotheses warranting further empirical validation.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 3 minor

Summary. The paper claims that epistemic trust—defined via five dimensions of Relevance, Inclusivity, Agency, Authority, and Alignment—functions as a mechanism linking ethics intervention design to practitioner engagement outcomes. Drawing on philosophical work on testimony and qualitative analysis of 70 voluntary moral imagination workshops with engineering teams (2019–2025), it presents a typology of 23 failure modes and derives nine design principles for cultivating epistemic trust through technomoral scenarios and structured deliberation. The work contributes to socio-technical integration literature by specifying uptake conditions and explicitly positions the typology as hypotheses requiring further validation, while noting selection effects and the lack of formal outcome measures.

Significance. If the observed patterns prove robust, the framework could provide actionable guidance for designing ethics interventions that avoid common dismissal by practitioners, filling an undertheorised gap in responsible innovation scholarship. The practice-based derivation of concrete failure modes and design principles from a substantial number of workshops is a notable strength, offering testable hypotheses for future work. However, the interpretive basis limits immediate generalizability and causal claims about the mechanism.

major comments (2)
  1. [Abstract] Abstract: the claim that epistemic trust 'functions as a conceptual model linking intervention design to engagement outcomes' is load-bearing for the contribution, yet the evidence consists solely of facilitator interpretations of voluntary workshops without pre/post engagement metrics, behavioral data, or comparison groups; this makes the typology descriptive of observed patterns rather than demonstrative of a general mechanism, as the abstract itself acknowledges.
  2. [Analysis of workshop data] The section deriving the five dimensions and 23 failure modes from workshop observations: without reported details on the qualitative coding process, number of coders, inter-rater reliability, or explicit mitigation of selection bias from self-selected teams, the typology cannot be assessed for robustness as support for the proposed model.
minor comments (3)
  1. A summary table mapping the 23 failure modes to the five epistemic trust dimensions would improve readability and allow readers to quickly assess coverage.
  2. [Methods] The operationalisation of moral imagination via technomoral scenarios is central to the design principles but would benefit from a brief example scenario in the methods to illustrate how it addresses the dimensions.
  3. [Limitations] The discussion of limitations could be expanded to address how voluntary participation might systematically over-represent teams already open to ethics reflection, potentially affecting the observed failure modes.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for their constructive comments, which highlight important issues of evidential scope and methodological transparency. We address each major comment below and have revised the manuscript accordingly.

read point-by-point responses
  1. Referee: [Abstract] Abstract: the claim that epistemic trust 'functions as a conceptual model linking intervention design to engagement outcomes' is load-bearing for the contribution, yet the evidence consists solely of facilitator interpretations of voluntary workshops without pre/post engagement metrics, behavioral data, or comparison groups; this makes the typology descriptive of observed patterns rather than demonstrative of a general mechanism, as the abstract itself acknowledges.

    Authors: We agree that the evidential basis is interpretive and does not demonstrate a general causal mechanism. The manuscript already frames the typology as hypotheses requiring further validation and acknowledges the absence of formal outcome measures and selection effects. To prevent any overstatement, we have revised the abstract to describe the contribution more precisely as a practice-derived conceptual model and typology of observed patterns, rather than a validated linking mechanism. revision: yes

  2. Referee: [Analysis of workshop data] The section deriving the five dimensions and 23 failure modes from workshop observations: without reported details on the qualitative coding process, number of coders, inter-rater reliability, or explicit mitigation of selection bias from self-selected teams, the typology cannot be assessed for robustness as support for the proposed model.

    Authors: We accept that the original manuscript omitted necessary details on the qualitative process. The dimensions and failure modes emerged from iterative thematic analysis of facilitator observations and notes across the 70 workshops, led by the first author with team discussion but without formal multi-coder reliability metrics, as the approach was reflexive and interpretive. We have added a dedicated Methods subsection describing the analysis steps, the single primary coder with iterative refinement, and an expanded limitations discussion that explicitly addresses selection bias from voluntary participation. These changes enable readers to evaluate the typology's robustness while preserving the study's interpretive character. revision: yes

Circularity Check

0 steps flagged

No significant circularity in derivation chain

full rationale

The paper develops its epistemic trust model, five dimensions, 23 failure modes, and nine design principles through original qualitative analysis of 70 workshops combined with independent philosophical literature on testimony. No equations, fitted parameters, self-referential definitions, or load-bearing self-citations appear in the provided derivation; the typology is explicitly framed as hypotheses rather than proven outputs. The central claims remain self-contained and do not reduce to inputs by construction.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 1 invented entities

The contribution centers on a new interpretive framework built from workshop data; the main untested element is the generalizability of the dimensions and modes.

axioms (1)
  • domain assumption Qualitative analysis of observations from voluntary workshops can identify generalizable dimensions of epistemic trust and associated failure modes.
    This underpins the extraction of the five dimensions and 23 failure modes from the 2019-2025 workshop series.
invented entities (1)
  • Epistemic trust as a five-dimensional conceptual model no independent evidence
    purpose: To link intervention design choices to practitioner engagement outcomes in ethics workshops.
    The model is constructed by the authors from philosophical testimony concepts and their workshop data.

pith-pipeline@v0.9.0 · 5547 in / 1376 out tokens · 41929 ms · 2026-05-10T16:34:56.213520+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

5 extracted references · 5 canonical work pages

  1. [1]

    Alexander, T. M. (1993). John Dewey and the moral imagination: Beyond Putnam and Rorty toward a postmodern ethics.Transactions of the Charles S. Peirce Society, 29(3):369–400. Baier, A. (1986). Trust and antitrust.Ethics, 96(2):231–260. Balmer, A.S., Calvert, J., Marris, C., Molyneux-Hodgson, S., Frow,E., Kearnes, M., etal.(2015). Taking roles in interdis...

  2. [2]

    (2009).The Laws of Disruption: Harnessing the New Forces that Govern Life and Business in the Digital Age

    Downes, L. (2009).The Laws of Disruption: Harnessing the New Forces that Govern Life and Business in the Digital Age. Basic Books. Edmondson, A. (1999). Psychological safety and learning behavior in work teams.Administrative Science Quarterly, 44(2):350–383. Eigenbrode,S.D.,O’Rourke,M.,Wulfhorst,J.D.,Althoff,D.M.,Goldberg,C.S.,Merrill,K.,etal. (2007). Emp...

  3. [3]

    if time allows

    Fonagy, P. and Allison, E. (2014). The role of mentalizing and epistemic trust in the therapeutic relationship.Psychotherapy, 51(3):372–380. Friedman, B. and Hendry, D. G. (2019).Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press. 37 Friedman,B.,Kahn,P.H.,andBorning,A.(2008). Valuesensitivedesignandinformationsystems. InHimma,K.E...

  4. [4]

    Moral imagination for engineering teams: The technomoral scenario.International Review of Information Ethics, 34(1):1–8

    Keeling,G.,Lange,B.,McCroskery,A.,Weinberger,D.,Pedersen,K.,andZevenbergen,B.(2024). Moral imagination for engineering teams: The technomoral scenario.International Review of Information Ethics, 34(1):1–8. Lange, B., Keeling, G., McCroskery, A., Zevenbergen, B., Blascovich, S., Pedersen, K., Lentz, A., and Aguera Y Arcas, B. (2025). Engaging engineering t...

  5. [5]

    Scheman, N. (2001). Epistemology resuscitated: Objectivity as trustworthiness. In Tuana, N. and Morgen, S., editors,Engendering Rationalities, pages 23–52. SUNY Press, Albany, NY. Schroder-Pfeifer, P., Talia, A., Volkert, J., and Taubner, S. (2018). Developing an assessment of epistemic trust: A research protocol.Research in Psychotherapy, 21(3):330. Schu...