Pith. sign in

REVIEW 4 cited by

Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systems

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1806.07552 v1 pith:23VKFWUT submitted 2018-06-20 cs.AI

classification cs.AI
keywords interpretablelearningmachinemodelsysteminterpretabilityagentrelation
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a model intended to help answer this question, by identifying different roles that agents can fulfill in relation to the machine learning system. We illustrate the use of our model in a variety of scenarios, exploring how an agent's role influences its goals, and the implications for defining interpretability. Finally, we make suggestions for how our model could be useful to interpretability researchers, system developers, and regulatory bodies auditing machine learning systems.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 85 citations worldwide. Full citation record

  1. The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems

    cs.CY 2026-02 accept novelty 6.0 of 10

    The 2025 AI Agent Index catalogs technical and safety details for 30 deployed AI agents and finds low developer transparency on safety, evaluations, and societal impacts.

  2. Are machine learning interpretations reliable? A stability study on global interpretations

    stat.ML 2025-05 conditional novelty 6.0 of 10

    Popular machine learning interpretation methods are frequently unstable under small data perturbations, and interpretation stability does not track prediction accuracy.

  3. A Taxonomy for Design and Evaluation of Prompt-Based Natural Language Explanations

    cs.CL 2025-07 conditional novelty 4.0 of 10

    A three-part taxonomy for prompt-based natural language explanations, covering context, generation and presentation, and evaluation with 15 desirable properties.

  4. Explainable AI Systems Must Be Contestable: Here's How to Make It Happen

    cs.CY 2025-06 reject novelty 4.0 of 10

    The paper proposes a definition of contestability for AI, a four-dimension taxonomy, and a weighted Contestability Assessment Score, applied to three illustrative case studies.

Pith tools