Pith. sign in

REVIEW 5 major objections 5 minor 29 references

Triadic Fusion of Cognitive, Functional, and Causal Dimensions for Explainable LLMs: The TAXAL Framework

T0 review · 5 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash

Pith's one-line read This paper claims that no single explainability dimension suffices for LLMs; only the fusion of cognitive, functional, and causal dimensions can meet stakeholder needs in high-risk domains, and it proposes the TAXAL framework to scaffold th

desk verdict A coherent triadic framework for LLM explainability, but its central necessity claim is more asserted than demonstrated; still worth a referee. read the letter →

arxiv 2509.05199 v1 pith:PBCD2KZZ submitted 2025-09-05 cs.CL

classification cs.CL
keywords explainableAIlargelanguagemodelsTAXALframeworkagenticcognitive-functional-causaldimensionshuman-AIcollaborationexplanationevaluationstakeholderroles
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper proposes TAXAL, a framework claiming that explainability for large language models fails when reduced to any single dimension. It distinguishes three complementary dimensions—cognitive (whether users understand the explanation), functional (whether the explanation is practically usable in a workflow), and causal (whether the explanation is faithful to the model's actual reasoning)—and argues that only their integration meets the needs of different stakeholders in high-risk settings like law, healthcare, education, and public services. The contribution is a role-sensitive scaffolding that maps existing explanation techniques to these dimensions, illustrated through six case studies and a medical diagnosis scenario, plus design patterns and adoption pathways. If correct, it gives practitioners a structured way to design, evaluate, and deploy explanations that support trust, contestability, and accountability in agentic LLMs.

What carries the argument

The TAXAL triadic fusion model: a conceptual lens that classifies any explanation strategy by its cognitive alignment (how well it matches user mental models), functional alignment (how well it supports practical workflows), and causal alignment (how faithfully it traces the model's actual decision pathway). The framework carries the argument through three artifacts: a mapping of explanation techniques to the three dimensions, scoring matrices rating their alignment strength, and cross-domain case studies showing how stakeholder roles shift the required emphasis among the dimensions.

What would settle it

A controlled study where the same explanation is presented with each dimension independently varied—for example, high cognitive clarity but deliberately unfaithful causal traces, or faithful causal traces but poor comprehensibility—within a high-risk decision task. If stakeholders still rate explanation quality as acceptable when any one dimension is absent, or if single-dimension methods match triadic fusion on trust calibration and audit outcomes, the necessity of triadic fusion is refuted.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that explainability is not a single property but a triadic alignment problem: cognitive, functional, and causal dimensions form a required unit, and no single technique excels across all of them simultaneously. The paper operationalizes this by mapping techniques such as chain-of-thought prompting, token attribution, counterfactuals, concept bottlenecks, and dialogic interfaces to the dimension they primarily serve, and by rating their alignment strength in a scoring matrix. It then argues that different stakeholders—developers, regulators, doctors, patients—require different weightings of these dimensions, and that explanation design must t

Load-bearing premise

The paper assumes the three dimensions—cognitive, functional, and causal—can be assessed independently and are jointly sufficient to determine explanation quality for all stakeholders, but it provides no measurement protocol; the high/medium/low ratings in Tables 4 and 5 are untested interpretive choices, as the paper itself concedes in its limitations on missing formal mapping criteria and empirical evaluation gaps.

Editorial extensions

If this is right

  • Practitioners can use TAXAL as a structured checklist to ensure explanation pipelines cover cognitive, functional, and causal requirements instead of optimizing a single dimension.
  • Evaluation of explainability should combine plausibility, faithfulness, truthfulness, and contrastivity metrics mapped onto the three axes, moving beyond static plausibility scores.
  • Stakeholder-specific explanation layers—simple rationales for end users, causal traces for auditors—become a design requirement in high-risk deployments, not an optional add-on.
  • Procurement and compliance processes should require documentation of which dimensions an explanation system addresses, for whom, and at what granularity.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Inference: The triadic split implies a testable prediction—explanations rated high on cognitive and functional dimensions but low on causal fidelity will fail audit or compliance scrutiny, while high causal fidelity alone will fail to build user trust; controlled studies varying each dimension independently would reveal such interaction effects.
  • Inference: TAXAL's qualitative scoring matrices (Tables 4 and 5) could be operationalized into a quantitative rubric—user-rated comprehensibility for the cognitive axis, task-completion metrics for the functional axis, and counterfactual consistency or causal tracing agreement for the causal axis—yielding a common scale for comparing explanation methods.
  • Inference: For agentic LLMs that decompose tasks and chain tool calls, the causal dimension would need to expand to include goal provenance, subgoal decomposition, and inter-agent dependencies, making TAXAL a natural starting point for tracing multi-step plans rather than only single outputs.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. The paper introduces TAXAL, a conceptual framework for explainability of large language models (LLMs), organized around three dimensions: cognitive (user understanding), functional (practical utility), and causal (faithful reasoning). The authors argue that no single dimension suffices and that only their triadic fusion can meet the diverse needs of stakeholders in high-risk sociotechnical domains. The paper synthesizes existing XAI techniques, maps them onto the three dimensions (Tables 3-5), presents six cross-domain case studies plus a detailed medical scenario (Section 4), and proposes design patterns and adoption pathways (Sections 5.2-5.3). Section 5.4 lists limitations including lack of formal mapping criteria and empirical validation gaps.

Significance. If the TAXAL framework were properly operationalized and validated, it could provide a useful shared vocabulary for comparing and designing explanation strategies across LLM deployments, especially in regulated or safety-critical settings. The paper is clearly written, covers a broad literature, and is honest about several of its own limitations, particularly in Table 8 and the explicit note that the medical scenario is simulated. However, the paper is entirely conceptual: there is no empirical data, no quantitative evaluation, and the central claim is asserted rather than tested. The framework's practical value therefore remains a plausible hypothesis rather than a demonstrated contribution.

major comments (5)
  1. [§3.1, Tables 4-5, §6] The central claim (Section 6) that 'no single dimension is sufficient in isolation' presupposes a well-defined notion of a single-dimensional explanation, but none is provided. In Tables 4 and 5 every technique is rated High or Medium on at least two dimensions (e.g., CoT: High/High/Medium; SHAP: Medium/High/High), so no row instantiates the 'single dimension in isolation' regime. As stated, the claim is unfalsifiable and risks reducing to the tautology that all three measured aspects matter. The authors should define single-dimensional explanations operationally, for example by requiring a protocol that varies one dimension while holding the others fixed, and give a scoring rubric that permits such ratings.
  2. [§5.4, Table 8, §4.2] The limitations explicitly acknowledge 'Lack of Formal Mapping Criteria' and 'Empirical Evaluation Gaps,' and the medical scenario is explicitly labeled simulated (Section 4.2, Remark). These are not merely future-work items; they directly undermine the paper's central empirical claim that triadic integration is necessary. Without at least one real stakeholder evaluation or a clearly scoped repositioning of TAXAL as a heuristic taxonomy rather than a validated model, the conclusion in Section 6 overstates the evidence.
  3. [Tables 4 and 5, §3.1] The High/Medium/Low ratings are introduced as 'illustrative' but are later used to derive trade-off conclusions and design recommendations (e.g., Section 5.2). The paper does not specify how these ratings were produced, who assigned them, or what criteria distinguish High from Medium. Unless a reproducible scoring procedure is given, the tables cannot support the framework's practical claims and remain interpretive choices.
  4. [§4.1, case studies] The six case-study domains are selected without stated criteria, and each scenario is described using TAXAL's own categories. This makes the case studies consistent with the framework by construction rather than confirming it. The closing paragraph of Section 4.1 says the cases 'validate the framework's capacity,' which is stronger than what illustrative scenarios can establish. I recommend recasting these as worked examples and reserving 'validation' for empirical studies.
  5. [§2.3.1, §3.1] The mapping of evaluation criteria onto TAXAL dimensions (faithfulness→causal, plausibility→cognitive, truthfulness→functional, contrastivity→cognitive/causal) is asserted without justification or derivation. Since this mapping is foundational to the triadic split, the paper should explain why these criteria align with these dimensions rather than other groupings, or acknowledge the choice as one possible taxonomy among several.
minor comments (5)
  1. [Table 6] Typo: 'Sentiment Analysis Alanlysis' should be 'Sentiment Analysis Analysis' or 'Sentiment Analysis.'
  2. [§4.2] Grammar: 'we propose an TAXAL-based validation framework' should be 'a TAXAL-based validation framework.'
  3. [References [13] and [14]] The JAILJUDGE reference appears twice in different forms; please merge into one consistent entry.
  4. [§5.4, Table 8] The sentence 'Framework lacks validation across real-world domains and tasks' is a key admission and should be connected more explicitly in the main text to the earlier case-study claims, rather than only appearing in a table.
  5. [General] The manuscript uses 'demonstrates' and 'validates' in several places (abstract, Section 4.1, Conclusion) while also acknowledging the absence of empirical validation. Align the language with the actual evidence level, e.g., 'illustrates' or 'exemplifies.'

Circularity Check

1 steps flagged · score 3.0 of 10

No derivational circularity in the framework itself, but the illustrative mapping in Table 4 is self-authored and then used to reinforce the central claim, making that supporting evidence partially self-validating.

  1. other [Section 3.1, Table 4 and following paragraph]
    "This mapping illustrates that no single technique excels in all dimensions, reinforcing the importance of stakeholder-sensitive explanation strategies that balance cognitive clarity, functional utility, and causal fidelity."

    The table is constructed for TAXAL: each row is assigned High/Medium ratings by the authors with no scoring rubric (Section 5.4 admits 'Current mapping relies on qualitative judgment'), and the legend explicitly notes Low 'does not appear with the current selected XAI techniques.' The sentence after the table reads the conclusion that techniques are multi-dimensional—'no single technique excels in all dimensions'—directly off those self-assigned ratings and calls it reinforcing for the TAXAL thesis. The observation is therefore a summary of the table's own inputs, not an independent confirmation; the supporting evidence is self-validating.

full rationale

TAXAL is a conceptual framework with no equations, fitted parameters, or empirical predictions to reduce. The central claim in Section 6—'no single dimension is sufficient in isolation'—is a normative stance about stakeholder needs, not a mathematically derived result. The case studies are explicitly presented as illustrative and, in the medical scenario, as a 'simulated scenario without real doctors and patients.' The paper's self-citations (e.g., Herrera [6,7], LoBOX [8]) are present but not load-bearing: the triadic dimensions are defined in the paper itself and are mapped onto standard external XAI techniques such as SHAP, LIME, Chain-of-Thought, and counterfactuals. The main circularity-adjacent move is the use of the author-assigned qualitative ratings in Tables 4 and 5 to 'reinforce' the triadic-fusion claim; because the ratings are the authors' own classification, drawing the multi-dimensionality conclusion from them is self-validating rather than independent. Section 5.4 openly acknowledges 'Lack of Formal Mapping Criteria' and 'Empirical Evaluation Gaps,' which confirms that the tables are interpretive rather than tested. This lowers the evidential weight of the illustrative mapping but does not make the whole framework's central claim a derivation from its own inputs, so a score of 3 is appropriate rather than a higher score reserved for predictions that reduce by construction.

Assumptions & free parameters 2 free parameters · 4 assumptions · 1 invented entities

The paper relies on the triad structure as a postulate, on unmeasured qualitative ratings, and on hand-picked case studies. These are the main inputs the reader must accept on faith. No physical entities are introduced, but the TAXAL framework itself is the central conceptual construct.

free parameters (2)
  • Technique-dimension alignment ratings (High/Medium/Low) in Tables 4 and 5 = Various (e.g., CoT: cognitive High, functional High, causal Medium)
    Assigned by authors based on qualitative judgment, not measured or validated. These underpin the framework's operationalization.
  • Selection of six case study domains (law, education, public service, HR, mental health, jailbreak) = N/A
    Chosen by hand to illustrate the framework; not a systematic sample, so conclusions about generalizability are unsupported.
assumptions (4)
  • domain assumption Explainability can be decomposed into cognitive, functional, and causal dimensions that are jointly necessary and sufficient.
    This is the core postulate of TAXAL; no evidence is offered that these three dimensions cover all relevant aspects or are mutually exclusive. Introduced in Section 3.
  • domain assumption Existing explanation techniques can be meaningfully compared along these dimensions using qualitative ratings.
    Assumes that High/Medium/Low ratings are meaningful and comparable across heterogeneous methods without a measurement protocol. Used in Tables 4 and 5.
  • domain assumption Faithful causal explanations of LLM behavior are achievable via counterfactuals, tracing, and attribution.
    The paper itself notes that post-hoc methods often compromise faithfulness, yet the framework treats causal tracing as a viable dimension. Stated in Section 3.1.
  • ad hoc to paper The six case studies are representative of real-world high-risk deployment scenarios.
    The medical case is explicitly simulated (Section 4.2); other cases are stylized narratives, not empirical studies, so their representativeness is assumed.
invented entities (1)
  • TAXAL framework
    purpose: Organizes explainability methods into cognitive, functional, causal dimensions with role-sensitive mapping.
    A conceptual invention; no falsifiable predictions or independent validation are provided, only illustrative case studies.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Triadic Fusion of Cognitive, Functional, and Causal Dimensions for Explainable LLMs: The TAXAL Framework." pith.science (2026). https://pith.science/paper/PBCD2KZZ

@misc{pith2026250905199,
  author       = {Pith},
  title        = {Pith review of: Triadic Fusion of Cognitive, Functional, and Causal Dimensions for Explainable LLMs: The TAXAL Framework},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/PBCD2KZZ}},
  note         = {Machine review of arXiv:2509.05199}
}
read the original abstract

Large Language Models (LLMs) are increasingly being deployed in high-risk domains where opacity, bias, and instability undermine trust and accountability. Traditional explainability methods, focused on surface outputs, do not capture the reasoning pathways, planning logic, and systemic impacts of agentic LLMs. We introduce TAXAL (Triadic Alignment for eXplainability in Agentic LLMs), a triadic fusion framework that unites three complementary dimensions: cognitive (user understanding), functional (practical utility), and causal (faithful reasoning). TAXAL provides a unified, role-sensitive foundation for designing, evaluating, and deploying explanations in diverse sociotechnical settings. Our analysis synthesizes existing methods, ranging from post-hoc attribution and dialogic interfaces to explanation-aware prompting, and situates them within the TAXAL triadic fusion model. We further demonstrate its applicability through case studies in law, education, healthcare, and public services, showing how explanation strategies adapt to institutional constraints and stakeholder roles. By combining conceptual clarity with design patterns and deployment pathways, TAXAL advances explainability as a technical and sociotechnical practice, supporting trustworthy and context-sensitive LLM applications in the era of agentic AI.

Figures

Figures reproduced from arXiv: 2509.05199 by the authors.

Figure 1
Figure 1. Graphical abstract: TAXAL triadic fusion framework [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. “How to read TAXAL”: from stakeholder role to triadic fusion (cognitive–functional–causal), then to strategy [PITH_FULL_IMAGE:figures/full_fig_p007_2.png] view at source ↗
Figure 3
Figure 3. Application of the TAXAL triadic fusion framework in a clinical decision support system. The same [PITH_FULL_IMAGE:figures/full_fig_p018_3.png] view at source ↗

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

29 extracted references · 19 canonical work pages

  1. [1]

    Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI

    Alejandro Barredo Arrieta et al. “Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI”. In:Information Fusion58 (2020), pp. 82–115

  2. [2]

    On selective, mutable and dialogic XAI: A review of what users say about different types of interactive explanations

    Astrid Bertrand et al. “On selective, mutable and dialogic XAI: A review of what users say about different types of interactive explanations”. In:Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 2023, pp. 1–21

  3. [3]

    Xai meets llms: A survey of the relation between explainable ai and large language models

    Erik Cambria et al. “Xai meets llms: A survey of the relation between explainable ai and large language models”. In:arXiv preprint arXiv:2407.15248(2024)

  4. [4]

    Unveiling the Black Box: The Significance of XAI in Making LLMs Transparent

    Murillo Edson Carvalho Souza, Murillo Edson De Carvalho Souza, and Li Weigang. “Unveiling the Black Box: The Significance of XAI in Making LLMs Transparent”. In:Authorea Preprints(2025)

  5. [5]

    Is Conversational XAI All You Need? Human-AI Deci- sion Making With a Conversational XAI Assistant

    Gaole He, Nilay Aishwarya, and Ujwal Gadiraju. “Is Conversational XAI All You Need? Human-AI Deci- sion Making With a Conversational XAI Assistant”. In:Proceedings of the 30th International Conference on Intelligent User Interfaces. 2025, pp. 907–924

  6. [6]

    Making Sense of the Unsensible: Reflection, Survey, and Challenges for XAI in Large Language Models Toward Human-Centered AI

    Francisco Herrera. “Making Sense of the Unsensible: Reflection, Survey, and Challenges for XAI in Large Language Models Toward Human-Centered AI”. In:arXiv preprint arXiv:2505.20305(2025)

  7. [7]

    Reflections and attentiveness on eXplainable Artificial Intelligence (XAI). The journey ahead from criticisms to human-AI collaboration

    Francisco Herrera. “Reflections and attentiveness on eXplainable Artificial Intelligence (XAI). The journey ahead from criticisms to human-AI collaboration”. In:Information Fusion(2025), p. 103133

  8. [8]

    Opacity as a Feature, Not a Flaw: The LoBOX Governance Ethic for Role-Sensitive Explainability and Institutional Trust in AI

    Francisco Herrera and Reyes Calderón. “Opacity as a Feature, Not a Flaw: The LoBOX Governance Ethic for Role-Sensitive Explainability and Institutional Trust in AI”. In:arXiv preprint arXiv:2505.20304(2025)

Show all 29 references
  1. [9]

    An overview of model uncertainty and variability in LLM-based sentiment anal- ysis: challenges, mitigation strategies, and the role of explainability

    David Herrera-Poyatos et al. “An overview of model uncertainty and variability in LLM-based sentiment anal- ysis: challenges, mitigation strategies, and the role of explainability”. In:Frontiers in Artificial Intelligence V olume 8 - 2025 (2025).ISSN: 2624-8212.DOI:10 . 3389 /...

  2. [10]

    The effect of model size on LLM post-hoc explainability via lime

    Henning Heyen et al. “The effect of model size on LLM post-hoc explainability via lime”. In:arXiv preprint arXiv:2405.05348(2024)

  3. [11]

    Against the opacity, and for a qualitative understanding, of artificially intelligent technologies

    Mahdi Khalili. “Against the opacity, and for a qualitative understanding, of artificially intelligent technologies”. In:AI and Ethics4.4 (2024), pp. 1013–1021

  4. [12]

    Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language models

    Zichao Lin et al. “Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language models”. In:Artificial Intelligence Review57.9 (2024), p. 243

  5. [13]

    Jailjudge: A comprehensive jailbreak judge benchmark with multi-agent enhanced explanation evaluation framework

    Fan Liu et al. “Jailjudge: A comprehensive jailbreak judge benchmark with multi-agent enhanced explanation evaluation framework”. In:arXiv preprint arXiv:2410.12855(2024)

  6. [14]

    JAILJUDGE: A Comprehensive JAILBREAK judge benchmark with multi-agent enhanced explaination evaluation frameowrk

    Fan et al. Liu. “JAILJUDGE: A Comprehensive JAILBREAK judge benchmark with multi-agent enhanced explaination evaluation frameowrk”. In:2025 1st International Conference on Artificial Intelligence and Com- puting. 2025

  7. [15]

    From understanding to utilization: A survey on explainability for large language models

    Haoyan Luo and Lucia Specia. “From understanding to utilization: A survey on explainability for large language models”. In:arXiv preprint arXiv:2401.12874(2024)

  8. [16]

    Cell your model: Contrastive explanations for large lan- guage models

    Ronny Luss, Erik Miehling, and Amit Dhurandhar. “Cell your model: Contrastive explanations for large lan- guage models”. In:arXiv preprint arXiv:2406.11785v3(2025)

  9. [17]

    XAI for all: Can large language models simplify explainable AI?

    Philip Mavrepis et al. “XAI for all: Can large language models simplify explainable AI?” In:arXiv preprint arXiv:2401.13110(2024)

  10. [18]

    A Unified Framework with Novel Metrics for Evaluating the Effectiveness of XAI Techniques in LLMs

    Melkamu Abay Mersha et al. “A Unified Framework with Novel Metrics for Evaluating the Effectiveness of XAI Techniques in LLMs”. In:arXiv preprint arXiv:2503.05050(2025)

  11. [19]

    Explanation in artificial intelligence: Insights from the social sciences

    Tim Miller. “Explanation in artificial intelligence: Insights from the social sciences”. In:Artificial intelligence 267 (2019), pp. 1–38

  12. [20]

    Explainable artificial intelligence (XAI): from inherent explainability to large language models

    Fuseini Mumuni and Alhassan Mumuni. “Explainable artificial intelligence (XAI): from inherent explainability to large language models”. In:arXiv preprint arXiv:2501.09967(2025)

  13. [21]

    A practical review of mechanistic interpretability for transformer-based language models

    Daking Rai et al. “A practical review of mechanistic interpretability for transformer-based language models”. In:arXiv preprint arXiv:2407.02646(2025)

  14. [22]

    Generative to Agentic AI: Survey, Conceptualization, and Challenges

    Johannes Schneider. “Generative to Agentic AI: Survey, Conceptualization, and Challenges”. In:arXiv preprint arXiv:2504.18875(2025)

  15. [23]

    Bridging the Gap Between Explainability and Large Language Models

    Xia Shui and Zhihao Ru. “Bridging the Gap Between Explainability and Large Language Models”. In:Hal- 05011844(2025)

  16. [24]

    Explaining machine learning models with interactive natural language conversations using TalkToModel

    Dylan Slack et al. “Explaining machine learning models with interactive natural language conversations using TalkToModel”. In:Nature Machine Intelligence5.8 (2023), pp. 873–883. 26 TAXAL: Triadic Alignment for eXplainability in Agentic LLMsA PREPRINT

  17. [25]

    The rationality of explanation or human capacity? Understanding the impact of explainable artificial intelligence on human-AI trust and decision performance

    Ping Wang and Heng Ding. “The rationality of explanation or human capacity? Understanding the impact of explainable artificial intelligence on human-AI trust and decision performance”. In:Information Processing & Management61.4 (2024), p. 103732

  18. [26]

    Usable XAI: 10 strategies towards exploiting explainability in the LLM era

    X. Wu et al. “Usable XAI: 10 strategies towards exploiting explainability in the LLM era”. In:arXiv preprint arXiv:2403.08946(2024)

  19. [27]

    Editing factual knowledge and explanatory ability of medical large language models

    Derong Xu et al. “Editing factual knowledge and explanatory ability of medical large language models”. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, pp. 2660–2670

  20. [28]

    Explainability for large language models: A survey

    Haiyan Zhao et al. “Explainability for large language models: A survey”. In:ACM Transactions on Intelligent Systems and Technology15.2 (2024), pp. 1–38

  21. [29]

    Explanation in the era of large language models

    Zining Zhu et al. “Explanation in the era of large language models”. In:Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 5: Tutorial Abstracts). 2024, pp. 19–25. 27

Pith tools

Reviewed August 5, 2026 · model on record in the stance chip above.