REVIEW 4 cited by
On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
BERT, as one of the pretrianed language models, attracts the most attention in recent years for creating new benchmarks across GLUE tasks via fine-tuning. One pressing issue is to open up the blackbox and explain the decision makings of BERT. A number of attribution techniques have been proposed to explain BERT models, but are often limited to sequence to sequence tasks. In this paper, we adapt existing attribution methods on explaining decision makings of BERT in sequence classification tasks. We conduct extensive analyses of four existing attribution methods by applying them to four different datasets in sentiment analysis. We compare the reliability and robustness of each method via various ablation studies. Furthermore, we test whether attribution methods explain generalized semantics across semantically similar tasks. Our work provides solid guidance for using attribution methods to explain decision makings of BERT for downstream classification tasks.
Forward citations
Cited by 4 Pith papers
-
PLEX: Perturbation-free Local Explanations for LLM-Based Text Classification
PLEX learns a mapping from BERT or RoBERTa token embeddings to word importance scores, reproducing LIME and SHAP style explanations without per-sentence perturbations.
-
NeuroBreak: Unveil Internal Jailbreak Mechanisms in Large Language Models
A visualization system traces jailbreak attacks through LLM layers and neurons, then fine-tunes the vulnerable neurons to reduce attack success while preserving general ability.
-
Explainability of Large Language Models: Opportunities and Challenges toward Generating Trustworthy Explanations
LLM explanations split into local and mechanistic tracks; the paper argues they are trustworthy only if they pass causal and contrastive stress tests, adapt to the explainee, and satisfy eight trust principles.
-
Towards Transparent AI: A Survey on Explainable Large Language Models
A review that groups LLM explainability methods by transformer architecture and discusses their evaluation and applications.
Discussion (0). Sign in to comment.