REVIEW 5 cited by
Sources of Hallucination by Large Language Models on Inference Tasks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large Language Models (LLMs) are claimed to be capable of Natural Language Inference (NLI), necessary for applied tasks like question answering and summarization. We present a series of behavioral studies on several LLM families (LLaMA, GPT-3.5, and PaLM) which probe their behavior using controlled experiments. We establish two biases originating from pretraining which predict much of their behavior, and show that these are major sources of hallucination in generative LLMs. First, memorization at the level of sentences: we show that, regardless of the premise, models falsely label NLI test samples as entailing when the hypothesis is attested in training data, and that entities are used as ``indices'' to access the memorized data. Second, statistical patterns of usage learned at the level of corpora: we further show a similar effect when the premise predicate is less frequent than that of the hypothesis in the training data, a bias following from previous studies. We demonstrate that LLMs perform significantly worse on NLI test samples which do not conform to these biases than those which do, and we offer these as valuable controls for future LLM evaluation.
Forward citations
Cited by 5 Pith papers
-
Synthetic Heuristic Evaluation: A Comparison between AI- and Human-Powered Usability Evaluation
An LLM prompted to conduct heuristic evaluation reported more usability issues on two apps than five human experts, but the ground truth included the LLM's own findings.
-
Conformal Prediction Beyond the Seen: A Missing Mass Perspective for Uncertainty Quantification in Generative Models
CPQ builds conformal prediction sets for black-box LLMs by stopping queries when the estimated missing-mass derivative is small and thresholding a Good-Turing based score, with a fallback EE label for unseen correct answers.
-
Are Large Language Models Good Temporal Graph Learners?
TGTalker prompts LLMs with the most recent edges and neighbor history of a temporal graph, achieving link prediction accuracy competitive with specialized temporal graph neural networks on five real-world datasets.
-
Small Data Explainer -- The impact of small data methods in everyday life
A review and explainer that frames small data methods through the recurring challenges of similarity, transfer, and uncertainty and maps them to application areas and technical approaches.
-
The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMs
A structured survey of LLM safety evaluation that proposes a why/what/where/how taxonomy and catalogs metrics, datasets, benchmarks, evaluators, and frameworks.
Discussion (0). Sign in to comment.