REVIEW 14 cited by
Estimating LLM Uncertainty with Evidence
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Estimating LLM Uncertainty with Evidence
read the original abstract
Over the past few years, Large Language Models (LLMs) have developed rapidly and are widely applied in various domains. However, LLMs face the issue of hallucinations, generating responses that may be unreliable when the models lack relevant knowledge. To be aware of potential hallucinations, uncertainty estimation methods have been introduced, and most of them have confirmed that reliability lies in critical tokens. However, probability-based methods perform poorly in identifying token reliability, limiting their practical utility. In this paper, we reveal that the probability-based method fails to estimate token reliability due to the loss of evidence strength information which is accumulated in the training stage. Therefore, we present Logits-induced token uncertainty (LogTokU), a framework for estimating decoupled token uncertainty in LLMs, enabling real-time uncertainty estimation without requiring multiple sampling processes. We employ evidence modeling to implement LogTokU and use the estimated uncertainty to guide downstream tasks. The experimental results demonstrate that LogTokU has significant effectiveness and promise.
Forward citations
Cited by 14 Pith papers
-
LLM Doesn't Know What It Doesn't Know: Detecting Epistemic Blind Spots via Cross-Model Attribution Divergence on Clinical Tabular Data
LLMs exhibit epistemically vacuous confidence on clinical tabular data, but cross-model attribution divergence with XGBoost enables a calibrator that reduces expected calibration error from 0.254 to 0.080.
-
Quantifying Consistency in LLM Logical Reasoning via Structural Uncertainty
Structural uncertainty from self-preference-induced rankings of LLM reasoning paths complements answer dispersion for identifying unreliable instances on logical tasks while collapsing on factual retrieval.
-
Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction
Vision-language models vary widely in how trustworthy their confidence scores are on document extraction, with stronger models and OCR-plus-image input helping most, as measured on the new ConfBench benchmark.
-
Uncertainty Quantification for Flow-Based Vision-Language-Action Models
Velocity-field disagreement yields calibrated epistemic uncertainty for flow-based VLAs, supporting failure detection and uncertainty-guided active fine-tuning that cuts required samples by ≥22%.
-
Integrating Local and Global Entropy for Uncertainty Quantification in LLMs
GLU is a single-pass unsupervised uncertainty score for LLMs formed by multiplying global hidden-state geometric entropy with local token entropy, shown to match or beat baselines on three model families and six bench...
-
VIHD: Visual Intervention-based Hallucination Detection for Medical Visual Question Answering
VIHD detects hallucinations in medical MLLMs by identifying visually dominant decoder layers via probing and applying visual token masking to calibrate semantic entropy as a detection signal.
-
Towards Generation-Efficient Uncertainty Estimation in Large Language Models
Uncertainty estimation for LLM hallucinations can be done effectively with partial generations or input-only predictors, reducing the need for full autoregressive sampling.
-
Estimating the Black-box LLM Uncertainty with Distribution-Aligned Adversarial Distillation
DisAAD trains a 1%-sized proxy model via adversarial distillation to quantify uncertainty in black-box LLMs by aligning with their output distributions.
-
Complementing Self-Consistency with Cross-Model Disagreement for Uncertainty Quantification
Cross-model semantic disagreement adds an epistemic uncertainty term that improves total uncertainty estimation over self-consistency alone, helping flag confident errors in LLMs.
-
INSIGHT: INference-time Sequence Introspection for Generating Help Triggers in Vision-Language-Action Models
Token-level uncertainty sequences from a VLA policy, classified by a small transformer, predict when a robot should request human help better than static uncertainty scores.
-
VIHD: Visual Intervention-based Hallucination Detection for Medical Visual Question Answering
VIHD detects hallucinations in medical MLLMs via visual dependency probing, token masking intervention, and calibrated semantic entropy on VQA benchmarks.
-
From Accuracy to Auditability: A Survey of Determinism in Financial AI Systems
Financial AI systems using tabular models, graph networks, and LLM agents exhibit nondeterminism that undermines reproducibility, quantified via experiments on public datasets and addressed by a proposed layered evalu...
-
Uncertainty-Aware Exploratory Direct Preference Optimization for Multimodal Large Language Models
UE-DPO quantifies epistemic uncertainty from grounding failures to direct more learning pressure on hard visual tokens in preferred samples while easing penalties on dispreferred ones.
-
WebUncertainty: Dual-Level Uncertainty Driven Planning and Reasoning For Autonomous Web Agent
WebUncertainty improves web agent performance on benchmarks by adaptively selecting planning modes based on task uncertainty and using confidence-induced action uncertainty in MCTS to quantify aleatoric and epistemic ...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.