An auxiliary LLM can diagnose whether an LLM's uncertainty comes from ambiguous questions or missing knowledge by analyzing patterns of disagreement among multiple sampled answers.
The prompt explicitly breaks the task into two steps—difference analysis and knowl- edge identification—to ensure clarity and fo- cus
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Can Multiple Responses from an LLM Reveal the Sources of Its Uncertainty?
An auxiliary LLM can diagnose whether an LLM's uncertainty comes from ambiguous questions or missing knowledge by analyzing patterns of disagreement among multiple sampled answers.