REVIEW 4 cited by
Language Models with Conformal Factuality Guarantees
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Guaranteeing the correctness and factuality of language model (LM) outputs is a major open problem. In this work, we propose conformal factuality, a framework that can ensure high probability correctness guarantees for LMs by connecting language modeling and conformal prediction. We observe that the correctness of an LM output is equivalent to an uncertainty quantification problem, where the uncertainty sets are defined as the entailment set of an LM's output. Using this connection, we show that conformal prediction in language models corresponds to a back-off algorithm that provides high probability correctness guarantees by progressively making LM outputs less specific (and expanding the associated uncertainty sets). This approach applies to any black-box LM and requires very few human-annotated samples. Evaluations of our approach on closed book QA (FActScore, NaturalQuestions) and reasoning tasks (MATH) show that our approach can provide 80-90% correctness guarantees while retaining the majority of the LM's original output.
Forward citations
Cited by 4 Pith papers
-
Evaluating and Guarding Citation Faithfulness in Agentic Scientific Synthesis
Citation-faithfulness metrics for AI science agents are verifier-dependent (3–18% on identical outputs), and a split-conformal guard provides a finite-sample catch-rate guarantee anchored on human gold.
-
E-valuator: Reliable Agent Verifiers with Sequential Hypothesis Testing
A density-ratio e-process wrapper converts black-box verifier scores into sequential decisions that control the false-alarm rate for agent trajectories, with empirical gains in early stopping.
-
Conformal Arbitrage: Risk-Controlled Balancing of Competing Objectives in Language Models
Conformal Arbitrage calibrates a score-gap threshold with conformal risk control so that a primary model can act when confident and defer to a guardian otherwise, with the expected guardrail loss bounded by a user-cho...
-
Though Language Models Err While They Strive: Conformal Prediction for Self-Correcting Scientific Generation
A graph-based conformal wrapper that filters and regenerates LLM reasoning steps claims formal coverage guarantees on scientific validity, but its evaluation is circular and its gains are confounded with sampling effo...
Discussion (0). Sign in to comment.