REVIEW 8 cited by
SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models
read the original abstract
We introduce SelfCite, a novel self-supervised approach that aligns LLMs to generate high-quality, fine-grained, sentence-level citations for the statements in their generated responses. Instead of only relying on costly and labor-intensive annotations, SelfCite leverages a reward signal provided by the LLM itself through context ablation: If a citation is necessary, removing the cited text from the context should prevent the same response; if sufficient, retaining the cited text alone should preserve the same response. This reward can guide the inference-time best-of-N sampling strategy to improve citation quality significantly, as well as be used in preference optimization to directly fine-tune the models for generating better citations. The effectiveness of SelfCite is demonstrated by increasing citation F1 up to 5.3 points on the LongBench-Cite benchmark across five long-form question answering tasks. The source code is available at https://github.com/facebookresearch/SelfCite
Forward citations
Cited by 8 Pith papers
-
How Context Attribution Handles What the Model Already Knows
Context attribution methods cannot disentangle in-context from in-weight knowledge and assign unfaithful scores under overlap; new metrics and WMDP-Cyber++ quantify the failure.
-
On Improving Faithfulness of Podcasts from Documents
AI-generated podcasts often add unsupported claims; a turn-level detector plus rewrite pass improves measured faithfulness across five models and in- and out-of-domain documents.
-
What LLMs explain is not what they believe: Evaluating explanation sufficiency under models' own input beliefs
Proposes SCSuff metric for evaluating LLM explanation sufficiency via model-generated alternative inputs, showing explanations are typically insufficient and predictable from hidden states.
-
Citation Failure: Definition, Analysis and Efficient Mitigation
The paper defines citation failure separately from response failure, introduces the CITECONTROL benchmark to analyze relational effects on citation quality, and proposes the CITENTION framework that integrates generat...
-
Cite Pretrain: Retrieval-Free Knowledge Attribution for Large Language Models
Active Indexing with synthetic data augmentation for bidirectional fact-source binding during pretraining yields up to 30.2% higher citation precision than passive identifier appending on CitePretrainBench for Qwen models.
-
ProvenAI: Provenance-Native Traces of Evidence in Generated Answers
ProvenAI measures transparency in multi-hop QA via answer correctness, citation fidelity, and ablation-based document influence on HotpotQA, reporting 53.53% accuracy and 71.55% fidelity while identifying a citation-i...
-
TRUE: A Trustworthy Unified Explanation Framework for Large Language Model Reasoning
TRUE checks whether LLM reasoning traces are self-sufficient by executing them blind, maps neighboring reasoning paths into a DAG, and ranks recurring failure modes by Shapley values.
-
A Survey of Context Engineering for Large Language Models
The survey organizes Context Engineering into retrieval, processing, management, and integrated systems like RAG and multi-agent setups while identifying an asymmetry where LLMs handle complex inputs well but struggle...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.