Conformal prediction coverage collapses before accuracy during lifelong LLM fine-tuning, and a lightweight calibration replay using small task buffers can restore nominal coverage.
Anytime-valid answer sufficiency certificates for LLM generation via sequential information lift
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Continual Calibration: Coverage Can Collapse Before Accuracy in Lifelong LLM Fine-Tuning
Conformal prediction coverage collapses before accuracy during lifelong LLM fine-tuning, and a lightweight calibration replay using small task buffers can restore nominal coverage.