REVIEW 4 major objections 6 minor 42 references
Uncertainty-Aware Complex Scientific Table Data Extraction
T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read An uncertainty-aware pipeline for scientific tables flags likely OCR and structure errors, so verifying just 47% of extracted cells raises data accuracy by about 30%.
desk verdict Interesting idea, but the headline verification savings are in-sample because the flagging threshold was tuned on the test set. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the conformal score assigned to each constructed grid cell. TSR row and column boxes are intersected to form grid cells; OCR text boxes are matched to cells by intersection-over-area exceeding 50%; each cell inherits a TSR confidence (average of row and column confidences) and an OCR confidence (average of matched text-box confidences). Conformal prediction on a calibration half of the cells yields a threshold q-hat, and each cell receives uncertainty U(X)=max(0, s(X)-q-hat). The paper compares three score functions: LAC (minimum of TSR and OCR confidence), APS (cumulative confidence), and a hybrid spatial score, with APS giving the best F1 and becoming the primary choice.
What would settle it
Run the pipeline with the flagging threshold selected on a separate validation split or via nested cross-validation, then count the fraction of cells requiring human review and the post-correction accuracy; if the 47%, 53%, and 30% figures degrade materially, the headline savings are an artifact of threshold selection on the evaluation set.
Extended reading notes
Core claim
The central claim is that conformal prediction applied to combined TSR and OCR confidences can reliably flag incorrectly extracted cells in scientific tables. On the paper's own terms, with the APS score the pipeline flags most errors (overall recall about 65%) while keeping most flagged cells genuinely wrong (overall precision about 70%), and if a human corrects only the flagged cells, overall data accuracy improves by about 30%, with Computer Science tables improving from 53% to 97%. The framework is model-agnostic: any TSR or OCR model that outputs confidence scores can be plugged in, and the uncertainty score is produced by comparing a conformal score against a calibration-set threshold.
Load-bearing premise
The reported verification savings and quality gains assume the flagging threshold can be chosen on the same data used to measure success; if the threshold must be fixed on separate validation data, the 47% and 30% figures would likely change.
Editorial extensions
If this is right
- If the UQ signal is trusted, extraction pipelines can stop verifying every cell and instead route only flagged cells to a human reviewer, preserving most of the accuracy gain at half the labor cost.
- Because the framework only requires confidence outputs from the underlying models, replacing the OCR or TSR engine with a better one should directly reduce both true errors and false flags without re-engineering the UQ layer.
- APS is the recommended score function among those tested; OCR-only confidence is close but slightly worse, and TSR-only confidence is clearly worse, so both structure and text uncertainty matter for error detection.
- UQ-informed correction works unevenly across domains: tables with clean structure and short text (Computer Science) benefit most, while Biology and Materials Science retain more errors due to symbols and long content, pointing to a need for domain-adaptive scoring.
Reading between the lines
- Editorial inference: because the 0.03 flagging threshold was selected on the evaluation data itself by maximizing F1, the headline 47% and 30% figures likely overstate out-of-sample performance; a validation-set or nested threshold selection would give a fairer estimate of the savings.
- Editorial inference: the same per-cell uncertainty scores could be used to order the human review queue rather than binary flagging, so a reviewer with a fixed time budget could stop after the highest-uncertainty cells and still capture most errors.
- Editorial inference: the grid-cell representation with uncertainty attached could feed downstream database loading or scientific knowledge bases by marking low-confidence cells as requiring review instead of silently inserting potentially wrong values.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes TSR-OCR-UQ, a pipeline that integrates table structure recognition (TATR) and OCR (PaddleOCR) with uncertainty scores derived from conformal-prediction-style calibration, in order to flag likely-incorrect extracted cells for human verification. The method is evaluated on the GenTSR and ICDAR-2013 datasets, with several scoring functions (LAC, APS, HSS) compared. The central claim is that by manually verifying only 47% of extracted cells, the data accuracy improves by about 30% (from 53% to 83%), and the verification effort is reduced by 53%. The paper also reports domain-wise precision/recall/F1 for error flagging and includes a discussion of failure modes. Code and data are publicly available.
Significance. If the quantitative claims were established, this would be a practically useful contribution to scientific table extraction, since it would provide a way to prioritize human verification effort using uncertainty information. The paper is also valuable for comparing several uncertainty scoring functions and for releasing an open implementation of the pipeline. However, the headline numbers are currently supported only by an evaluation procedure that selects key thresholds on the test set and lacks a random-verification control, and the connection to conformal prediction's formal coverage guarantee is not established as written. These issues are central, not cosmetic, so the paper needs a substantive revision before the main claims can be accepted.
major comments (4)
- [Section 4.1, Table 3] The APS flagging threshold τ=0.03 is selected by maximizing the F1-score on 'our dataset' (Section 4.1), and the same data is then used to report Table 3 and the headline 47%/30% figures in Section 4.3. Since the labor savings in Eq. (15) is a direct function of the number of flagged cells, selecting τ on the evaluation set makes the reported labor savings and accuracy gains in-sample optima. The paper must split the data into calibration, validation, and test (or use nested cross-validation), select τ on a validation set, and then report the metrics on a held-out test set. The sensitivity of the 47% and 30% numbers to τ should also be reported.
- [Section 4.3.2, Section 4.3.3] No random-verification baseline is reported. Correcting a randomly chosen 47% of the cells would be expected to remove roughly 47% of the existing errors, assuming errors are not concentrated. The paper should compare UQ-informed correction against this random baseline (repeated over multiple random seeds) to demonstrate that the flagged cells are enriched for errors. Without this comparison, the 30% accuracy improvement cannot be attributed to the uncertainty scoring rather than to the mere act of verifying a fraction of the cells.
- [Section 3.3.1, Eq. (5), Eq. (6), Eq. (10)] The scores s_LAC and s_APS are defined using the confidence of the predicted cell Y, not the true label. In conformal prediction, the conformity score must be a function of the true label (e.g., 1 - f(X)_Y for LAC) for the quantile in Eq. (3) to yield the coverage guarantee stated in Eq. (2). As written, the scores are label-independent functions of the model's confidence for its own prediction, so the procedure is a heuristic calibration of confidence scores rather than conformal prediction, and the coverage guarantee does not follow. The authors should either reformulate the scores to depend on the true label during calibration or remove the claim of conformal prediction and describe the method as a calibrated uncertainty-scoring heuristic.
- [Section 3.4, Eq. (2), Eq. (3)] The calibration set is described as 'a randomly selected 50% subset of the extracted cells from each domain,' and it is not stated whether the test tables listed in Section 4.2 are disjoint from these calibration cells. If calibration and test cells come from the same tables, within-table correlation can inflate the apparent flagging performance and can break the exchangeability assumption needed for the conformal guarantee. The paper should use table-level disjoint splits for calibration and testing, and should also verify and report the empirical coverage of the prediction sets at the chosen α level, which is currently missing.
minor comments (6)
- [Abstract and Section 4.3.3] The '30% improvement' is in absolute percentage points (from 53% to 83%); please state this explicitly to avoid confusion with a relative improvement.
- [Section 3.3.1, Eq. (8)] The HSS weight parameters w_row, w_col, and w_text are tuned by a grid search; please state whether this tuning is performed on the calibration set or on the test set, since tuning on the test set would inflate the HSS results.
- [Section 3.2.3] The treatment of cells with no OCR match (OCR confidence set to 0) should be justified, because blank cells may be correctly empty and setting confidence to 0 may cause systematic false flagging of legitimate blank cells.
- [Table 2 vs Table 3] Table 2 reports an APS mean F1-score of 0.761 while Table 3 reports an ALL-domain F1 of 0.590; please clarify whether these are computed over different units (e.g., tables vs cells, or with vs without threshold selection) so that readers can reconcile the two numbers.
- [Equation (1)] The Levenshtein accuracy can become negative when the Levenshtein distance exceeds the maximum string length; clipping the value to [0,1] would make the metric more interpretable.
- [References] There is a typo in reference [39], which reads 'ICDAR-2103' and should be 'ICDAR-2013'.
Circularity Check
The 47%/30% headline is an in-sample threshold-selection result: Sec. 4.1 chooses τ=0.03 by maximizing F1 on the same data used to report the labor savings and quality gain.
-
fitted input called prediction
[Sec. 4.1 (Conformal Score Function Selection) and Sec. 4.3.2/4.3.3 (reported headline results)]
"To evaluate the effectiveness of different score functions, we tested a range of thresholds (0.01 - 1) for each function and identified the optimal threshold (0.03) for APS score function that maximized the F1-score for our dataset. ... In addition, UQ improves efficiency, with an overall labor savings of 53%, meaning that only 47% of extracted cells require manual review."
The flagging threshold τ=0.03 is selected on the same evaluation set that later produces the headline metrics. Sec. 4.1 states the threshold was chosen to maximize F1 'for our dataset'; Sec. 4.3.2 then reports precision, recall, F1, and labor savings on that same data, and Sec. 4.3.3 reports the ~30% accuracy improvement after correcting those flagged cells. Because τ is an extra free parameter beyond the CP calibration quantile q (Eq. 10), the reported 47%/30% results are optima of an in-sample search rather than out-of-sample predictions. No separate validation split or random-verification control is described, so the central quantitative claim is not shown to be a property of the UQ method rather than of the selected threshold.
full rationale
The paper's core methodological contribution—integrating TSR and OCR and applying conformal-prediction-style uncertainty scores—is not itself circular: the framework is evaluated against external ground truth, and the conformal calibration step uses a held-out 50% subset of cells. However, the headline quantitative claims (53% labor savings, 30% quality improvement) depend on an additional flagging threshold τ=0.03 selected by maximizing F1 on the very evaluation set used to report those numbers (Sec. 4.1 vs. Sec. 4.3). This makes the central 'prediction' an in-sample fitted optimum rather than an out-of-sample estimate. The GenTSR dataset citation [18] is a self-citation (Ajayi, Choudhury, Rajtmajer, Wu) but it is a dataset construction artifact, not a load-bearing circular derivation; TATR's reported benchmarks are external. So the partial circularity is concentrated in the threshold-selection/evaluation loop, justifying a score of 6 rather than full self-definitional circularity.
Assumptions & free parameters
free parameters (2)
- flagging threshold (APS) =
0.03
- HSS weights w_row, w_col, w_text =
not reported
assumptions (4)
- domain assumption Calibration and test cells are exchangeable within each domain
- domain assumption Softmax confidence scores from TATR and PaddleOCR are meaningful uncertainty signals
- domain assumption IoA greater than 50% correctly maps OCR bboxes to grid cells
- domain assumption Human correction of flagged cells is perfect
Cite this review
Pith. "Pith review of Uncertainty-Aware Complex Scientific Table Data Extraction." pith.science (2026). https://pith.science/paper/FL7PQ3OY
@misc{pith2026250702009,
author = {Pith},
title = {Pith review of: Uncertainty-Aware Complex Scientific Table Data Extraction},
year = {2026},
howpublished = {\url{https://pith.science/paper/FL7PQ3OY}},
note = {Machine review of arXiv:2507.02009}
}
read the original abstract
Table structure recognition (TSR) and optical character recognition (OCR) play crucial roles in extracting structured data from tables in scientific documents. However, existing extraction frameworks built on top of TSR and OCR methods often fail to quantify the uncertainties of extracted results. To obtain highly accurate data for scientific domains, all extracted data must be manually verified, which can be time-consuming and labor-intensive. We propose a framework that performs uncertainty-aware data extraction for complex scientific tables, built on conformal prediction, a model-agnostic method for uncertainty quantification (UQ). We explored various uncertainty scoring methods to aggregate the uncertainties introduced by TSR and OCR. We rigorously evaluated the framework using a standard benchmark and an in-house dataset consisting of complex scientific tables in six scientific domains. The results demonstrate the effectiveness of using UQ for extraction error detection, and by manually verifying only 47% of extraction results, the data quality can be improved by 30%. Our work quantitatively demonstrates the role of UQ with the potential of improving the efficiency in the human-machine cooperation process to obtain scientifically usable data from complex tables in scientific documents. All code and data are available on GitHub at https://github.com/lamps-lab/TSR-OCR-UQ/tree/main.
Figures
Reference graph
Works this paper leans on
-
[1]
pdf2table: A method to extract table information from pdf files
Burcu Yildiz, Katharina Kaiser, and Silvia Miksch. pdf2table: A method to extract table information from pdf files. In IICAI, volume 2005, pages 1773–1785. Citeseer, 2005
work page 2005
-
[2]
Automatic web spreadsheet data extraction
Zhe Chen and Michael Cafarella. Automatic web spreadsheet data extraction. In Proceedings of the 3rd International Workshop on Semantic Search over the Web, pages 1–8, 2013
work page 2013
-
[3]
Table extraction using conditional random fields
David Pinto, Andrew McCallum, Xing Wei, and W Bruce Croft. Table extraction using conditional random fields. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pages 235–242, 2003
work page 2003
-
[4]
Mouli Rastogi, Syed Afshan Ali, Mrinal Rawat, Lovekesh Vig, Puneet Agarwal, Gautam Shroff, and Ashwin Srinivasan. Information extraction from document images via fca-based template detection and knowledge graph rule induction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pages 558–559, 2020
work page 2020
-
[5]
Information retrieval from documents: A survey
Mandar Mitra and BB Chaudhuri. Information retrieval from documents: A survey. Information retrieval, 2:141–163, 2000
work page 2000
-
[6]
Karl Holub, Nicole Hardy, and Kevin Kallmes. Toward automated data extraction according to tabular data struc- ture: Cross-sectional pilot survey of the comparative clinical literature. JMIR Formative Research, 5(11):e33124, 2021
work page 2021
-
[7]
DeepTabStR: deep learning based table structure recognition
Shoaib Ahmed Siddiqui, Imran Ali Fateh, Syed Tahseen Raza Rizvi, Andreas Dengel, and Sheraz Ahmed. DeepTabStR: deep learning based table structure recognition. In 2019 International Conference on Document Analysis and Recognition (ICDAR), pages 1403–1409. IEEE, 2019
work page 2019
-
[8]
Devashish Prasad, Ayan Gadpal, Kshitij Kapadni, Manish Visave, and Kavita Sultanpure. CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documents. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pages 572–573, 2020
work page 2020
Show all 42 references
-
[9]
Rethinking table structure recognition using sequence labeling methods
Yibo Li, Yilun Huang, Ziyi Zhu, Lemeng Pan, Yongshuai Huang, Lin Du, Zhi Tang, and Liangcai Gao. Rethinking table structure recognition using sequence labeling methods. In International Conference on Document Analysis and Recognition, pages 541–553. Springer, 2021. 11 Uncertai...
2021
-
[10]
TableLab: An interactive table extraction system with adaptive deep learning
Nancy Xin Ru Wang, Douglas Burdick, and Yunyao Li. TableLab: An interactive table extraction system with adaptive deep learning. In Companion Proceedings of the 26th International Conference on Intelligent User Interfaces, pages 87–89, 2021
2021
-
[11]
A Bayesian approach for quantification of model uncertainty
Inseok Park, Hemanth K Amarchinta, and Ramana V Grandhi. A Bayesian approach for quantification of model uncertainty. Reliability Engineering & System Safety, 95(7):777–785, 2010
2010
-
[12]
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Yarin Gal and Zoubin Ghahramani. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In international conference on machine learning, pages 1050–1059, 2016
2016
-
[13]
A gentle introduction to conformal prediction and distribution-free uncertainty quantification
Anastasios N Angelopoulos and Stephen Bates. A gentle introduction to conformal prediction and distribution-free uncertainty quantification. arXiv preprint arXiv:2107.07511, 2021
2021 arXiv
-
[14]
Conformal prediction masks: Visualizing uncertainty in medical imaging
Gilad Kutiel, Regev Cohen, Michael Elad, Daniel Freedman, and Ehud Rivlin. Conformal prediction masks: Visualizing uncertainty in medical imaging. In International Workshop on Trustworthy Machine Learning for Healthcare, pages 163–176. Springer, 2023
2023
-
[15]
Conformal prediction in clinical medical sciences
Janette Vazquez and Julio C Facelli. Conformal prediction in clinical medical sciences. Journal of Healthcare Informatics Research, 6(3):241–252, 2022
2022
-
[16]
Uncertainty quantification for probabilistic machine learning in earth observation using conformal prediction
Geethen Singh, Glenn Moncrieff, Zander Venter, Kerry Cawse-Nicholson, Jasper Slingsby, and Tamara B Robinson. Uncertainty quantification for probabilistic machine learning in earth observation using conformal prediction. Scientific Reports, 14(1):16166, 2024
2024
-
[17]
Benchmarking llms via uncertainty quantification
Fanghua Ye, Mingming Yang, Jianhui Pang, Longyue Wang, Derek F Wong, Emine Yilmaz, Shuming Shi, and Zhaopeng Tu. Benchmarking llms via uncertainty quantification. arXiv preprint arXiv:2401.12794, 2024
2024 arXiv
-
[18]
A Study on Reproducibility and Replicability of Table Structure Recognition Methods
Kehinde Ajayi, Muntabir Hasan Choudhury, Sarah M Rajtmajer, and Jian Wu. A Study on Reproducibility and Replicability of Table Structure Recognition Methods. In International Conference on Document Analysis and Recognition, pages 3–19. Springer, 2023
2023
-
[19]
ICDAR 2013 Table Competition
Max Göbel, Tamir Hassan, Ermelinda Oro, and Giorgio Orsi. ICDAR 2013 Table Competition. In 2013 12th International Conference on Document Analysis and Recognition, pages 1449–1453. IEEE, 2013
2013
-
[20]
PP-OCRv3: More attempts for the improvement of ultra lightweight OCR system
Chenxia Li, Weiwei Liu, Ruoyu Guo, Xiaoting Yin, Kaitao Jiang, Yongkun Du, Yuning Du, Lingfeng Zhu, Baohua Lai, Xiaoguang Hu, et al. PP-OCRv3: More attempts for the improvement of ultra lightweight OCR system. arXiv preprint arXiv:2206.03001, 2022
2022 arXiv
-
[21]
EasyOCR: Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc
Jaided AI. EasyOCR: Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc. https://github.com/JaidedAI/EasyOCR, 2020
2020
-
[22]
docTR: Document Text Recognition
Mindee. docTR: Document Text Recognition. https://github.com/mindee/doctr, 2021
2021
-
[23]
Table Transformer, 06 2021
Brandon Smock and Rohith Pesala. Table Transformer, 06 2021. Version 1.0.0
2021
-
[24]
Automatic table recognition and extraction from heterogeneous documents
Florence Folake Babatunde, Bolanle Adefowoke Ojokoh, Samuel Adebayo Oluwadare, et al. Automatic table recognition and extraction from heterogeneous documents. Journal of Computer and Communications, 3(12):100, 2015
2015
-
[25]
Deep-learning and graph-based approach to table structure recognition
Eunji Lee, Jaewoo Park, Hyung Il Koo, and Nam Ik Cho. Deep-learning and graph-based approach to table structure recognition. Multimedia Tools and Applications, 81(4):5827–5848, 2022
2022
-
[26]
Pascal Fischer, Alen Smajic, Giuseppe Abrami, and Alexander Mehler. Multi-Type-TD-TSR–Extracting Tables from Document Images Using a Multi-stage Pipeline for Table Detection and Table Structure Recognition: From OCR to Structured Table Representations. InGerman Conference on A...
2021
-
[27]
Table structure recognition using top-down and bottom-up cues
Sachin Raja, Ajoy Mondal, and CV Jawahar. Table structure recognition using top-down and bottom-up cues. In European Conference on Computer Vision, pages 70–86. Springer, 2020
2020
-
[28]
TGRNet: A Table Graph Reconstruction Network for Table Structure Recognition
Wenyuan Xue, Baosheng Yu, Wen Wang, Dacheng Tao, and Qingyong Li. TGRNet: A Table Graph Reconstruction Network for Table Structure Recognition. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1295–1304, 2021
2021
-
[29]
Tablenet: Deep learning model for end-to-end table detection and tabular data extraction from scanned document images
Shubham Singh Paliwal, D Vishwanath, Rohit Rahul, Monika Sharma, and Lovekesh Vig. Tablenet: Deep learning model for end-to-end table detection and tabular data extraction from scanned document images. In 2019 International Conference on Document Analysis and Recognition (ICDA...
2019
-
[30]
Simple and scalable predictive uncertainty estimation using deep ensembles
Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. Simple and scalable predictive uncertainty estimation using deep ensembles. Advances in neural information processing systems, 30, 2017
2017
-
[31]
A tutorial on conformal prediction.Journal of Machine Learning Research, 9(3), 2008
Glenn Shafer and Vladimir V ovk. A tutorial on conformal prediction.Journal of Machine Learning Research, 9(3), 2008. 12 Uncertainty-Aware Complex Scientific Table Data Extraction A PREPRINT
2008
-
[32]
Impact of uncertainty quantification through conformal prediction on volume assessment from deep learning-based MRI prostate segmentation
Marius Gade, Kevin Mekhaphan Nguyen, Sol Gedde, and Alvaro Fernandez-Quilez. Impact of uncertainty quantification through conformal prediction on volume assessment from deep learning-based MRI prostate segmentation. Insights into Imaging, 15(1):286, 2024
2024
-
[33]
Pp-ocr: A practical ultra lightweight ocr system
Yuning Du, Chenxia Li, Ruoyu Guo, Xiaoting Yin, Weiwei Liu, Jun Zhou, Yifan Bai, Zilin Yu, Yehua Yang, Qingqing Dang, et al. Pp-ocr: A practical ultra lightweight ocr system. arXiv preprint arXiv:2009.09941, 2020
2009 arXiv
-
[34]
ICDAR 2019 Competition on Table Detection and Recognition (cTDaR)
Liangcai Gao, Yilun Huang, Hervé Déjean, Jean-Luc Meunier, Qinqin Yan, Yu Fang, Florian Kleber, and Eva Lang. ICDAR 2019 Competition on Table Detection and Recognition (cTDaR). In 2019 International Conference on Document Analysis and Recognition (ICDAR), pages 1510–1515, 2019
2019
-
[35]
CRNN: a joint neural network for redundancy detection
Xinyu Fu, Eugene Ch’ng, Uwe Aickelin, and Simon See. CRNN: a joint neural network for redundancy detection. In 2017 IEEE international conference on smart computing (SMARTCOMP), pages 1–8. IEEE, 2017
2017
-
[36]
Analysis of optical character recognition using easyocr under image degradation
MAM Salehudin, SN Basah, H Yazid, KS Basaruddin, MJA Safar, MH Mat Som, and KA Sidek. Analysis of optical character recognition using easyocr under image degradation. In Journal of Physics: Conference Series, volume 2641, page 012001. IOP Publishing, 2023
2023
-
[37]
PubTables-1M: Towards comprehensive table extraction from unstructured documents
Brandon Smock, Rohith Pesala, and Robin Abraham. PubTables-1M: Towards comprehensive table extraction from unstructured documents. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 4634–4642, 2022
2022
-
[38]
Global table extractor (gte): A framework for joint table identification and cell structure recognition using visual context
Xinyi Zheng, Douglas Burdick, Lucian Popa, Xu Zhong, and Nancy Xin Ru Wang. Global table extractor (gte): A framework for joint table identification and cell structure recognition using visual context. In Proceedings of the IEEE/CVF winter conference on applications of compute...
2021
-
[39]
Aligning benchmark datasets for table structure recognition
Brandon Smock, Rohith Pesala, and Robin Abraham. Aligning benchmark datasets for table structure recognition. In International Conference on Document Analysis and Recognition, pages 371–386. Springer, 2023
2023
-
[40]
Uncertainty estimation and quantification for llms: A simple supervised approach
Linyu Liu, Yu Pan, Xiaocheng Li, and Guanting Chen. Uncertainty estimation and quantification for llms: A simple supervised approach. arXiv preprint arXiv:2404.15993, 2024
2024 arXiv
-
[41]
Least ambiguous set-valued classifiers with bounded error levels
Mauricio Sadinle, Jing Lei, and Larry Wasserman. Least ambiguous set-valued classifiers with bounded error levels. Journal of the American Statistical Association, 114(525):223–234, 2019
2019
-
[42]
Classification with valid and adaptive coverage
Yaniv Romano, Matteo Sesia, and Emmanuel Candes. Classification with valid and adaptive coverage. Advances in Neural Information Processing Systems, 33:3581–3591, 2020. 13
2020
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.