Develops a unified framework representing performance metrics as smooth functionals of confusion-matrix probabilities to enable cluster-robust sandwich variance estimation for asymptotically valid confidence intervals and tests under clustered data.
Manning, Prabhakar Raghavan, and Hinrich Schütze
5 Pith papers cite this work. Polarity classification is still indexing.
citation-role summary
citation-polarity summary
roles
background 1polarities
background 1representative citing papers
PrimeFacts extracts decontextualized premises from fact-check articles, raising evidence retrieval MRR by up to 30% and verdict prediction Macro-F1 by 10-20 points over baselines.
Cluster-based semantic chunking does not outperform fixed-size or recursive chunking for RAG on academic theses, and RAGAs faithfulness shows limited reliability in this setup.
A survey that categorizes RAG methods for LLMs into four retrieval-centric stages, reviews their evolution and evaluation, and outlines challenges and future directions.
citing papers explorer
-
Beyond Point Estimates: Reliable Evaluation of Prediction Performance Metrics under Clustered Data
Develops a unified framework representing performance metrics as smooth functionals of confusion-matrix probabilities to enable cluster-robust sandwich variance estimation for asymptotically valid confidence intervals and tests under clustered data.
-
From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence
PrimeFacts extracts decontextualized premises from fact-check articles, raising evidence retrieval MRR by up to 30% and verdict prediction Macro-F1 by 10-20 points over baselines.
-
Evaluating Chunking Strategies for Retrieval-Augmented Generation on Academic Texts
Cluster-based semantic chunking does not outperform fixed-size or recursive chunking for RAG on academic theses, and RAGAs faithfulness shows limited reliability in this setup.
- A Reproducible Benchmark and Evidence-Retrieval Software Framework for Silicon Detector R&D Literature