XRAG is a modular, open-source benchmark and diagnostic toolkit that evaluates RAG components across three QA datasets and proposes fixes for common failure modes.
Justification: The error value is the average of three trials of the generation, with a constant LLM Temperature of 0 in Table 5, Table 6, Table 7, Table 8 and Table 9
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
method 1
citation-polarity summary
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1roles
method 1polarities
use method 1representative citing papers
citing papers explorer
-
XRAG: eXamining the Core -- Benchmarking Foundational Components in Advanced Retrieval-Augmented Generation
XRAG is a modular, open-source benchmark and diagnostic toolkit that evaluates RAG components across three QA datasets and proposes fixes for common failure modes.