Fixed-size chunking trade-offs depend on answer locality and embedding model: 64-128 token chunks suit fact-based QA, 512-1024 token chunks suit long-context narrative QA.
Leveraging passage retrieval with generative models for open domain question answering, 2021
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.IR 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Rethinking Chunk Size For Long-Document Retrieval: A Multi-Dataset Analysis
Fixed-size chunking trade-offs depend on answer locality and embedding model: 64-128 token chunks suit fact-based QA, 512-1024 token chunks suit long-context narrative QA.