REVIEW 2 cited by
Modern Question Answering Datasets and Benchmarks: A Survey
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Modern Question Answering Datasets and Benchmarks: A Survey
read the original abstract
Question Answering (QA) is one of the most important natural language processing (NLP) tasks. It aims using NLP technologies to generate a corresponding answer to a given question based on the massive unstructured corpus. With the development of deep learning, more and more challenging QA datasets are being proposed, and lots of new methods for solving them are also emerging. In this paper, we investigate influential QA datasets that have been released in the era of deep learning. Specifically, we begin with introducing two of the most common QA tasks - textual question answer and visual question answering - separately, covering the most representative datasets, and then give some current challenges of QA research.
Forward citations
Cited by 2 Pith papers
-
Natural Context Drift Undermines the Natural Language Understanding of Large Language Models
QA accuracy of open-weight LLMs drops as Wikipedia passages semantically drift from training-time content, while human accuracy stays flat.
-
AfriEconQA: A Benchmark for Quantitative and Temporal Reasoning over World Bank Economic Reports
An LLM-generated QA benchmark over World Bank African economic reports is evaluated on a small sample and found hard, but the abstract and body report conflicting dataset sizes, model names, and scores.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.