REVIEW 5 cited by
Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehension
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Question answering (QA) is a fundamental means to facilitate assessment and training of narrative comprehension skills for both machines and young children, yet there is scarcity of high-quality QA datasets carefully designed to serve this purpose. In particular, existing datasets rarely distinguish fine-grained reading skills, such as the understanding of varying narrative elements. Drawing on the reading education research, we introduce FairytaleQA, a dataset focusing on narrative comprehension of kindergarten to eighth-grade students. Generated by educational experts based on an evidence-based theoretical framework, FairytaleQA consists of 10,580 explicit and implicit questions derived from 278 children-friendly stories, covering seven types of narrative elements or relations. Our dataset is valuable in two folds: First, we ran existing QA models on our dataset and confirmed that this annotation helps assess models' fine-grained learning skills. Second, the dataset supports question generation (QG) task in the education domain. Through benchmarking with QG models, we show that the QG model trained on FairytaleQA is capable of asking high-quality and more diverse questions.
Forward citations
Cited by 5 Pith papers
-
Beyond the Textual: Generating Coherent Visual Options for MCQs
A four-stage framework (convertibility check, question/reason generation, optimal pair selection, and template-based image generation) produces MCQs with image options from ScienceQA content.
-
Automatic Generation of Inference Making Questions for Reading Comprehension Assessments
GPT-4o generates high-quality reading comprehension questions, but only 42.6% correctly target the specified bridging inference type.
-
Persona-SQ: A Personalized Suggested Question Generation Framework For Real-world Documents
Persona-based prompting plus quality filtering yields more diverse suggested questions, and synthetic data from the pipeline trains a 360M model to near-GPT-4o levels.
-
Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models
A multi-level optimal transport loss combining sequence-level ranking, top-k truncation, and Sinkhorn sequence distance outperforms earlier cross-tokenizer distillation losses on QA and summarization.
-
DragonVerseQA: Open-Domain Long-Form Context-Aware Question-Answering
DragonVerseQA is a 3,200-pair question-answering dataset for House of the Dragon and Game of Thrones episodes, built from summaries, reviews, and wiki data to support long-form narrative QA.
Discussion (0). Continue with ORCID to comment.