Pith. sign in

REVIEW 4 cited by

Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2210.01613 v1 pith:7WJIT32G submitted 2022-10-04 cs.CL

Priyanka Sen , Alham Fikri Aji , Amir Saffari This is my paper
classification cs.CL
keywords mintakacomplexdatasetend-to-endenglishhitsmodelsmultilingual
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We introduce Mintaka, a complex, natural, and multilingual dataset designed for experimenting with end-to-end question-answering models. Mintaka is composed of 20,000 question-answer pairs collected in English, annotated with Wikidata entities, and translated into Arabic, French, German, Hindi, Italian, Japanese, Portuguese, and Spanish for a total of 180,000 samples. Mintaka includes 8 types of complex questions, including superlative, intersection, and multi-hop questions, which were naturally elicited from crowd workers. We run baselines over Mintaka, the best of which achieves 38% hits@1 in English and 31% hits@1 multilingually, showing that existing models have room for improvement. We release Mintaka at https://github.com/amazon-research/mintaka.

Discussion (0). Sign in to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

    cs.CL 2025-06 conditional novelty 6.0 of 10

    An adaptive, per-language data filtering and deduplication pipeline produces multilingual LLM pre-training corpora that beat prior public datasets on 11 of 14 evaluated languages, and a 20TB, 1,868 language-script dat...

  2. The Role of Visualization in LLM-Assisted Knowledge Graph Systems: Effects on User Trust, Exploration, and Workflows

    cs.LG 2025-05 conditional novelty 6.0 of 10

    Visualizations designed to increase transparency in an LLM-based knowledge graph query tool actually led users, including experts, to overtrust incorrect outputs.

  3. DTKG: Dual-Track Knowledge Graph-Verified Reasoning Framework for Multi-Hop QA

    cs.AI 2025-10 conditional novelty 4.0 of 10

    DTKG routes multi-hop questions into either a fact-verification or knowledge-graph chain-reasoning branch, reporting modest accuracy gains on four QA benchmarks.

  4. Aligning Knowledge Graphs and Language Models for Factual Accuracy

    cs.CL 2025-07 conditional novelty 3.0 of 10

    ALIGNed-LLM aligns knowledge graph entity embeddings with language model text embeddings through a trainable projection layer, improving question answering accuracy on KG-derived datasets.

Pith tools