Pith. sign in

REVIEW 2 cited by

TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2003.05002 v1 pith:AUSK4TRT submitted 2020-03-10 cs.CL cs.LG

Jonathan H. Clark , Eunsol Choi , Michael Collins , Dan Garrette , Tom Kwiatkowski , Vitaly Nikolaev , Jennimaria Palomaki This is my paper
classification cs.CL cs.LG
keywords languagesdiverselanguagetydiansweransweringdatainformation-seeking
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Confidently making progress on multilingual modeling requires challenging, trustworthy evaluations. We present TyDi QA---a question answering dataset covering 11 typologically diverse languages with 204K question-answer pairs. The languages of TyDi QA are diverse with regard to their typology---the set of linguistic features each language expresses---such that we expect models performing well on this set to generalize across a large number of the world's languages. We present a quantitative analysis of the data quality and example-level qualitative linguistic analyses of observed language phenomena that would not be found in English-only corpora. To provide a realistic information-seeking task and avoid priming effects, questions are written by people who want to know the answer, but don't know the answer yet, and the data is collected directly in each language without the use of translation.

Discussion (0). Sign in to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Unveiling Language Routing Isolation in Multilingual MoE Models for Interpretable Subnetwork Adaptation

    cs.CL 2026-04 conditional novelty 6.0 of 10

    MoE models isolate high- vs low-resource languages in expert routing; training only the isolated target subnetwork (RISE) lifts low-resource F1 by up to ~11 points with little cross-lingual loss.

  2. Unsupervised Dense Information Retrieval with Contrastive Learning

    cs.IR 2021-12 unverdicted novelty 6.0 of 10

    Contrastive learning trains unsupervised dense retrievers that beat BM25 on most BEIR datasets and support cross-lingual retrieval across scripts.

Pith tools