Pith. sign in

REVIEW 2 cited by

Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languages

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2210.09984 v1 pith:JEIWGAFD submitted 2022-10-18 cs.IR cs.CL

Xinyu Zhang , Nandan Thakur , Odunayo Ogundepo , Ehsan Kamalloo , David Alfonso-Hermelo , Xiaoguang Li , Qun Liu , Mehdi Rezagholizadeh
show 1 more author
Jimmy Lin
This is my paper
classification cs.IRcs.CL
keywords languagesretrievalacrossmiraclaroundcontinuumdatasetinformation
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

MIRACL (Multilingual Information Retrieval Across a Continuum of Languages) is a multilingual dataset we have built for the WSDM 2023 Cup challenge that focuses on ad hoc retrieval across 18 different languages, which collectively encompass over three billion native speakers around the world. These languages have diverse typologies, originate from many different language families, and are associated with varying amounts of available resources -- including what researchers typically characterize as high-resource as well as low-resource languages. Our dataset is designed to support the creation and evaluation of models for monolingual retrieval, where the queries and the corpora are in the same language. In total, we have gathered over 700k high-quality relevance judgments for around 77k queries over Wikipedia in these 18 languages, where all assessments have been performed by native speakers hired by our team. Our goal is to spur research that will improve retrieval across a continuum of languages, thus enhancing information access capabilities for diverse populations around the world, particularly those that have been traditionally underserved. This overview paper describes the dataset and baselines that we share with the community. The MIRACL website is live at http://miracl.ai/.

Discussion (0). Sign in to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. LAMAR: An Open Language-Aware Multilingual Alignment Reranker

    cs.IR 2026-07 conditional novelty 6.0 of 10

    A 0.6B multilingual reranker trained to prefer query-language documents over semantically equivalent other-language documents beats existing rerankers on language-coherence tests without collapsing general reranking quality.

  2. Redundancy, Isotropy, and Intrinsic Dimensionality of Prompt-based Text Embeddings

    cs.CL 2025-06 conditional novelty 6.0 of 10

    Prompt-based text embeddings can be truncated to a small fraction of their dimensions with little performance loss on classification and clustering, but retrieval and STS degrade faster; the difference tracks lower in...

Pith tools