mRobust04: A Multilingual Version of the TREC Robust 2004 Benchmark
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:RQPTUMPOrecord.jsonopen to challenge →
read the original abstract
Robust 2004 is an information retrieval benchmark whose large number of judgments per query make it a reliable evaluation dataset. In this paper, we present mRobust04, a multilingual version of Robust04 that was translated to 8 languages using Google Translate. We also provide results of three different multilingual retrievers on this dataset. The dataset is available at https://huggingface.co/datasets/unicamp-dl/mrobust
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models
RouteHead trains a lightweight router to dynamically select optimal LLM attention heads per query for improved attention-based document re-ranking.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.