The reviewed record of science sign in
Pith

arxiv: 2209.13738 · v1 · pith:RQPTUMPO · submitted 2022-09-27 · cs.CL · cs.AI

mRobust04: A Multilingual Version of the TREC Robust 2004 Benchmark

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:RQPTUMPOrecord.jsonopen to challenge →

classification cs.CL cs.AI
keywords datasetmultilingualbenchmarkmrobust04robustversionavailabledatasets
0
0 comments X
read the original abstract

Robust 2004 is an information retrieval benchmark whose large number of judgments per query make it a reliable evaluation dataset. In this paper, we present mRobust04, a multilingual version of Robust04 that was translated to 8 languages using Google Translate. We also provide results of three different multilingual retrievers on this dataset. The dataset is available at https://huggingface.co/datasets/unicamp-dl/mrobust

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models

    cs.IR 2026-04 conditional novelty 6.0

    RouteHead trains a lightweight router to dynamically select optimal LLM attention heads per query for improved attention-based document re-ranking.