pith. sign in

arxiv: 2412.20061 · v2 · pith:FYXSAIQLnew · submitted 2024-12-28 · 💻 cs.CL

Comparative Analysis of Listwise Reranking with Large Language Models in Limited-Resource Language Contexts

classification 💻 cs.CL
keywords languagellmsmodelslargererankingcontextslanguageslimited-resource
0
0 comments X
read the original abstract

Large Language Models (LLMs) have demonstrated significant effectiveness across various NLP tasks, including text ranking. This study assesses the performance of large language models (LLMs) in listwise reranking for limited-resource African languages. We compare proprietary models RankGPT3.5, Rank4o-mini, RankGPTo1-mini and RankClaude-sonnet in cross-lingual contexts. Results indicate that these LLMs significantly outperform traditional baseline methods such as BM25-DT in most evaluation metrics, particularly in nDCG@10 and MRR@100. These findings highlight the potential of LLMs in enhancing reranking tasks for low-resource languages and offer insights into cost-effective solutions.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. On the Stability of Prompt Ranking in Large Language Model Evaluation

    cs.CL 2026-06 unverdicted novelty 4.0

    Prompt rankings for LLMs show moderate overall correlation but frequent changes in the top prompt under random seeds and limited subsets; a lower-confidence-bound selection strategy improves robustness.