CricBench is the first multilingual Text-to-SQL benchmark for cricket analytics, showing LLMs achieve over 98% execution accuracy but under 29% semantic correctness with a 37-55 point gap versus general benchmarks like BIRD.
Richard Hipp
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
CricBench: A Multilingual Benchmark for Evaluating LLMs in Cricket Analytics
CricBench is the first multilingual Text-to-SQL benchmark for cricket analytics, showing LLMs achieve over 98% execution accuracy but under 29% semantic correctness with a 37-55 point gap versus general benchmarks like BIRD.