A cross-evaluation setup with native-speaker SME rubrics benchmarks LLMs on underrepresented Arabic dialects and quantifies automated judge bias and cultural-reasoning gaps.
CultureBank: An online community-driven knowledge base towards culturally aware language technologies
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground Truth
A cross-evaluation setup with native-speaker SME rubrics benchmarks LLMs on underrepresented Arabic dialects and quantifies automated judge bias and cultural-reasoning gaps.