BenchMaker automatically builds multiple-choice benchmarks from assessment demands and matches human benchmarks' ranking power (0.967 Pearson correlation with MMLU-Pro across 12 LLMs) at $0.005 per item.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
LLM-Powered Benchmark Factory: Reliable, Generic, and Efficient
BenchMaker automatically builds multiple-choice benchmarks from assessment demands and matches human benchmarks' ranking power (0.967 Pearson correlation with MMLU-Pro across 12 LLMs) at $0.005 per item.