MultiQ&A automatically rephrases questions and crowdsources answers from LLM agents, showing gpt-3.5-turbo is fairly stable on extractive and multiple-choice QA but more variable on free-form answers.
In Findings of the Association for Computational Linguistics: EMNLP 2020, 1896–1907
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
MultiQ&A: An Analysis in Measuring Robustness via Automated Crowdsourcing of Question Perturbations and Answers
MultiQ&A automatically rephrases questions and crowdsources answers from LLM agents, showing gpt-3.5-turbo is fairly stable on extractive and multiple-choice QA but more variable on free-form answers.