GPT-4o and Gemma-2 generate Portuguese reading-comprehension MCQs whose expert and psychometric quality is comparable to human-authored items, while a two-step small-model pipeline underperforms.
Simple or Complex? Complexity-Controllable Question Generation with Soft Templates and Deep Mixture of Experts Model
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
The ability to generate natural-language questions with controlled complexity levels is highly desirable as it further expands the applicability of question generation. In this paper, we propose an end-to-end neural complexity-controllable question generation model, which incorporates a mixture of experts (MoE) as the selector of soft templates to improve the accuracy of complexity control and the quality of generated questions. The soft templates capture question similarity while avoiding the expensive construction of actual templates. Our method introduces a novel, cross-domain complexity estimator to assess the complexity of a question, taking into account the passage, the question, the answer and their interactions. The experimental results on two benchmark QA datasets demonstrate that our QG model is superior to state-of-the-art methods in both automatic and manual evaluation. Moreover, our complexity estimator is significantly more accurate than the baselines in both in-domain and out-domain settings.
citation-role summary
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
From Model to Classroom: Evaluating Generated MCQs for Portuguese with Narrative and Difficulty Concerns
GPT-4o and Gemma-2 generate Portuguese reading-comprehension MCQs whose expert and psychometric quality is comparable to human-authored items, while a two-step small-model pipeline underperforms.