clem:todd is a self-play benchmarking framework for task-oriented dialogue systems, and its MultiWOZ 2.2 booking experiments show monolithic and LLM-managed modular systems beating a fixed pipeline at lower cost.
Lets begin Figure 6: Prompt template for the User Simulator, specifying the task description, interaction instructions, and response format guidelines
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations
clem:todd is a self-play benchmarking framework for task-oriented dialogue systems, and its MultiWOZ 2.2 booking experiments show monolithic and LLM-managed modular systems beating a fixed pipeline at lower cost.