Introduces PicPersona-TOD, the first task-oriented dialogue dataset with user images as persona, together with a multimodal NLG baseline called Pictor.
Infusing Emotions into Task-oriented Dialogue Systems: Understanding, Management, and Generation
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Emotions are indispensable in human communication, but are often overlooked in task-oriented dialogue (ToD) modelling, where the task success is the primary focus. While existing works have explored user emotions or similar concepts in some ToD tasks, none has so far included emotion modelling into a fully-fledged ToD system nor conducted interaction with human or simulated users. In this work, we incorporate emotion into the complete ToD processing loop, involving understanding, management, and generation. To this end, we extend the EmoWOZ dataset (Feng et al., 2022) with system affective behaviour labels. Through interactive experimentation involving both simulated and human users, we demonstrate that our proposed framework significantly enhances the user's emotional experience as well as the task success.
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
PicPersona-TOD : A Dataset for Personalizing Utterance Style in Task-Oriented Dialogue with Image Persona
Introduces PicPersona-TOD, the first task-oriented dialogue dataset with user images as persona, together with a multimodal NLG baseline called Pictor.