REVIEW 2 cited by
InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large language models (LLMs) have been used for diverse tasks in natural language processing (NLP), yet remain under-explored for task-oriented dialogue systems (TODS), especially for end-to-end TODS. We present InstructTODS, a novel off-the-shelf framework for zero-shot end-to-end task-oriented dialogue systems that can adapt to diverse domains without fine-tuning. By leveraging LLMs, InstructTODS generates a proxy belief state that seamlessly translates user intentions into dynamic queries for efficient interaction with any KB. Our extensive experiments demonstrate that InstructTODS achieves comparable performance to fully fine-tuned TODS in guiding dialogues to successful completion without prior knowledge or task-specific data. Furthermore, a rigorous human evaluation of end-to-end TODS shows that InstructTODS produces dialogue responses that notably outperform both the gold responses and the state-of-the-art TODS in terms of helpfulness, informativeness, and humanness. Moreover, the effectiveness of LLMs in TODS is further supported by our comprehensive evaluations on TODS subtasks: dialogue state tracking, intent classification, and response generation. Code and implementations could be found here https://github.com/WillyHC22/InstructTODS/
Forward citations
Cited by 2 Pith papers
-
MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents
MemGuide retrieves and filters past dialogue memories by intent and missing slots, and on its new synthetic benchmark MS-TOD it improves task success by 11 points and shortens dialogues by 2.84 turns.
-
Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategy
A three-agent domain-independent framework with distribution-balanced DPO training reaches Combined 106.3 on MultiWOZ 2.2 with Qwen2.5-7B, the best score among the compared baselines.
Discussion (0). Continue with ORCID to comment.