REVIEW 4 cited by
Schema-Guided Dialogue State Tracking Task at DSTC8
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
This paper gives an overview of the Schema-Guided Dialogue State Tracking task of the 8th Dialogue System Technology Challenge. The goal of this task is to develop dialogue state tracking models suitable for large-scale virtual assistants, with a focus on data-efficient joint modeling across domains and zero-shot generalization to new APIs. This task provided a new dataset consisting of over 16000 dialogues in the training set spanning 16 domains to highlight these challenges, and a baseline model capable of zero-shot generalization to new APIs. Twenty-five teams participated, developing a range of neural network models, exceeding the performance of the baseline model by a very high margin. The submissions incorporated a variety of pre-trained encoders and data augmentation techniques. This paper describes the task definition, dataset and evaluation methodology. We also summarize the approach and results of the submitted systems to highlight the overall trends in the state-of-the-art.
Forward citations
Cited by 4 Pith papers
-
Schema-Guided Response Generation using Multi-Frame Dialogue State for Motivational Interviewing Systems
A frame-based dialogue state plus retrieval of counselor strategies makes an MI chatbot more eliciting (more questions, less non-adherent advice) than prompt-only baselines, at the cost of perceived empathy.
-
Arch-Router: Aligning LLM Routing with Human Preferences
Arch-Router, a 1.5B fine-tuned generative model, matches chat queries to user-defined domain-action policies and reports higher accuracy than several proprietary models on adapted routing benchmarks.
-
The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
A new 8TB openly-licensed text corpus trains 7B LLMs that are competitive with Llama 1/2, showing that performant models need not depend on unlicensed web data.
-
PyTOD: Programmable Task-Oriented Dialogue with Execution Feedback
A solvable one-state model of a dynamic molecular switch is claimed to combine synapse-like switching with proven convergence and fading memory for stable neuromorphic computation.
Discussion (0). Continue with ORCID to comment.