The reviewed record of science sign in
Pith

arxiv: 2408.09857 · v1 · pith:L64AWR3L · submitted 2024-08-19 · cs.CL

TaSL: Continual Dialog State Tracking via Task Skill Localization and Consolidation

Reviewed by Pithpith:L64AWR3Lopen to challenge →

classification cs.CL
keywords knowledgetaslskillconsolidationdialoguetaskstransfercontinual
0
0 comments X
read the original abstract

A practical dialogue system requires the capacity for ongoing skill acquisition and adaptability to new tasks while preserving prior knowledge. However, current methods for Continual Dialogue State Tracking (DST), a crucial function of dialogue systems, struggle with the catastrophic forgetting issue and knowledge transfer between tasks. We present TaSL, a novel framework for task skill localization and consolidation that enables effective knowledge transfer without relying on memory replay. TaSL uses a novel group-wise technique to pinpoint task-specific and task-shared areas. Additionally, a fine-grained skill consolidation strategy protects task-specific knowledge from being forgotten while updating shared knowledge for bi-directional knowledge transfer. As a result, TaSL strikes a balance between preserving previous knowledge and excelling at new tasks. Comprehensive experiments on various backbones highlight the significant performance improvements of TaSL over existing state-of-the-art methods. The source code is provided for reproducibility.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.