Fine-tuning an LLM with GPT-4o-generated sign language structure assistance improves sign pose generation over a Progressive Transformer baseline on Phoenix14T and How2Sign.
Autoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representations
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Gloss-free Sign Language Production (SLP) offers a direct translation of spoken language sentences into sign language, bypassing the need for gloss intermediaries. This paper presents the Sign language Vector Quantization Network, a novel approach to SLP that leverages Vector Quantization to derive discrete representations from sign pose sequences. Our method, rooted in both manual and non-manual elements of signing, supports advanced decoding methods and integrates latent-level alignment for enhanced linguistic coherence. Through comprehensive evaluations, we demonstrate superior performance of our method over prior SLP methods and highlight the reliability of Back-Translation and Fr\'echet Gesture Distance as evaluation metrics.
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Teach Me Sign: Stepwise Prompting LLM for Sign Language Production
Fine-tuning an LLM with GPT-4o-generated sign language structure assistance improves sign pose generation over a Progressive Transformer baseline on Phoenix14T and How2Sign.