A gloss-free sign language translation framework, MMSLT, augments sign video features with MLLM-generated textual descriptions and achieves state-of-the-art BLEU-4 scores on PHOENIX14T and CSL-Daily.
Sign language transformers: Joint end-to- end sign language recognition and translation
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation
A gloss-free sign language translation framework, MMSLT, augments sign video features with MLLM-generated textual descriptions and achieves state-of-the-art BLEU-4 scores on PHOENIX14T and CSL-Daily.