Fine-tuning an LLM with GPT-4o-generated sign language structure assistance improves sign pose generation over a Progressive Transformer baseline on Phoenix14T and How2Sign.
Teach Me Sign: Stepwise Prompting LLM for Sign Language Production
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Large language models, with their strong reasoning ability and rich knowledge, have brought revolution to many tasks of AI, but their impact on sign language generation remains limited due to its complexity and unique rules. In this paper, we propose TEAch Me Sign (TEAM-Sign), treating sign language as another natural language. By fine-tuning an LLM, we enable it to learn the correspondence between text and sign language, and facilitate generation. Considering the differences between sign and spoken language, we employ a stepwise prompting strategy to extract the inherent sign language knowledge within the LLM, thereby supporting the learning and generation process. Experimental results on How2Sign and Phoenix14T datasets demonstrate that our approach effectively leverages both the sign language knowledge and reasoning capabilities of LLM to align the different distribution and grammatical rules between sign and spoken language.
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Teach Me Sign: Stepwise Prompting LLM for Sign Language Production
Fine-tuning an LLM with GPT-4o-generated sign language structure assistance improves sign pose generation over a Progressive Transformer baseline on Phoenix14T and How2Sign.