A 7.2 MB branched DNN, fed with MediaPipe landmarks encoded as 947 ASL parameter features, classifies 343 isolated American Sign Language signs with 92% video-level accuracy and sub-10 ms latency on edge devices.
GLoT: A Novel Gated-Logarithmic Transformer for Efficient Sign Language Translation
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Machine Translation has played a critical role in reducing language barriers, but its adaptation for Sign Language Machine Translation (SLMT) has been less explored. Existing works on SLMT mostly use the Transformer neural network which exhibits low performance due to the dynamic nature of the sign language. In this paper, we propose a novel Gated-Logarithmic Transformer (GLoT) that captures the long-term temporal dependencies of the sign language as a time-series data. We perform a comprehensive evaluation of GloT with the transformer and transformer-fusion models as a baseline, for Sign-to-Gloss-to-Text translation. Our results demonstrate that GLoT consistently outperforms the other models across all metrics. These findings underscore its potential to address the communication challenges faced by the Deaf and Hard of Hearing community.
fields
cs.CV 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Developing Lightweight DNN Models With Limited Data For Real-Time Sign Language Recognition
A 7.2 MB branched DNN, fed with MediaPipe landmarks encoded as 947 ASL parameter features, classifies 343 isolated American Sign Language signs with 92% video-level accuracy and sub-10 ms latency on edge devices.