REVIEW 3 major objections 5 minor 247 references
Sign Language Question Answering: A New Task, Benchmark, and Baseline for Sign Language Understanding
T0 review · 3 major / 5 minor · reviewed 2026-08-01 · deepseek-v4-flash
Pith's one-line read Sign-language QA: answering natural-language questions about sign videos tests understanding beyond fixed gloss and translation mappings.
desk verdict Useful SLQA benchmark and baseline, but the 'beyond recognition/translation' claim needs a text-only oracle experiment to hold up. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the Question-Conditioned Modulated Temporal Downsampling (QCMTD) module. Before each temporal pooling layer, frame features are modulated by a global question embedding and per-frame relevance weights, producing a question-aware video representation that preserves segments relevant to the question. This replaces the fixed, question-agnostic temporal convolution used in prior sign-language pipelines. The other key machinery is a three-stage in-domain knowledge transfer strategy: first a visual encoder is pre-trained with continuous sign-language recognition using CTC loss, then a language decoder is trained for sign-language translation, and finally the whole model is
What would settle it
Run an oracle experiment in which the ground-truth gloss sequence and translation are provided as text to the answer generator, skipping the video entirely. If a text-only oracle achieves near-perfect accuracy on M1, M2, and M3, those categories would be shown to test recognition-based lookup rather than video-grounded reasoning.
Extended reading notes
Core claim
The paper's central discovery is that sign-language understanding can be evaluated through question answering: given a sign-language video and an arbitrary natural-language question, a model should generate the correct answer. To support this, the authors produce SignQA, a benchmark of 144,550 template-generated question-answer pairs covering position reasoning, structural reasoning, visual search, gloss recognition, and translation understanding. Their baseline, SLQAM, uses a Question-Conditioned Modulated Temporal Downsampling (QCMTD) module and a three-stage in-domain knowledge transfer pipeline, and it outperforms representative video-language models and a cascaded sign-to-text-to-answer
Load-bearing premise
The load-bearing premise is that question-answer pairs generated from existing gloss and translation annotations actually measure video-grounded semantic understanding rather than, for many categories, just recognition and text-based lookup.
Editorial extensions
If this is right
- SLQA can serve as a standardized benchmark for evaluating sign-language understanding beyond fixed recognition and translation objectives.
- Question-conditioned temporal downsampling is shown to be more effective than fixed temporal convolution or Q-Former-style aggregation for sign-video question answering.
- In-domain pre-training on continuous sign-language recognition and translation provides a substantial boost over training from scratch or from generic video-language models.
- The five question categories offer a diagnostic breakdown of model strengths, from fine-grained visual search and sequential reasoning to sentence-level semantic understanding.
- The token-weighted fine-tuning strategy is a practical recipe for training on template-generated QA benchmarks, preventing models from memorizing answer patterns.
Reading between the lines
- Because M1-M3 questions are deterministic lookups over gloss sequences, a model with strong gloss recognition and a small text-reasoning module could solve them without true video-grounded understanding; an oracle experiment feeding ground-truth glosses as text would reveal how much of the benchmark is actually testing recognition versus reasoning.
- The template-based construction limits linguistic and visual diversity; extending SignQA with human-written open-ended questions and free-form answers would strengthen claims about general sign-language understanding.
- The QCMTD mechanism could transfer to other fine-grained video-QA tasks where questions target short temporal segments, such as gesture recognition or sports-event reasoning.
- The per-category results suggest that future SLU models should be compared on their reasoning profiles across these five capabilities, not just on translation quality.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Sign Language Question Answering (SLQA), a new task in which a model must answer natural-language questions about a sign-language video. The authors construct two benchmarks, SignQA-PHOENIX14T and SignQA-CSL-Daily, by instantiating 30 templates over existing gloss and sentence annotations, covering position reasoning, structural reasoning, visual search, gloss recognition, and translation understanding. They also propose a baseline, SLQAM, with a question-conditioned temporal downsampling module (QCMTD) and a three-stage in-domain knowledge transfer pipeline (CSLR pretraining, SLT training, SLQA fine-tuning). Experiments compare SLQAM with general-purpose VLMs and a cascaded Sign2Text2Answer baseline, reporting consistent improvements across categories and overall metrics.
Significance. If the benchmark truly measures video-grounded semantic understanding beyond recognition and translation, this is a valuable contribution: it defines a new evaluation paradigm, provides two public benchmarks, and gives a strong baseline. The paper also has practical strengths: the datasets are released, random sampling uses fixed seeds, and the experimental setup is clearly described. However, the central claim is not yet established. Because every QA pair is derived from the same gloss and translation annotations that define recognition and translation, the benchmark may be solvable by a system that first recognizes glosses/translations and then performs text-only QA; the paper reports no oracle experiment to rule this out. In addition, the reported performance differences are not accompanied by error bars or significance tests. These are load-bearing gaps for the paper's headline claims.
major comments (3)
- [Dataset Construction, Table 10] The benchmark's construct validity is unverified. Each of the five question categories is generated from the existing gloss or sentence annotations: M4 asks for the gloss sequence itself, M5 asks for the spoken translation itself, and M1–M3 are deterministic lookups over the gloss sequence (e.g., 'Which gloss appears at position 2?'). Thus an oracle that is given ground-truth glosses and translations as text-only input to the answer generator would answer the benchmark without any video understanding. The paper claims SLQA assesses 'multiple reasoning capabilities beyond recognition and translation' (Abstract, Introduction), but no such oracle upper bound is reported. The authors should add this decisive control, and also analyze which categories cannot be solved by the oracle, to substantiate the central claim.
- [Tables 5–8] The 'consistently outperforms' claim lacks statistical support. All tables report a single run with no error bars, confidence intervals, or significance tests. Some differences are small—for example, on PHOENIX14T test overall, SLQAM achieves BLEU-4 34.12 vs. 33.24 for Sign2Text2Answer (Table 6), and on CSL-Daily test overall, ROUGE-L is 73.52 vs. 70.75 (Table 8). Given that the benchmark is template-generated, paired bootstrap or multiple-seed reporting is essential to show the gains are not noise. This is a load-bearing issue for the main empirical comparison.
- [In-domain Knowledge Transfer Training / Dataset Construction] There is a potential train/evaluation overlap that weakens the interpretation of the baseline results. The model is pretrained on CSLR and SLT using PHOENIX14T and CSL-Daily annotations, and then fine-tuned on QA pairs generated from the same annotations. Since M4 and M5 ask for exactly those annotations, strong performance may reflect memorized recognition/translation mappings rather than question-conditioned video reasoning. A text-only oracle on the QA head, or evaluation on a held-out set with questions that cannot be derived from the original annotations, would clarify whether the QCMTD and pretraining gains are due to genuine question-aware video understanding or to annotation reuse.
minor comments (5)
- [Tables 5–6 captions] 'Phenix14T' should be 'Phoenix14T'.
- [Evaluation of SLQA Performance on CSL-Daily-QA] The sentence 'Tables 7 and 8 compare SLQAM with general-purpose VLMs and the cascaded Sign2Text2Answer baseline on CSL-Daily-QA da.' is incomplete; 'da' should be 'dataset'.
- [Table 9] The 'Total QA Pairs' row reads '3035,480'; this likely means '30 templates; 35,480 pairs' but the formatting is ambiguous and should be corrected.
- [Related Work, paragraph 1] The phrase 'we formulate SLQA as a bora SLU task' contains a typo; presumably 'novel' was intended.
- [Dataset Construction, M3] The non-manual marker questions on CSL-Daily are said to be instantiated from annotations, but the procedure for deriving the interrogative/non-interrogative answer is not specified. Please clarify how the template determines the answer from the original annotation without additional manual labeling.
Circularity Check
The 'beyond recognition and translation' claim is partially definitional: M4/M5 are the recognition/translation tasks restated as questions, and M1–M3 are deterministic lookups over the same gloss annotations.
-
self definitional
[Dataset Construction (Question Categories M4/M5; Generation Procedure); Abstract]
"M4 – Gloss Recognition. The model answers questions that require recognizing the gloss sequence corresponding to the input SL video. ... M5 – Translation Understanding. The model answers questions requiring the spoken-language translation of the input SL video. ... The answer is then deterministically derived from the annotations according to the question type."
SLQA is introduced as evaluating SLU 'beyond recognition and translation,' but M4's correct answer is by construction the GT gloss sequence (CSLR output) and M5's correct answer is the GT spoken sentence (SLT output). M1–M3 are likewise deterministic operations on the same GT gloss sequence (fetch-by-position, neighbor, occurrence search). Hence the benchmark's advertised 'multiple reasoning capabilities beyond recognition and translation' reduces, for all five categories, to recognizing/translating the input annotations or performing string lookups on them; the QA wrapper does not add an independently specified reasoning target.
full rationale
There is no formal derivation chain in this paper: the contribution is a task formulation, automatically generated benchmarks, and an empirical baseline. The baseline experiments are internally coherent and are compared against externally fine-tuned VLMs (VideoLLaMA3, Qwen3-VL, InternVL3), so the engineering and evaluation sections are not circular. The circularity/construct-validity issue is confined to the central benchmarking claim. The paper states that QA pairs are generated 'by leveraging the existing gloss and sentence annotations' and that M4 and M5 ask for the gloss sequence and the spoken-language translation. Those are the very recognition/translation outputs the paper says SLQA goes beyond, and the remaining categories are deterministic queries over the same gloss annotation. Thus the assertion that SLQA 'assesses multiple reasoning capabilities beyond recognition and translation' is not demonstrated; a text-only oracle using ground-truth glosses/translations would be the decisive control and is absent. Weighing this against the substantial independent benchmark/baseline work, the score reflects a partial, definitional reduction rather than a full equivalence or a self-citation chain.
Assumptions & free parameters
free parameters (2)
- Template/answer token loss weights =
0.02 (template), 0.98 (answer)
- Augmentation hyperparameters =
flip p=0.5; temporal scaling ±20%
assumptions (4)
- domain assumption Ground-truth gloss and sentence annotations in PHOENIX14T and CSL-Daily are correct and sufficient to generate unambiguous QA pairs.
- domain assumption Template-instantiated questions are a valid probe of video-grounded sign language understanding.
- standard math CTC loss aligns video frames to glosses for pretraining.
- domain assumption Pre-trained ResNet-18 and mT5 provide appropriate initialization for the sign-language QA model.
Cite this review
Pith. "Pith review of Sign Language Question Answering: A New Task, Benchmark, and Baseline for Sign Language Understanding." pith.science (2026). https://pith.science/paper/VDIJOP4E
@misc{pith2026260727826,
author = {Pith},
title = {Pith review of: Sign Language Question Answering: A New Task, Benchmark, and Baseline for Sign Language Understanding},
year = {2026},
howpublished = {\url{https://pith.science/paper/VDIJOP4E}},
note = {Machine review of arXiv:2607.27826}
}
read the original abstract
Recent advances in sign language (SL) understanding (SLU) have led to remarkable progress in tasks such as continuous SL recognition and SL translation. However, these tasks are designed with predefined objectives, requiring models to learn a fixed mapping from sign videos to glosses or spoken-language sentences. As a result, they provide only a limited assessment of whether a model truly understands the semantic content of SL videos. To address this limitation, \textbf{we first propose a new task, Sign Language Question Answering (SLQA)}, which evaluates SL understanding by requiring models to answer arbitrary natural language questions about SL videos. Unlike previous SLU tasks, SLQA provides a more flexible and comprehensive evaluation framework that assesses multiple reasoning capabilities beyond recognition and translation. To facilitate this task, \textbf{we further construct two SignQA benchmarks} based on PHOENIX14T and CSL-Daily by automatically generating question-answer pairs from existing gloss and sentence annotations using carefully designed templates. The resulting datasets cover five complementary question categories, including position reasoning, structural reasoning, visual search, gloss recognition, and translation understanding. \textbf{Finally, we propose a simple yet effective baseline model} equipped with a Question-Conditioned Modulated Temporal Downsampling module and an in-domain knowledge transfer strategy, enabling effective knowledge transfer from existing SLU tasks while enhancing question-aware temporal feature modeling. Extensive experiments demonstrate that our baseline consistently outperforms representative vision-language models across all question categories, establishing a strong benchmark for future research on SLQA. Datasets are available at:{https://huggingface.co/datasets/hulala/SignQA-2026}.
Figures
Reference graph
Works this paper leans on
-
[1]
Proceedings of the 2022 conference on empirical methods in natural language processing , pages=
Video question answering: Datasets, algorithms and challenges , author=. Proceedings of the 2022 conference on empirical methods in natural language processing , pages=
2022
-
[2]
Proceedings of the 31st International Conference on Computational Linguistics , pages=
VideoQA-TA: Temporal-Aware Multi-Modal Video Question Answering , author=. Proceedings of the 31st International Conference on Computational Linguistics , pages=
-
[3]
arXiv preprint arXiv:2404.03413 , year=
MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens , author=. arXiv preprint arXiv:2404.03413 , year=
-
[4]
European Conference on Computer Vision , pages=
Llama-vid: An image is worth 2 tokens in large language models , author=. European Conference on Computer Vision , pages=. 2024 , organization=
2024
-
[5]
Proceedings of the IEEE international conference on computer vision , pages=
Vqa: Visual question answering , author=. Proceedings of the IEEE international conference on computer vision , pages=
-
[6]
Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
Clevr: A diagnostic dataset for compositional language and elementary visual reasoning , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
-
[7]
Advances in neural information processing systems , volume=
Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks , author=. Advances in neural information processing systems , volume=
-
[8]
International conference on machine learning , pages=
Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation , author=. International conference on machine learning , pages=. 2022 , organization=
2022
Show all 247 references
-
[9]
Advances in neural information processing systems , volume=
Flamingo: a visual language model for few-shot learning , author=. Advances in neural information processing systems , volume=
-
[10]
Advances in neural information processing systems , volume=
Visual instruction tuning , author=. Advances in neural information processing systems , volume=
-
[11]
Proceedings of the 25th ACM international conference on Multimedia , pages=
Video question answering via gradually refined attention over appearance and motion , author=. Proceedings of the 25th ACM international conference on Multimedia , pages=
-
[12]
Proceedings of the AAAI conference on artificial intelligence , volume=
Activitynet-qa: A dataset for understanding complex web videos via question answering , author=. Proceedings of the AAAI conference on artificial intelligence , volume=
-
[13]
Proceedings of the 2024 conference on empirical methods in natural language processing , pages=
Video-llava: Learning united visual representation by alignment before projection , author=. Proceedings of the 2024 conference on empirical methods in natural language processing , pages=
2024
-
[14]
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=
Video-chatgpt: Towards detailed video understanding via large vision and language models , author=. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=
-
[15]
International conference on machine learning , pages=
Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models , author=. International conference on machine learning , pages=. 2023 , organization=
2023
-
[16]
arXiv preprint arXiv:2501.13106 , year=
Videollama 3: Frontier multimodal foundation models for image and video understanding , author=. arXiv preprint arXiv:2501.13106 , year=
-
[17]
arXiv preprint arXiv:2511.21631 , year=
Qwen3-vl technical report , author=. arXiv preprint arXiv:2511.21631 , year=
-
[18]
arXiv preprint arXiv:2411.10442 , year=
Enhancing the reasoning ability of multimodal large language models via mixed preference optimization , author=. arXiv preprint arXiv:2411.10442 , year=
-
[19]
Pattern Recognition , pages=
SSL-SSAW: Self-Supervised Learning with Sigmoid Self-Attention Weighting for Question-Based Sign Language Translation , author=. Pattern Recognition , pages=. 2026 , publisher=
2026
-
[20]
IEEE Transactions on Circuits and Systems for Video Technology , volume=
Overcoming modality bias in question-driven sign language video translation , author=. IEEE Transactions on Circuits and Systems for Video Technology , volume=. 2024 , publisher=
2024
-
[21]
arXiv preprint arXiv:2606.03788 , year=
SLU-2K: A Question-Based Benchmark for Semantic Evaluation of Sign Language Translation , author=. arXiv preprint arXiv:2606.03788 , year=
-
[22]
2000 , publisher =
The Syntax of American Sign Language: Functional Categories and Hierarchical Structure , author =. 2000 , publisher =
2000
-
[23]
2006 , publisher =
Sign Language and Linguistic Universals , author =. 2006 , publisher =
2006
-
[24]
TCSVT , volume=
Semantic Boundary Detection with Reinforcement Learning for Continuous Sign Language Recognition , author=. TCSVT , volume=. 2020 , publisher=
2020
-
[25]
, author=
Dilated Convolutional Network with Iterative Optimization for Continuous Sign Language Recognition. , author=. IJCAI , volume=
-
[26]
ECCV , year=
Fully convolutional networks for continuous sign language recognition , author=. ECCV , year=
-
[27]
CVPR , pages=
C2SLR: Consistency-Enhanced Continuous Sign Language Recognition , author=. CVPR , pages=
-
[28]
TPAMI , year=
Weakly supervised learning with multi-stream CNN-LSTM-HMMs to discover sequential parallelism in sign language videos , author=. TPAMI , year=
-
[29]
MM , pages=
Boosting Continuous Sign Language Recognition via Cross Modality Augmentation , author=. MM , pages=
-
[30]
ICCV , pages=
Self-Mutual Distillation Learning for Continuous Sign Language Recognition , author=. ICCV , pages=
-
[31]
ICCV , pages=
Visual alignment constraint for continuous sign language recognition , author=. ICCV , pages=
-
[32]
ICIP , pages=
Continuous sign language recognition via reinforcement learning , author=. ICIP , pages=. 2019 , organization=
2019
-
[33]
ICIMCS , pages=
A threshold-based hmm-dtw approach for continuous sign language recognition , author=. ICIMCS , pages=
-
[34]
CVPR , pages=
Re-sign: Re-aligned end-to-end sequence modelling with deep recurrent CNN-HMMs , author=. CVPR , pages=
-
[35]
AAAI , year=
Video-based sign language recognition without temporal segmentation , author=. AAAI , year=
-
[36]
TMM , year=
Graph-based multimodal sequential embedding for sign language translation , author=. TMM , year=
-
[37]
AAAI , volume=
Hierarchical lstm for sign language translation , author=. AAAI , volume=
-
[38]
ICCV , pages=
Subunets: End-to-end hand shape and continuous sign language recognition , author=. ICCV , pages=. 2017 , organization=
2017
-
[39]
arXiv preprint arXiv:1908.01341 , year=
SF-Net: Structured Feature Network for Continuous Sign Language Recognition , author=. arXiv preprint arXiv:1908.01341 , year=
1908 arXiv
-
[40]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
SignGraph: A Sign Sequence is Worth Graphs of Nodes , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[41]
CVPR , pages=
Recurrent convolutional neural networks for continuous sign language recognition by staged optimization , author=. CVPR , pages=
-
[42]
ECCV , pages=
Stochastic fine-grained labeling of multi-state sign glosses for continuous sign language recognition , author=. ECCV , pages=. 2020 , organization=
2020
-
[43]
, author=
Spatial-Temporal Multi-Cue Network for Continuous Sign Language Recognition. , author=. AAAI , year=
-
[44]
ICME , pages=
Dynamic pseudo label decoding for continuous sign language recognition , author=. ICME , pages=. 2019 , organization=
2019
-
[45]
TMM , volume=
A deep neural framework for continuous sign language recognition by iterative training , author=. TMM , volume=. 2019 , publisher=
2019
-
[46]
CVPR , pages=
Iterative alignment network for continuous sign language recognition , author=. CVPR , pages=
-
[47]
CVIU , pages=
Koller, Oscar and Forster, Jens and Ney, Hermann , title=. CVIU , pages=
-
[48]
Pattern Recognition Letters , volume=
Continuous sign language recognition using level building based on fast hidden Markov model , author=. Pattern Recognition Letters , volume=. 2016 , publisher=
2016
-
[49]
CVPR , pages=
Deep hand: How to train a cnn on 1 million hand images when your data is continuous and weakly labelled , author=. CVPR , pages=
-
[50]
Proceedings of the British Machine Vision Conference 2016 , year=
Deep sign: Hybrid CNN-HMM for continuous sign language recognition , author=. Proceedings of the British Machine Vision Conference 2016 , year=
2016
-
[51]
CVPR , pages=
Continuous Sign Language Recognition with Correlation Network , author=. CVPR , pages=
-
[52]
ICCV , pages=
CoSign: Exploring Co-occurrence Signals in Skeleton-based Continuous Sign Language Recognition , author=. ICCV , pages=
-
[53]
ICASSP , year=
Spatio-temporal graph convolutional networks for continuous sign language recognition , author=. ICASSP , year=
-
[54]
Proceedings of the AAAI Conference on Artificial Intelligence , volume=
Self-emphasizing network for continuous sign language recognition , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
-
[55]
Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
Improving continuous sign language recognition with cross-lingual signs , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
-
[56]
Journal of Electronic Imaging , volume=
Multiscale temporal network for continuous sign language recognition , author=. Journal of Electronic Imaging , volume=. 2024 , publisher=
2024
-
[57]
European conference on computer vision , pages=
Temporal lift pooling for continuous sign language recognition , author=. European conference on computer vision , pages=. 2022 , organization=
2022
-
[58]
Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
A Closer Look at Skeleton-based Continuous Sign Language Recognition , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
-
[59]
, author=
Connectionist Temporal Modeling of Video and Language: a Joint Model for Translation and Sign Labeling. , author=. IJCAI , pages=
-
[60]
, author=
Dense Temporal Convolution Network for Sign Language Translation. , author=. IJCAI , pages=
-
[61]
ACM Transactions on Accessible Computing (TACCESS) , volume=
Isolated sign language recognition with grassmann covariance matrices , author=. ACM Transactions on Accessible Computing (TACCESS) , volume=. 2016 , publisher=
2016
-
[62]
Proceedings of the AAAI Conference on Artificial Intelligence , volume=
Hand-Model-Aware Sign Language Recognition , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
-
[63]
IEEE Transactions on Circuits and Systems for Video Technology , volume=
Attention-based 3D-CNNs for large-vocabulary sign language recognition , author=. IEEE Transactions on Circuits and Systems for Video Technology , volume=. 2018 , publisher=
2018
-
[64]
arXiv preprint arXiv:2008.10428 , year=
Global-local Enhancement Network for NMFs-aware Sign Language Recognition , author=. arXiv preprint arXiv:2008.10428 , year=
2008 arXiv
-
[65]
2018 IEEE International Conference on Big Data (Big Data) , pages=
American sign language recognition using deep learning and computer vision , author=. 2018 IEEE International Conference on Big Data (Big Data) , pages=. 2018 , organization=
2018
-
[66]
2011 IEEE international conference on computer vision workshops (ICCV Workshops) , pages=
Real-time sign language letter and word recognition from depth data , author=. 2011 IEEE international conference on computer vision workshops (ICCV Workshops) , pages=. 2011 , organization=
2011
-
[67]
SMC , title=
K. SMC , title=. 1997 , volume=
1997
-
[68]
Proceedings of the AAAI conference on artificial intelligence , volume=
BEST: BERT pre-training for sign language recognition with coupling tokenization , author=. Proceedings of the AAAI conference on artificial intelligence , volume=
-
[69]
ACM Transactions on Intelligent Systems and Technology (TIST) , volume=
A real-time hand posture recognition system using deep neural networks , author=. ACM Transactions on Intelligent Systems and Technology (TIST) , volume=. 2015 , publisher=
2015
-
[70]
2016 IEEE International Conference on Image Processing (ICIP) , pages=
Sign language recognition based on adaptive hmms with data augmentation , author=. 2016 IEEE International Conference on Image Processing (ICIP) , pages=. 2016 , organization=
2016
-
[71]
ICIP , pages=
Sign language recognition with long short-term memory , author=. ICIP , pages=. 2016 , organization=
2016
-
[72]
TPAMI , year=
Scaling up multimodal pre-training for sign language understanding , author=. TPAMI , year=
-
[73]
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
Natural language-assisted sign language recognition , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
-
[74]
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
Transferring cross-domain knowledge for video sign language recognition , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
-
[75]
arXiv preprint arXiv:2503.08529 , year=
Signrep: Enhancing self-supervised sign representations , author=. arXiv preprint arXiv:2503.08529 , year=
-
[76]
2018 , publisher=
Addressing the rising prevalence of hearing loss , author=. 2018 , publisher=
2018
-
[77]
Coronavirus , author=
-
[78]
Conference on Computer Vision and Pattern Recognition (CVPR) , year=
Duarte, Amanda and Palaskar, Shruti and Ventura, Lucas and Ghadiyaram, Deepti and DeHaan, Kenneth and Metze, Florian and Torres, Jordi and Giro-i-Nieto, Xavier , title =. Conference on Computer Vision and Pattern Recognition (CVPR) , year=
-
[79]
CVPR , volume=
Online detection and classification of dynamic hand gestures with recurrent 3d convolutional neural networks , author=. CVPR , volume=
-
[80]
Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies , pages=
Learning word vectors for sentiment analysis , author=. Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies , pages=
-
[81]
Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
Mobilenetv2: Inverted residuals and linear bottlenecks , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
-
[82]
arXiv preprint arXiv:1704.04861 , year=
Mobilenets: Efficient convolutional neural networks for mobile vision applications , author=. arXiv preprint arXiv:1704.04861 , year=
-
[83]
arXiv preprint arXiv:2101.03697 , year=
RepVGG: Making VGG-style ConvNets Great Again , author=. arXiv preprint arXiv:2101.03697 , year=
-
[84]
Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
Deep residual learning for image recognition , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
-
[85]
proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=
Quo vadis, action recognition? a new model and the kinetics dataset , author=. proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=
-
[86]
Proceedings of the IEEE international conference on computer vision , pages=
Learning spatiotemporal features with 3d convolutional networks , author=. Proceedings of the IEEE international conference on computer vision , pages=
-
[87]
CVPR , pages=
Learning spatio-temporal representation with pseudo-3d residual networks , author=. CVPR , pages=
-
[88]
Neural networks , volume=
Framewise phoneme classification with bidirectional LSTM and other neural network architectures , author=. Neural networks , volume=. 2005 , publisher=
2005
-
[89]
Journal of Machine Learning Research , year =
Nitish Srivastava and Geoffrey Hinton and Alex Krizhevsky and Ilya Sutskever and Ruslan Salakhutdinov , title =. Journal of Machine Learning Research , year =
-
[90]
arXiv preprint arXiv:1412.6980 , year=
Adam: A method for stochastic optimization , author=. arXiv preprint arXiv:1412.6980 , year=
-
[91]
arXiv preprint arXiv:1409.1556 , year=
Very deep convolutional networks for large-scale image recognition , author=. arXiv preprint arXiv:1409.1556 , year=
-
[92]
NIPS , pages=
Sequence to sequence learning with neural networks , author=. NIPS , pages=
-
[93]
Biological cybernetics , volume=
Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , author=. Biological cybernetics , volume=. 1980 , publisher=
1980
-
[94]
arXiv preprint arXiv:1605.05101 , year=
Recurrent neural network for text classification with multi-task learning , author=. arXiv preprint arXiv:1605.05101 , year=
-
[95]
arXiv preprint arXiv:2003.00392 , year=
Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning , author=. arXiv preprint arXiv:2003.00392 , year=
2003 arXiv
-
[96]
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=
Dual encoding for zero-example video retrieval , author=. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=
-
[97]
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=
Devnet: A deep event network for multimedia event detection and evidence recounting , author=. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=
-
[98]
2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05) , volume=
Histograms of oriented gradients for human detection , author=. 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05) , volume=. 2005 , organization=
2005
-
[99]
2009 IEEE Conference on Computer Vision and Pattern Recognition , pages=
Histograms of oriented optical flow and binet-cauchy kernels on nonlinear dynamical systems for the recognition of human actions , author=. 2009 IEEE Conference on Computer Vision and Pattern Recognition , pages=. 2009 , organization=
2009
-
[100]
International journal of computer vision , volume=
Dense trajectories and motion boundary descriptors for action recognition , author=. International journal of computer vision , volume=. 2013 , publisher=
2013
-
[101]
International journal of computer vision , volume=
On space-time interest points , author=. International journal of computer vision , volume=. 2005 , publisher=
2005
-
[102]
International journal of computer vision , volume=
Detecting irregularities in images and in video , author=. International journal of computer vision , volume=. 2007 , publisher=
2007
-
[103]
IEEE transactions on pattern analysis and machine intelligence , volume=
Exploiting feature and class relationships in video categorization with regularized deep neural networks , author=. IEEE transactions on pattern analysis and machine intelligence , volume=. 2017 , publisher=
2017
-
[104]
Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
Beyond short snippets: Deep networks for video classification , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
-
[105]
ieee assp magazine , volume=
An introduction to hidden Markov models , author=. ieee assp magazine , volume=. 1986 , publisher=
1986
-
[106]
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) , volume=
Online early-late fusion based on adaptive HMM for sign language recognition , author=. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) , volume=. 2017 , publisher=
2017
-
[107]
Computer speech & language , volume=
Maximum likelihood linear transformations for HMM-based speech recognition , author=. Computer speech & language , volume=. 1998 , publisher=
1998
-
[108]
IEEE Transactions on Audio, Speech, and Language Processing , volume=
HMM word and phrase alignment for statistical machine translation , author=. IEEE Transactions on Audio, Speech, and Language Processing , volume=. 2008 , publisher=
2008
-
[109]
in the wild
The THUMOS challenge on action recognition for videos “in the wild” , author=. Computer Vision and Image Understanding , volume=. 2017 , publisher=
2017
-
[110]
Proceedings of the IEEE International Conference on Computer Vision Workshops , pages=
Gesture and sign language recognition with temporal residual networks , author=. Proceedings of the IEEE International Conference on Computer Vision Workshops , pages=
-
[111]
Advances in neural information processing systems , pages=
Faster r-cnn: Towards real-time object detection with region proposal networks , author=. Advances in neural information processing systems , pages=
-
[112]
European Conference on Computer Vision , pages=
Collaborative learning of gesture recognition and 3D hand pose estimation with multi-order feature analysis , author=. European Conference on Computer Vision , pages=. 2020 , organization=
2020
-
[113]
arXiv preprint arXiv:1406.2199 , year=
Two-stream convolutional networks for action recognition in videos , author=. arXiv preprint arXiv:1406.2199 , year=
-
[114]
European conference on computer vision , pages=
Temporal segment networks: Towards good practices for deep action recognition , author=. European conference on computer vision , pages=. 2016 , organization=
2016
-
[115]
ICML , pages=
Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks , author=. ICML , pages=
-
[116]
arXiv preprint arXiv:1409.0473 , year=
Neural machine translation by jointly learning to align and translate , author=. arXiv preprint arXiv:1409.0473 , year=
-
[117]
NIPS , pages=
Attention is all you need , author=. NIPS , pages=
-
[118]
arXiv preprint arXiv:1707.05928 , year=
Deep active learning for named entity recognition , author=. arXiv preprint arXiv:1707.05928 , year=
-
[119]
arXiv preprint arXiv:1412.4729 , year=
Translating videos to natural language using deep recurrent neural networks , author=. arXiv preprint arXiv:1412.4729 , year=
-
[120]
ICCV , pages=
Sequence to sequence-video to text , author=. ICCV , pages=
-
[121]
Proceedings of the IEEE international conference on computer vision , pages=
Describing videos by exploiting temporal structure , author=. Proceedings of the IEEE international conference on computer vision , pages=
-
[122]
Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
Jointly modeling embedding and translation to bridge video and language , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
-
[123]
Proceedings of the Eighteenth International Conference on Machine Learning , pages=
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , author=. Proceedings of the Eighteenth International Conference on Machine Learning , pages=
-
[124]
International Conference on Learning Representations , year=
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , author=. International Conference on Learning Representations , year=
-
[125]
Neural computation , volume=
Long short-term memory , author=. Neural computation , volume=. 1997 , publisher=
1997
-
[126]
CVPR , pages=
Deep high-resolution representation learning for human pose estimation , author=. CVPR , pages=
-
[127]
IEEE Transactions on Multimedia , volume=
Diversified visual attention networks for fine-grained object classification , author=. IEEE Transactions on Multimedia , volume=. 2017 , publisher=
2017
-
[128]
CVPR , pages=
Attentive generative adversarial network for raindrop removal from a single image , author=. CVPR , pages=
-
[129]
CVPR , pages=
Realtime multi-person 2d pose estimation using part affinity fields , author=. CVPR , pages=
-
[130]
2009 IEEE Conference on Computer Vision and Pattern Recognition , pages=
Learning sign language by watching TV (using weakly aligned subtitles) , author=. 2009 IEEE Conference on Computer Vision and Pattern Recognition , pages=. 2009 , organization=
2009
-
[131]
Proceedings of the IEEE International Conference on Computer Vision Workshops , pages=
Continuous gesture recognition with hand-oriented spatiotemporal feature , author=. Proceedings of the IEEE International Conference on Computer Vision Workshops , pages=
-
[132]
AAAI , year =
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition , author =. AAAI , year =
-
[133]
arXiv preprint arXiv:1609.02907 , year=
Semi-supervised classification with graph convolutional networks , author=. arXiv preprint arXiv:1609.02907 , year=
-
[134]
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=
Skeleton-based action recognition with directed graph neural networks , author=. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages=
-
[135]
Advances in neural information processing systems , volume=
Residual networks behave like ensembles of relatively shallow networks , author=. Advances in neural information processing systems , volume=
-
[136]
International conference on machine learning , pages=
Batch normalization: Accelerating deep network training by reducing internal covariate shift , author=. International conference on machine learning , pages=. 2015 , organization=
2015
-
[137]
ACL , pages=
BLEU: a method for automatic evaluation of machine translation , author=. ACL , pages=
-
[138]
Text summarization branches out , pages=
Rouge: A package for automatic evaluation of summaries , author=. Text summarization branches out , pages=
-
[139]
arXiv preprint arXiv:1211.3711 , year=
Sequence transduction with recurrent neural networks , author=. arXiv preprint arXiv:1211.3711 , year=
-
[140]
NIPS , volume=
Scheduled sampling for sequence prediction with recurrent neural networks , author=. NIPS , volume=
-
[141]
ACL , pages=
On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation , author=. ACL , pages=
-
[142]
ACL/IJCNLP (1) , year=
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation , author=. ACL/IJCNLP (1) , year=
-
[143]
CVPR , volume=
Dimensionality reduction by learning an invariant mapping , author=. CVPR , volume=. 2006 , organization=
2006
-
[144]
CoRR , year=
Sequence Level Training with Recurrent Neural Networks , author=. CoRR , year=
-
[145]
Adversarial Generation of Natural Language
Subramanian, Sandeep and Rajeswar, Sai and Dutil, Francis and Pal, Chris and Courville, Aaron. Adversarial Generation of Natural Language. Proceedings of the 2nd Workshop on Representation Learning for NLP. 2017. doi:10.18653/v1/W17-2629
2017 doi
-
[146]
2018 , isbn =
Shi, Zhan and Chen, Xinchi and Qiu, Xipeng and Huang, Xuanjing , title =. 2018 , isbn =
2018
-
[147]
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pages=
Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation? , author=. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pages=
2021
-
[148]
ICML , pages=
A simple framework for contrastive learning of visual representations , author=. ICML , pages=. 2020 , organization=
2020
-
[149]
NIPS , volume=
Bootstrap your own latent-a new approach to self-supervised learning , author=. NIPS , volume=
-
[150]
Advances in neural information processing systems , volume=
Pytorch: An imperative style, high-performance deep learning library , author=. Advances in neural information processing systems , volume=
-
[151]
International Conference on Learning Representations , year=
ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness , author=. International Conference on Learning Representations , year=
-
[152]
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
Masked autoencoders are scalable vision learners , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
-
[153]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Oneformer: One transformer to rule universal image segmentation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[154]
arXiv preprint arXiv:2008.09864 , year=
Tackling over-smoothing for general graph convolutional networks , author=. arXiv preprint arXiv:2008.09864 , year=
2008 arXiv
-
[155]
Proceedings of the IEEE/CVF international conference on computer vision , pages=
Swin transformer: Hierarchical vision transformer using shifted windows , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
-
[156]
Computational Visual Media , volume=
Pvt v2: Improved baselines with pyramid vision transformer , author=. Computational Visual Media , volume=. 2022 , publisher=
2022
-
[157]
Proceedings of the IEEE/CVF international conference on computer vision , pages=
Cvt: Introducing convolutions to vision transformers , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
-
[158]
Advances in neural information processing systems , volume=
Early convolutions help transformers see better , author=. Advances in neural information processing systems , volume=
-
[159]
International Conference on Learning Representations , year=
DropEdge: Towards Deep Graph Convolutional Networks on Node Classification , author=. International Conference on Learning Representations , year=
-
[160]
Advances in Neural Information Processing Systems , volume=
Vision gnn: An image is worth graph of nodes , author=. Advances in Neural Information Processing Systems , volume=
-
[161]
arXiv preprint arXiv:2105.14491 , year=
How attentive are graph attention networks? , author=. arXiv preprint arXiv:2105.14491 , year=
-
[162]
Advances in neural information processing systems , volume=
Inductive representation learning on large graphs , author=. Advances in neural information processing systems , volume=
-
[163]
ACM Transactions on Graphics (tog) , volume=
Dynamic graph cnn for learning on point clouds , author=. ACM Transactions on Graphics (tog) , volume=. 2019 , publisher=
2019
-
[164]
Transactions of the Association for Computational Linguistics , volume=
Multilingual denoising pre-training for neural machine translation , author=. Transactions of the Association for Computational Linguistics , volume=. 2020 , publisher=
2020
-
[165]
S entence P iece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing
Kudo, Taku and Richardson, John. S entence P iece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2018. doi:10.18653/...
2018 doi
-
[166]
, author=
Visualizing data using t-SNE. , author=. Journal of machine learning research , volume=
-
[167]
Transactions on Machine Learning Research Journal , pages=
DINOv2: Learning Robust Visual Features without Supervision , author=. Transactions on Machine Learning Research Journal , pages=
-
[168]
Advances in Neural Information Processing Systems , volume=
Seeing the image: Prioritizing visual correlation by contrastive alignment , author=. Advances in Neural Information Processing Systems , volume=
-
[169]
arXiv preprint arXiv:2305.06355 , year=
Videochat: Chat-centric video understanding , author=. arXiv preprint arXiv:2305.06355 , year=
-
[170]
, author=
Lora: Low-rank adaptation of large language models. , author=. ICLR , volume=
-
[171]
arXiv:2304.07193 , year=
DINOv2: Learning Robust Visual Features without Supervision , author=. arXiv:2304.07193 , year=
-
[172]
IEEE Transactions on Pattern Analysis and Machine Intelligence , volume=
Uniformer: Unifying convolution and self-attention for visual recognition , author=. IEEE Transactions on Pattern Analysis and Machine Intelligence , volume=. 2023 , publisher=
2023
-
[173]
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
Metaformer is actually what you need for vision , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
-
[174]
arXiv preprint arXiv:2407.08083 , year=
MambaVision: A Hybrid Mamba-Transformer Vision Backbone , author=. arXiv preprint arXiv:2407.08083 , year=
-
[175]
arXiv preprint arXiv:2302.13971 , year=
Llama: Open and efficient foundation language models , author=. arXiv preprint arXiv:2302.13971 , year=
-
[176]
arXiv preprint arXiv:2311.10122 , year=
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection , author=. arXiv preprint arXiv:2311.10122 , year=
-
[177]
2024 , eprint=
Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoning , author=. 2024 , eprint=
2024
-
[178]
arxiv , year=
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding , author=. arxiv , year=
-
[179]
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) , year=
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models , author=. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) , year=
2024
-
[180]
ICLR , year=
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , author=. ICLR , year=
-
[181]
OpenAI blog , volume=
Language models are unsupervised multitask learners , author=. OpenAI blog , volume=
-
[182]
Advances in Neural Information Processing Systems , volume=
Cogvlm: Visual expert for pretrained language models , author=. Advances in Neural Information Processing Systems , volume=
-
[183]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Vid2seq: Large-scale pretraining of a visual language model for dense video captioning , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[184]
2023 , journal=
MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning , author=. 2023 , journal=
2023
-
[185]
arXiv preprint arXiv:2304.10592 , year=
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models , author=. arXiv preprint arXiv:2304.10592 , year=
-
[186]
2020 , booktitle =
BLEURT: Learning Robust Metrics for Text Generation , author =. 2020 , booktitle =
2020
-
[187]
2024 IEEE International Conference on Robotics and Automation (ICRA) , pages=
MBot: A modular ecosystem for scalable robotics education , author=. 2024 IEEE International Conference on Robotics and Automation (ICRA) , pages=. 2024 , organization=
2024
-
[188]
Proceedings of the AAAI Conference on Artificial Intelligence , volume=
An LLM-Guided Tutoring System for Social Skills Training , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
-
[189]
Proceedings of the IEEE/CVF international conference on computer vision , pages=
Emerging properties in self-supervised vision transformers , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
-
[190]
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
Momentum contrast for unsupervised visual representation learning , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
-
[191]
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
Exploring simple siamese representation learning , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
-
[192]
arXiv preprint arXiv:2105.05222 , year=
Including Signed Languages in Natural Language Processing , author=. arXiv preprint arXiv:2105.05222 , year=
-
[193]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Llms are good sign language translators , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[194]
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing , pages=
Open-Domain Sign Language Translation Learned from Online Video , author=. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing , pages=
2022
-
[195]
IEEE Transactions on Circuits and Systems for Video Technology , year=
C 2 RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval , author=. IEEE Transactions on Circuits and Systems for Video Technology , year=
-
[196]
Proceedings of the 31st ACM International Conference on Multimedia , pages=
Towards Real-Time Sign Language Recognition and Translation on Edge Devices , author=. Proceedings of the 31st ACM International Conference on Multimedia , pages=
-
[197]
MM , pages=
Skeleton-Aware Neural Sign Language Translation , author=. MM , pages=
-
[198]
Advances in Neural Information Processing Systems , volume=
Two-stream network for sign language recognition and translation , author=. Advances in Neural Information Processing Systems , volume=
-
[199]
MM , pages=
SimulSLT: End-to-End Simultaneous Sign Language Translation , author=. MM , pages=
-
[200]
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=
Sign Language Translation with Hierarchical Spatio-Temporal Graph Neural Network , author=. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=
-
[201]
MM , pages=
Contrastive Disentangled Meta-Learning for Signer-Independent Sign Language Translation , author=. MM , pages=
-
[202]
Better Sign Language Translation with STMC -Transformer
Yin, Kayo and Read, Jesse. Better Sign Language Translation with STMC -Transformer. COLING. 2020. doi:10.18653/v1/2020.coling-main.525
2020 doi
-
[203]
The 25th Annual International Conference on Mobile Computing and Networking , pages=
Signspeaker: A real-time, high-precision smartwatch-based sign language translator , author=. The 25th Annual International Conference on Mobile Computing and Networking , pages=
-
[204]
TMM , year=
Spatial-temporal multi-cue network for sign language recognition and translation , author=. TMM , year=
-
[205]
2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020) , pages=
Neural sign language translation by learning tokenization , author=. 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020) , pages=. 2020 , organization=
2020
-
[206]
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation , author =
-
[207]
CVPR , pages=
Neural sign language translation , author=. CVPR , pages=
-
[208]
CVPR , pages=
Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation , author=. CVPR , pages=
-
[209]
ECCV , pages=
Multi-channel transformers for multi-articulatory sign language translation , author=. ECCV , pages=. 2020 , organization=
2020
-
[210]
IEEE Conf
Sign language recognition and translation with kinect , author=. IEEE Conf. on AFGR , volume=
-
[211]
Workshop on representation and processing of sign languages, LREC , volume=
Statistical sign language translation , author=. Workshop on representation and processing of sign languages, LREC , volume=. 2004 , organization=
2004
-
[212]
TIP , volume=
Hierarchical recurrent deep fusion using adaptive clip summarization for sign language translation , author=. TIP , volume=. 2019 , publisher=
2019
-
[213]
CVPR , pages=
A simple multi-modality transfer learning baseline for sign language translation , author=. CVPR , pages=
-
[214]
CVPR , pages=
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation , author=. CVPR , pages=
-
[215]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
How2Sign: a large-scale multimodal dataset for continuous American sign language , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[216]
Proceedings of the AAAI conference on artificial intelligence , volume=
Hierarchical lstm for sign language translation , author=. Proceedings of the AAAI conference on artificial intelligence , volume=
-
[217]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Gloss attention for gloss-free sign language translation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[218]
IEEE Transactions on Multimedia , volume=
Conditional sentence generation and cross-modal reranking for sign language translation , author=. IEEE Transactions on Multimedia , volume=. 2021 , publisher=
2021
-
[219]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Sign language translation from instructional videos , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[220]
Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23 , pages=
Contrastive learning for sign language recognition and translation , author=. Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23 , pages=
-
[221]
IEEE Transactions on Pattern Analysis and Machine Intelligence , year=
SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding , author=. IEEE Transactions on Pattern Analysis and Machine Intelligence , year=
-
[222]
ICCV , pages=
Gloss-free sign language translation: Improving from visual-language pretraining , author=. ICCV , pages=
-
[223]
ICLR 2024: The Twelfth International Conference on Learning Representations , year=
SIGN2GPT: leveraging large language models for gloss-free sign language translation , author=. ICLR 2024: The Twelfth International Conference on Learning Representations , year=
2024
-
[224]
NeurIPS , year=
Improving Gloss-free Sign Language Translation by Reducing Representation Density , author=. NeurIPS , year=
-
[225]
2025 , booktitle=
MixSignGraph: A Sign Sequence is Worth Mixed Graphs of Nodes , author=. 2025 , booktitle=
2025
-
[226]
Proceedings of the IEEE/CVF international conference on computer vision , pages=
Is context all you need? scaling neural sign language translation to large domains of discourse , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
-
[227]
Proceedings of the AAAI Conference on Artificial Intelligence , year =
Rui Zhao, Liang Zhang, Biao Fu, Cong Hu, Jinsong Su, Yidong Chen , title =. Proceedings of the AAAI Conference on Artificial Intelligence , year =
-
[228]
arXiv preprint arXiv:2412.16524 , year=
LLaVA-SLT: Visual Language Tuning for Sign Language Translation , author=. arXiv preprint arXiv:2412.16524 , year=
-
[229]
Advances in Neural Information Processing Systems , volume=
Youtube-asl: A large-scale, open-domain american sign language-english parallel corpus , author=. Advances in Neural Information Processing Systems , volume=
-
[230]
Advances in neural information processing systems , volume=
Scaling sign language translation , author=. Advances in neural information processing systems , volume=
-
[231]
arXiv preprint arXiv:2402.09611 , year=
Towards privacy-aware sign language translation at scale , author=. arXiv preprint arXiv:2402.09611 , year=
-
[232]
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) , pages=
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation , author=. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) , pages=
2024
-
[233]
Findings of the Association for Computational Linguistics: ACL 2025 , year=
Signmusketeers: An efficient multi-stream approach for sign language translation at scale , author=. Findings of the Association for Computational Linguistics: ACL 2025 , year=
2025
-
[234]
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , pages=
SignCLIP: Connecting Text and Sign Language by Contrastive Learning , author=. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , pages=
2024
-
[235]
SH u BERT : Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction
Gueuwou, Shester and Du, Xiaodan and Shakhnarovich, Greg and Livescu, Karen and Liu, Alexander H. SH u BERT : Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction. Proceedings of the 63rd Annual Meeting of the Association for Computational ...
2025
-
[236]
arXiv preprint arXiv:2501.15187 , year=
Uni-sign: Toward unified sign language understanding at scale , author=. arXiv preprint arXiv:2501.15187 , year=
-
[237]
The 61st Annual Meeting Of The Association For Computational Linguistics , year=
Gloss-Free End-to-End Sign Language Translation , author=. The 61st Annual Meeting Of The Association For Computational Linguistics , year=
-
[238]
European Conference on Computer Vision , pages=
Visual alignment pre-training for sign language translation , author=. European Conference on Computer Vision , pages=. 2024 , organization=
2024
-
[239]
arXiv preprint arXiv:2505.15438 , year=
Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation , author=. arXiv preprint arXiv:2505.15438 , year=
-
[240]
Proceedings of the 33rd ACM International Conference on Multimedia , pages=
Gloss Matters: Unlocking the Potential of Non-Autoregressive Sign Language Translation , author=. Proceedings of the 33rd ACM International Conference on Multimedia , pages=
-
[241]
Proceedings of the aaai conference on artificial intelligence , volume=
Conditional variational autoencoder for sign language translation with cross-modal alignment , author=. Proceedings of the aaai conference on artificial intelligence , volume=
-
[242]
arXiv preprint arXiv:2506.00129 , year=
Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translation , author=. arXiv preprint arXiv:2506.00129 , year=
-
[243]
Proceedings of the AAAI Conference on Artificial Intelligence , volume=
SCOPE: Sign Language Contextual Processing with Embedding from LLMs , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
-
[244]
arXiv preprint arXiv:2407.11144 , year=
YouTube-SL-25: A Large-Scale, Open-Domain Multilingual Sign Language Parallel Corpus , author=. arXiv preprint arXiv:2407.11144 , year=
-
[245]
Towards Privacy-Aware Sign Language Translation at Scale
Rust, Phillip and Shi, Bowen and Wang, Skyler and Camgoz, Necati Cihan and Maillard, Jean. Towards Privacy-Aware Sign Language Translation at Scale. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024
2024
-
[246]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Learning Effective Sign Features without Text for Gloss-free Sign Language Translation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[247]
Proceedings of the 31st ACM International Conference on Multimedia , year=
Enhancing Gloss-free Sign Language Translation by Prioritizing Visual Features for LLMs , author=. Proceedings of the 31st ACM International Conference on Multimedia , year=
Reviewed August 1, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.