A vision transformer encoder with a transformer decoder beats small CNN-LSTM and ResNet-LSTM baselines on image-to-LaTeX conversion in the authors' reported experiments.
Recognizing Handwritten Mathematical Expressions as LaTex Sequences Using a Multiscale Robust Neural Network
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
In this paper, a robust multiscale neural network is proposed to recognize handwritten mathematical expressions and output LaTeX sequences, which can effectively and correctly focus on where each step of output should be concerned and has a positive effect on analyzing the two-dimensional structure of handwritten mathematical expressions and identifying different mathematical symbols in a long expression. With the addition of visualization, the model's recognition process is shown in detail. In addition, our model achieved 49.459% and 46.062% ExpRate on the public CROHME 2014 and CROHME 2016 datasets. The present model results suggest that the state-of-the-art model has better robustness, fewer errors, and higher accuracy.
fields
cs.CV 1years
2024 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
Automated LaTeX Code Generation from Handwritten Math Expressions Using Vision Transformer
A vision transformer encoder with a transformer decoder beats small CNN-LSTM and ResNet-LSTM baselines on image-to-LaTeX conversion in the authors' reported experiments.