REVIEW 6 cited by
Understanding Addition in Transformers
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Understanding the inner workings of machine learning models like Transformers is vital for their safe and ethical use. This paper provides a comprehensive analysis of a one-layer Transformer model trained to perform n-digit integer addition. Our findings suggest that the model dissects the task into parallel streams dedicated to individual digits, employing varied algorithms tailored to different positions within the digits. Furthermore, we identify a rare scenario characterized by high loss, which we explain. By thoroughly elucidating the model's algorithm, we provide new insights into its functioning. These findings are validated through rigorous testing and mathematical modeling, thereby contributing to the broader fields of model understanding and interpretability. Our approach opens the door for analyzing more complex tasks and multi-layer Transformer models.
Forward citations
Cited by 6 Pith papers
-
Path Channels and Plan Extension Kernels: a Mechanistic Description of Planning in a Sokoban RNN
A Sokoban-playing recurrent network stores future box moves in identifiable 'path channels' and builds plans by extending activations forward from boxes and backward from goals, with negative activations pruning failed paths.
-
Pretraining Curricula Enable Selective Fine-tuning
Imbalanced pretraining curricula disentangle task circuits in transformers, improving in-context learning and the selectivity of refusal fine-tuning relative to balanced training.
-
Explaining and Tuning Transformer-based LLMs in Arithmetic Tasks with Human Strategies
A small transformer learns addition, multiplication, and division by mastering simple digit subtasks first, and human teaching strategies lift its arithmetic accuracy to ~100%.
-
ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priors
Adding information-gain-selected virtual views refined by video diffusion priors to 3D Gaussian Splatting improves arbitrary-view rendering quality.
-
Extrapolation by Association: Length Generalization Transfer in Transformers
Length generalization on a short-trained main task can be inherited from a longer-trained related auxiliary task trained jointly with it.
-
Learning Euler Factors of Elliptic Curves
Neural networks predict the parity of Frobenius traces of elliptic curves from other traces with high accuracy, and their embeddings reveal learned mod-2 and mod-4 structure.
Discussion (0). Sign in to comment.