REVIEW 5 cited by
Equation Embeddings
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
We present an unsupervised approach for discovering semantic representations of mathematical equations. Equations are challenging to analyze because each is unique, or nearly unique. Our method, which we call equation embeddings, finds good representations of equations by using the representations of their surrounding words. We used equation embeddings to analyze four collections of scientific articles from the arXiv, covering four computer science domains (NLP, IR, AI, and ML) and $\sim$98.5k equations. Quantitatively, we found that equation embeddings provide better models when compared to existing word embedding approaches. Qualitatively, we found that equation embeddings provide coherent semantic representations of equations and can capture semantic similarity to other equations and to words.
Forward citations
Cited by 5 Pith papers
-
Syntax Meets Semantics: Understanding Scientific Formulae
Formula syntax and textual semantics show weak direct correspondence but strong latent correlation; contrastive learning bridges the gap and lifts retrieval from ~5% to ~58% recall@10.
-
Exponential Family Attention
EFA sets the natural parameters of exponential family distributions to self-attention-transformed context embeddings, subsuming linear latent factor models and beating them on held-out prediction for several datasets.
-
E-Gen: Leveraging E-Graphs to Improve Continuous Representations of Symbolic Expressions
An e-graph-based data generator produces 55 million equivalent-expression training pairs, and embeddings trained on them beat prior math-embedding models and GPT-4o on several symbolic math tasks.
-
SSEmb: A Joint Structural and Semantic Embedding Framework for Mathematical Formula Retrieval
SSEmb, which fuses Operator Graph contrastive embeddings with Sentence-BERT text embeddings, reports state-of-the-art contextualized formula retrieval on ARQMath-3.
-
AI for Mathematics: Progress, Challenges, and Prospects
AI for math combines task-specific architectures and general foundation models to support research and advance AI reasoning capabilities.
Discussion (0). Continue with ORCID to comment.