Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training | Paper Citation Record

Observation 6704f74b-430b-4ac6-aabf-bd407257fa08 · inbound

MARS: Unleashing the Power of Variance Reduction for Training Large Models cites this paper.

MARS: Unleashing the Power of Variance Reduction for Training Large Models Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-12T19:43:01.838625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d60d0ddb-4d26-45c6-a4b3-b4e4c5826b3a · inbound

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization cites this paper.

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-12T19:30:54.969095Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aed8cdd0-072e-4cdc-8d38-e525c030185c · inbound

An Enhanced Levenberg--Marquardt Method via Gram Reduction cites this paper.

An Enhanced Levenberg--Marquardt Method via Gram Reduction Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-11T17:57:13.148559Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 816c38e3-096c-4bc3-8bd0-0af2dfd509f5 · inbound

SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training cites this paper.

SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-11T13:28:28.964729Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d72f25a4-55e2-4c77-a360-1ff99fd6cf31 · inbound

Open Problems in Machine Unlearning for AI Safety cites this paper.

Open Problems in Machine Unlearning for AI Safety Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 77

Resolution: unresolved; no resolver link, observed 2026-08-10T21:24:10.338748Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f13b28c7-d635-4820-bafe-ead489f3cdae · inbound

Physics of Skill Learning cites this paper.

Physics of Skill Learning Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-10T17:20:51.014910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6ce8f0f0-0954-4e5e-90e8-879eb8ae34cf · inbound

Explicit Eigenvalue Regularization Improves Sharpness-Aware Minimization cites this paper.

Explicit Eigenvalue Regularization Improves Sharpness-Aware Minimization Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-10T17:03:52.681306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1ff73d5-fed1-4f72-bc32-107140871d21 · inbound

Spectral-factorized Positive-definite Curvature Learning for NN Training cites this paper.

Spectral-factorized Positive-definite Curvature Learning for NN Training Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-08T16:15:07.263627Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7e82254b-2dae-417a-a908-44bf23178cdc · inbound

Improving Adaptive Moment Optimization via Preconditioner Diagonalization cites this paper.

Improving Adaptive Moment Optimization via Preconditioner Diagonalization Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-08T12:40:42.278139Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 28103d01-4a27-4def-af13-4ab16277a96d · inbound

AlphaGrad: Non-Linear Gradient Normalization Optimizer cites this paper.

AlphaGrad: Non-Linear Gradient Normalization Optimizer Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-16T11:18:01.465897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 53b5ac0a-c32a-4cdf-9c2f-5000aebe686b · inbound

HessFormer: Hessians at Foundation Scale cites this paper.

HessFormer: Hessians at Foundation Scale Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T21:04:26.092494Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f92b09ec-4ed6-42b5-a8d8-cd983770081c · inbound

A Physics-Inspired Optimizer: Velocity Regularized Adam cites this paper.

A Physics-Inspired Optimizer: Velocity Regularized Adam Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 14

Resolution: metadata mismatch; arxiv_id, observed 2026-05-22T14:34:54.274212Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 79d2afd9-892c-4856-80e5-74ea0ec09f49 · inbound

A Physics-Inspired Optimizer: Velocity Regularized Adam cites this paper.

A Physics-Inspired Optimizer: Velocity Regularized Adam Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 2009

Resolution: unresolved; no resolver link, observed 2026-08-15T20:24:29.576710Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9d5a6cc2-5fce-499b-b2a9-d380d7eddbc3 · inbound

AdamS: Momentum Itself Can Be A Normalizer for LLM Pretraining and Post-training cites this paper.

AdamS: Momentum Itself Can Be A Normalizer for LLM Pretraining and Post-training Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T15:09:13.476967Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41d1d060-2d07-4b60-82c3-1d07c83b3c6b · inbound

Accelerated Training of Federated Learning via Second-Order Methods cites this paper.

Accelerated Training of Federated Learning via Second-Order Methods Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 103

Resolution: unresolved; no resolver link, observed 2026-08-07T12:45:35.556742Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f061df55-1140-45c8-8105-1c0ed0ec6369 · inbound

Stochastic Diagonal Estimation Based on Matrix Quadratic Form Oracles cites this paper.

Stochastic Diagonal Estimation Based on Matrix Quadratic Form Oracles Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-15T19:44:33.269049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d489ca37-7038-47a4-bbe0-bc28e55b7f10 · inbound

Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track cites this paper.

Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-06T23:13:17.783769Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8a4e6230-10b8-41d4-9d9c-120d5a4c958b · inbound

SoftSignSGD(S3): An Enhanced Optimizer for Practical DNN Training and Loss Spikes Minimization Beyond Adam cites this paper.

SoftSignSGD(S3): An Enhanced Optimizer for Practical DNN Training and Loss Spikes Minimization Beyond Adam Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-06T19:10:16.530074Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8ff146d4-94b4-4b36-9368-70d78bbf45b9 · inbound

DNT: a Deeply Normalized Transformer that can be trained by Momentum SGD cites this paper.

DNT: a Deeply Normalized Transformer that can be trained by Momentum SGD Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-06T14:54:58.829273Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bd57ed43-8e23-4aee-b56d-253bba041ffb · inbound

Sketched Gaussian Mechanism for Private Federated Learning cites this paper.

Sketched Gaussian Mechanism for Private Federated Learning Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-04T21:12:50.922764Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d51b4e2-2428-4ea0-835e-65e80319d235 · inbound

On the Convergence of Muon and Beyond cites this paper.

On the Convergence of Muon and Beyond Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 30

Resolution: verified exact; arxiv_id, observed 2026-05-18T15:56:34.183303Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation fa4a4d9d-b91c-4d2b-a413-ad83348928b1 · inbound

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure cites this paper.

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 41

Resolution: verified exact; arxiv_id, observed 2026-05-18T14:52:41.131143Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 524fef99-d863-46aa-929b-efe21266c15b · inbound

Downgrade to Upgrade: Optimizer Simplification Enhances Robustness in LLM Unlearning cites this paper.

Downgrade to Upgrade: Optimizer Simplification Enhances Robustness in LLM Unlearning Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 37

Resolution: verified exact; arxiv_id, observed 2026-05-18T10:46:16.991047Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 4162e015-673a-42ae-bd0b-59b21bd62987 · inbound

GraphMind: Theorem Selection and Conclusion Generation Framework with Dynamic GNN for LLM Reasoning cites this paper.

GraphMind: Theorem Selection and Conclusion Generation Framework with Dynamic GNN for LLM Reasoning Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-05-21T18:34:17.957013Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation c1581cf0-e851-440d-acb1-cb73c7511f13 · inbound

Self-Organizing Dual-Buffer Adaptive Clustering Experience Replay (SODACER) for Safe Reinforcement Learning in Optimal Control cites this paper.

Self-Organizing Dual-Buffer Adaptive Clustering Experience Replay (SODACER) for Safe Reinforcement Learning in Optimal Control Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 21

Resolution: verified exact; arxiv_id, observed 2026-05-16T15:38:03.167730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 20291dcc-a6e8-4039-9249-45414dc50937 · inbound

Depth, Not Data: An Analysis of Hessian Spectral Bifurcation cites this paper.

Depth, Not Data: An Analysis of Hessian Spectral Bifurcation Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-21T13:54:11.462030Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 7cb9d17c-2b5d-4eec-bab4-aafb3d5eabbc · inbound

Depth, Not Data: An Analysis of Hessian Spectral Bifurcation cites this paper.

Depth, Not Data: An Analysis of Hessian Spectral Bifurcation Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-03T06:08:34.918720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f65aeb92-3dfa-4e91-9a24-53946232c73b · inbound

HTMuon: Improving Muon via Heavy-Tailed Spectral Correction cites this paper.

HTMuon: Improving Muon via Heavy-Tailed Spectral Correction Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 16

Resolution: verified exact; arxiv_id, observed 2026-05-25T06:55:26.310837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation abd7b83e-755f-4e06-9d4e-7809f7361549 · inbound

FLeX: Fourier-based Low-rank EXpansion for multilingual transfer cites this paper.

FLeX: Fourier-based Low-rank EXpansion for multilingual transfer Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-10T22:25:53.403860Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1e31ab96-ce91-475e-8898-20a5a0dda58d · inbound

STQuant: Spatio-Temporal Adaptive Framework for Optimizer Quantization in Large Multimodal Model Training cites this paper.

STQuant: Spatio-Temporal Adaptive Framework for Optimizer Quantization in Large Multimodal Model Training Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 12

Resolution: verified exact; arxiv_id, observed 2026-05-10T23:50:57.041214Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 9c0dcc7e-ec11-4da9-9feb-eea5c9b0be8a · inbound

Representation-Guided Parameter-Efficient LLM Unlearning cites this paper.

Representation-Guided Parameter-Efficient LLM Unlearning Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 96

Resolution: metadata mismatch; arxiv_id, observed 2026-05-10T06:06:19.357258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation ddde0999-e6c4-457f-a4b9-87ec3efecd8e · inbound

AdaMeZO: Adam-style Zeroth-Order Optimizer for LLM Fine-tuning Without Maintaining the Moments cites this paper.

AdaMeZO: Adam-style Zeroth-Order Optimizer for LLM Fine-tuning Without Maintaining the Moments Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 17

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T15:31:07.780240Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation d0f2b442-edfd-42e7-a38a-27a19a23f2c2 · inbound

Anon: Extrapolating Adaptivity Beyond SGD and Adam cites this paper.

Anon: Extrapolating Adaptivity Beyond SGD and Adam Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 7

Resolution: verified exact; arxiv_id, observed 2026-05-11T16:31:09.762686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 0d7a88ee-e398-474d-910f-ddad5766b1cb · inbound

Fast Gauss-Newton for Multiclass Cross-Entropy cites this paper.

Fast Gauss-Newton for Multiclass Cross-Entropy Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 22

Resolution: verified exact; arxiv_id, observed 2026-05-11T18:46:09.639399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation b4d6b4c9-d03d-450e-aa4d-4cd04cb06175 · inbound

When Descent Is Too Stable: Event-Triggered Hamiltonian Learning to Optimize cites this paper.

When Descent Is Too Stable: Event-Triggered Hamiltonian Learning to Optimize Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 31

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T04:15:58.135974Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 38f7f36c-4495-4e6c-9046-1dc5bab39699 · inbound

OrScale: Orthogonalised Optimization with Layer-Wise Trust-Ratio Scaling cites this paper.

OrScale: Orthogonalised Optimization with Layer-Wise Trust-Ratio Scaling Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 10

Resolution: verified exact; arxiv_id, observed 2026-05-11T03:05:55.545930Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 768681cb-4d85-4433-b1de-9f55c8b3656a · inbound

Position: Zeroth-Order Optimization in Deep Learning Is Underexplored, Not Underpowered cites this paper.

Position: Zeroth-Order Optimization in Deep Learning Is Underexplored, Not Underpowered Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 37

Resolution: metadata mismatch; arxiv_id, observed 2026-05-20T21:23:44.499777Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a70a80e3-06e8-4f18-8e64-1e9c65c9463f · inbound

TBP-mHC: full expressivity for manifold-constrained hyper connections through transportation polytopes cites this paper.

TBP-mHC: full expressivity for manifold-constrained hyper connections through transportation polytopes Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 12

Resolution: verified exact; arxiv_id, observed 2026-05-22T10:01:23.417380Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e278e906-69ee-4b96-b4e4-31171763cf2e · inbound

Why SGD is not Brownian Motion: A New Perspective on Stochastic Dynamics cites this paper.

Why SGD is not Brownian Motion: A New Perspective on Stochastic Dynamics Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 153

Resolution: metadata mismatch; arxiv_id, observed 2026-05-22T08:11:17.272744Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation dd4ffc87-30e8-45ae-ae74-045f5c499fc3 · inbound

MAdam: Metric-Aware Multi-Objective Adam cites this paper.

MAdam: Metric-Aware Multi-Objective Adam Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-07-02T01:56:28.457859Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 0f5bdaee-8582-4180-a923-3c8dd4fa77e6 · inbound

Why Muon Outperforms Adam: A Curvature Perspective cites this paper.

Why Muon Outperforms Adam: A Curvature Perspective Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 103

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T07:06:44.868441Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 23065f76-49d6-41ff-ae8e-b74256f84141 · inbound

Nonreversible Gauge Fields in Fokker--Planck Dynamics: Supersymmetric Hamiltonians and Learned Finite Forces cites this paper.

Nonreversible Gauge Fields in Fokker--Planck Dynamics: Supersymmetric Hamiltonians and Learned Finite Forces Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-07-02T16:27:09.266798Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation dd75d8df-e762-4841-adeb-7804f04027d1 · inbound

Zeta: Dual Whitening for Matrix Optimization via Coordinate-Adaptive Preconditioning cites this paper.

Zeta: Dual Whitening for Matrix Optimization via Coordinate-Adaptive Preconditioning Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 24

Resolution: verified exact; arxiv_id, observed 2026-07-03T16:38:41.033120Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 639c8233-e634-4a3b-9ac5-2cc2e2935678 · inbound

Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models cites this paper.

Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-07-04T16:49:58.420186Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 65aa25fd-9971-43bd-aad9-911f003c6835 · inbound

Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models cites this paper.

Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-07-01T09:25:41.284177Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a5c9ca12-1df1-4865-8c30-f836d80cec43 · inbound

Curvature-Weighted Gradient Diversity: A Noise Measure for Geometry-Adaptive SGD Schedules cites this paper.

Curvature-Weighted Gradient Diversity: A Noise Measure for Geometry-Adaptive SGD Schedules Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 9

Resolution: verified exact; arxiv_id, observed 2026-06-30T07:34:21.498373Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation ad27b670-2eea-4251-82d4-ef71158d43d9 · inbound

Causal Optimizer Interaction Calculus: Hidden Geometric Relaxation and Identifiable Interventions cites this paper.

Causal Optimizer Interaction Calculus: Hidden Geometric Relaxation and Identifiable Interventions Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 78

Resolution: verified exact; local_arxiv, observed 2026-07-09T17:36:25.376052Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 72064397-e298-4e98-bb53-26beab5072c7 · inbound

Causal Optimizer Interaction Calculus: Hidden Geometric Relaxation and Identifiable Interventions cites this paper.

Causal Optimizer Interaction Calculus: Hidden Geometric Relaxation and Identifiable Interventions Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 163

Resolution: unresolved; no resolver link, observed 2026-07-14T15:50:41.329016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0823259-c6e0-43b6-be8a-72bef1918ab1 · inbound

OPTScientist: Multi-Agent Discovery of Typed Optimizer Programs for Transformer Pretraining cites this paper.

OPTScientist: Multi-Agent Discovery of Typed Optimizer Programs for Transformer Pretraining Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-02T12:30:37.114754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Coverage vector

Reference resolution

Outbound references

Pith citing papers