Pith. sign in

Paper Citation Record · LEDGER

Simple Convergence Proof of Adam From a Sign-like Descent Perspective

As of 7 August 2026, this Paper Citation Record lists 55 of 55 outbound references and 2 inbound Pith citation observations for arXiv:2507.05966.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.05966 v1

Coverage vector

measured 55 of 55 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T19:25:24.982987Z

measured 57 of 57 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T09:08:41.993925Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T10:09:44.606239Z

Reference resolution

55 of 55 outbound references displayed

  • verified exact0
  • verified fuzzy32
  • unresolved23
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 35277eaa-d935-45a7-a922-e10106887638 · outbound

This paper cites Lower bounds for non-convex stochastic optimization.Mathematical Programming, 199(1-2):165–214, 2023.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Lower bounds for non-convex stochastic optimization.Mathematical Programming, 199(1-2):165–214, 2023

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.658393Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.771687Z digest=sha256:afad28594c15cbd0a0a8f0b5f808a81f24c469295e45409d18186b4761a181cb

Observation 96dffac1-f544-44e4-86e9-98d132fd80ab · outbound

This paper cites SGD with AdaGrad stepsizes: Full adaptivity with high probability to unknown parameters, unbounded gradients and affine variance.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective SGD with AdaGrad stepsizes: Full adaptivity with high probability to unknown parameters, unbounded gradients and affine variance

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.648432Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.776747Z digest=sha256:0e106823fc059490f571a99f7b8e96ee2c2c2e41ebb9cc4b07187bf3a703616e

Observation 705886f5-1206-4618-877e-504f020888e5 · outbound

This paper cites Dissecting Adam: The sign, magnitude and variance of stochastic gradients.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Dissecting Adam: The sign, magnitude and variance of stochastic gradients

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.637157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.781062Z digest=sha256:4fd74b25f9f38133cf6343512f12918fbd5757a0aa88e3b78e6ee1f34e4a642d

Observation d6b50d4e-acfd-4e70-9c5e-bdbee63f31c4 · outbound

This paper cites signSGD: Compressed optimisation for non-convex problems.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective signSGD: Compressed optimisation for non-convex problems

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.627021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.785713Z digest=sha256:6b19f83d6a875b46ec38921fcbada29035aa0a93cbb70225f4156d68f79627af

Observation 4fd4a7bd-b944-42a2-8ba6-9538afd26af6 · outbound

This paper cites Gradient convergence in gradient methods with errors.SIAM Journal on Optimization, 10(3):627–642, 2000.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Gradient convergence in gradient methods with errors.SIAM Journal on Optimization, 10(3):627–642, 2000

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.789519Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.789519Z digest=sha256:db0adaea210aad67d99b16d083b1a6bad5e8348002203e1b54541e2a51cc5f81

Observation a1448b4a-3e5b-4cff-96dd-c0c1f9f44b13 · outbound

This paper cites Optimization methods for large-scale machine learning.SIAM review, 60(2):223–311, 2018.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Optimization methods for large-scale machine learning.SIAM review, 60(2):223–311, 2018

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.794447Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.794447Z digest=sha256:6dc689e1f184942ad533094607c6373f15d09ce7ea8c68adf12d8bcb31f31029

Observation 74849577-cce8-4e77-9b24-b06173cb34f3 · outbound

This paper cites Language models are few-shot learners.Advances in neural information processing systems, 33:1877–1901, 2020.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Language models are few-shot learners.Advances in neural information processing systems, 33:1877–1901, 2020

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.798716Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.798716Z digest=sha256:71c64552d30b949c069f6f0c37325ca6c52f59698696e86823fb6efba5313199

Observation fc0b04f6-4ce8-412b-aecb-1d4f532ff784 · outbound

This paper cites Towards practical Adam: Non-convexity, convergence theory, and mini-batch acceleration.Journal of Machine Learning Research, 23(229):1–47, 2022.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Towards practical Adam: Non-convexity, convergence theory, and mini-batch acceleration.Journal of Machine Learning Research, 23(229):1–47, 2022

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.598173Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.802028Z digest=sha256:6d682bc04b286619adba7b2881f52bd9c5c8c89521fcfe2cdfc2f98d4066d73b

Observation 11d3e333-4110-4097-84c0-8327c374b3d8 · outbound

This paper cites Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.805241Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.805241Z digest=sha256:676d720b26d6147979b2f2e1b848c397a2fd36f1e3ff580d33f6caa0773f330a

Observation 559654b5-1189-44e8-8fa5-21b20f5338ab · outbound

This paper cites Symbolic Discovery of Optimization Algorithms.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Symbolic Discovery of Optimization Algorithms

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.809707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.809707Z digest=sha256:bb45fff54ddeba84272c2399d0369a40fafebe7eca11ce20be1c0ae6aee5674f

Observation 3a3bebb0-c25d-427c-b034-75336438fa83 · outbound

This paper cites On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.814261Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.814261Z digest=sha256:4679cdefb7480aeee95e3e153c9bdcd1bf7af5c429feb40bc2b4070251e51033

Observation 94fadaeb-e8fe-4cfa-9c53-c40e5704f401 · outbound

This paper cites PaLM: Scaling language modeling with pathways.Journal of Machine Learning Research, 24(240):1– 113, 2023.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective PaLM: Scaling language modeling with pathways.Journal of Machine Learning Research, 24(240):1– 113, 2023

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.588146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.818037Z digest=sha256:2bb7199cee9ee90874e392b365e5e6c1de534cdca601551bc9b8f84a22df3ddb

Observation a8cafaca-0910-411d-9072-79e42d722862 · outbound

This paper cites Ro- bustness to unbounded smoothness of generalized signSGD.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Ro- bustness to unbounded smoothness of generalized signSGD

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.577020Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.821214Z digest=sha256:0069efccf01a45097f9b4c762a8a965072283ae97ab86445ce3682bdc4d0e7f2

Observation e6719adf-27b9-470a-b54b-92e36ae55226 · outbound

This paper cites A Simple Convergence Proof of Adam and Adagrad.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective A Simple Convergence Proof of Adam and Adagrad

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.824358Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.824358Z digest=sha256:04d4ce201d008b083469739d790bc83016b4664d5abf33bca2472919bbc612f1

Observation d9a34d3d-ac87-4bec-91d1-98ccb4585ba9 · outbound

This paper cites The Llama 3 Herd of Models.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective The Llama 3 Herd of Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.828053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.828053Z digest=sha256:40addbe72fa78e115f843ee0894cb627e4570d56b75ebd40c760208539a33258

Observation d07053c8-09ea-4b27-a942-b074b378a25f · outbound

This paper cites Beyond uniform smoothness: A stopped analysis of adaptive SGD.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Beyond uniform smoothness: A stopped analysis of adaptive SGD

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.566367Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.831997Z digest=sha256:ff4591a5c771f541fb989f5407851fab29c85b7a2f230534cc231055cb52b4f9

Observation 5b93e733-4e24-4a03-aed9-f8f51bc75240 · outbound

This paper cites The power of adaptivity in SGD: Self-tuning step sizes with unbounded gradients and affine variance.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective The power of adaptivity in SGD: Self-tuning step sizes with unbounded gradients and affine variance

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.556055Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.835119Z digest=sha256:aa0cf60c5858bac0dec9d65a642f25a29cbd86f69f826624beffea7752318dbf

Observation 6ea988f4-e523-4dcb-ab6c-2eef37107b2c · outbound

This paper cites Deep residual learning for image recognition.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Deep residual learning for image recognition

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.545996Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.838339Z digest=sha256:dbf335710c0efd8956612cc7b0f7680e464731cb6a12a9390c2e7a0c4df8892c

Observation d96d8d6a-9d75-4bb4-962d-b3334ba293a4 · outbound

This paper cites Neural networks for machine learning lecture 6a overview of mini-batch gradient descent.Cited on, 14(8):2, 2012.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Neural networks for machine learning lecture 6a overview of mini-batch gradient descent.Cited on, 14(8):2, 2012

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.536142Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.841500Z digest=sha256:d3cdd6f6d47e249c63e79af8e33346bbc15261da9bed2d470a0492c12da8766f

Observation 41b284f3-d020-4db4-bb2f-7fdd13288949 · outbound

This paper cites High Probability Convergence of Adam Under Unbounded Gradients and Affine Variance Noise.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective High Probability Convergence of Adam Under Unbounded Gradients and Affine Variance Noise

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.845097Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.845097Z digest=sha256:89b8f06fa6bd3b4684d713bc28683b0e71e8577dc13771462eb9c79a1a16f349

Observation 6a4893c6-141d-457a-bd52-17523901a20d · outbound

This paper cites On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.849410Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.849410Z digest=sha256:e22fb9bc1ad95e51ad28541796eab09fbaa9b5da06660f1a07a58d3dfbc00fd0

Observation 59423576-3cf6-4779-a3d6-1b4818115798 · outbound

This paper cites Parameter-agnostic optimization under relaxed smoothness.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Parameter-agnostic optimization under relaxed smoothness

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.853400Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.853400Z digest=sha256:a818180697d3dd2a371965bcc3cc8d42ddbb4ffaf688185e74e5ade5a00347f3

Observation 4398f761-50bc-4597-900c-36f816439481 · outbound

This paper cites Non-convex distributionally robust optimization: Non-asymptotic analysis.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Non-convex distributionally robust optimization: Non-asymptotic analysis

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.518589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.857286Z digest=sha256:3c4c9611a78bf0a3a013536f4133c1b208f8903eed1c3901c8e36e8c222ab859

Observation ce223768-7387-4808-95b4-27633856fca0 · outbound

This paper cites Linear convergence of gradient and proximal- gradient methods under the polyak-łojasiewicz condition.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Linear convergence of gradient and proximal- gradient methods under the polyak-łojasiewicz condition

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.507326Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.860905Z digest=sha256:402f63a431e2fdf2e720a83fb0f5cde7082097f9b0b6cf150b5e4d1fc347ee9c

Observation e83368b9-7540-46fa-acf7-1dc72d1cee52 · outbound

This paper cites Adam: A method for stochastic optimization.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Adam: A method for stochastic optimization

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.864941Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.864941Z digest=sha256:96a28b51d87348352fac35bc6d8dc4903fa30d1b45d2de1a5d53a4f877f103d2

Observation 5859ac37-9c0d-49ab-a7e2-6da17c984bb0 · outbound

This paper cites Segment Anything.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Segment Anything

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.868543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.868543Z digest=sha256:1df22ac85840b9f12f29c58dce581bd39041b0586afade15161a9d174a38850a

Observation aa74ad19-d0b2-4daa-9cd1-f9cf1252fe95 · outbound

This paper cites Imagenet classification with deep convolutional neural networks.Communications of the ACM, 60(6):84–90, 2017.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Imagenet classification with deep convolutional neural networks.Communications of the ACM, 60(6):84–90, 2017

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.872541Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.872541Z digest=sha256:e45c6f44cbac2f68ba58bf2c212e04dc0d6152028dd07738872694c8fbd80d34

Observation 0e6c8338-7d86-4ed5-b889-518367398210 · outbound

This paper cites Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.877360Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.877360Z digest=sha256:e28259fc08b4ae803edaabbad51fdbb7434ee3cd15f5933b0de6a2ec1f1d6c2f

Observation 695b4b05-6208-440c-9b30-0ffb1201aa38 · outbound

This paper cites Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.881398Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.881398Z digest=sha256:f52695f8ee165c11dcf3b13931987471571e6b3844f9b096ebfca258eb4331a2

Observation 98eeaa30-7d20-440d-a490-6ffef12a0cfc · outbound

This paper cites Convergence of Adam under relaxed assumptions.Advances in Neural Information Processing Systems, 36, 2023.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Convergence of Adam under relaxed assumptions.Advances in Neural Information Processing Systems, 36, 2023

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.457726Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.884902Z digest=sha256:ea0b91261c1686424eb2461e0be1a5807201d6a17b0e0a2e9094f194a6d4d7a5

Observation 78af7bd9-1972-4135-a700-1b1379f29afd · outbound

This paper cites An improved analysis of stochastic gradient descent with momentum.Advances in Neural Information Processing Systems, 33:18261–18271, 2020.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective An improved analysis of stochastic gradient descent with momentum.Advances in Neural Information Processing Systems, 33:18261–18271, 2020

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.427096Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.888921Z digest=sha256:ebd48d8a039be0fcd327fbac074cebef1c6d65ebadfde4d0b65b1275e548dfe5

Observation c666a50c-643a-4d26-8eb0-611140135ec0 · outbound

This paper cites A convnet for the 2020s.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective A convnet for the 2020s

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.892988Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.892988Z digest=sha256:6f69780650c7c2aa1dbee8fcf45965d061018eef5b18648b4dacf016d3065b85

Observation b2dafb9f-2064-482c-b675-e4896ba17cf1 · outbound

This paper cites Learning transferable visual models from natural language supervision.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Learning transferable visual models from natural language supervision

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.896430Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.896430Z digest=sha256:ccb803502a097be045eda5f58c102e9ff6fd25f68783eea7b372facb42ba90b6

Observation 5c97f269-0659-4efb-8d09-95bc73b6f490 · outbound

This paper cites On the convergence of Adam and beyond.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective On the convergence of Adam and beyond

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.391718Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.900082Z digest=sha256:3931319473974a743b02823a2f47c6d274dee7c31fb026101a509e170be9367b

Observation db976a6c-0f1f-4376-8762-6ef03e8dba9f · outbound

This paper cites A direct adaptive method for faster backpropagation learning: The rprop algorithm.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective A direct adaptive method for faster backpropagation learning: The rprop algorithm

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.378687Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.903376Z digest=sha256:1f7be089f55e0f888124856027e5b280f28ce715b8e6ae83d91a0381abdc9b5b

Observation 614c7d1e-603f-4da3-99db-ef483b1037b1 · outbound

This paper cites 1-bit stochastic gradient descent and its application to data-parallel distributed training of speech DNNs.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective 1-bit stochastic gradient descent and its application to data-parallel distributed training of speech DNNs

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.366565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.907310Z digest=sha256:b4caab1e3049cc650ec966c9cb69378495870bf2f9b286b52595915cebc56788

Observation 6f05deac-e38b-45e5-9550-8b886c97128f · outbound

This paper cites RMSProp converges with proper hyperparameter.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective RMSProp converges with proper hyperparameter

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.353974Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.910722Z digest=sha256:a76d31d9c41da0730d87c886287089d6045fbe8bb88cbfdf238d3d4953ec28a0

Observation 0bdee0cc-0e89-4cf3-b983-c3ef9374b9ab · outbound

This paper cites Scalable distributed DNN training using commodity GPU cloud computing.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Scalable distributed DNN training using commodity GPU cloud computing

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.341132Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.914223Z digest=sha256:718e4f98696b44316378c21a1bfd68c5a65c09963c08a3f2e8413e14f4dc68c9

Observation 5d694ec4-c544-4ced-a699-313f53c5b24a · outbound

This paper cites Momentum ensures convergence of signSGD under weaker assumptions.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Momentum ensures convergence of signSGD under weaker assumptions

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.328991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.917574Z digest=sha256:cfe0b63a48b4ed9fd57be36b29730eb00706ea786545d844cb6c25f81f7c778b

Observation ba6d9a05-1f48-4624-948d-73fb7e46fc11 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective LLaMA: Open and Efficient Foundation Language Models

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.920766Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.920766Z digest=sha256:56f8ffc122e78e348de68c632e609f2512d66c4825e984d18a2dd1129793e343

Observation 99f1e25a-dc36-4a05-93ce-c647c55d7089 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.924812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.924812Z digest=sha256:3f50712c289abfd87ab054489e3e3e7e3e7a73933a9e1269b767e7b23a275f3a

Observation ccbd7f88-9575-47e9-a65b-adb19b0da7d4 · outbound

This paper cites Attention is all you need.Advances in neural information processing systems, 30, 2017.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Attention is all you need.Advances in neural information processing systems, 30, 2017

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.928366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.928366Z digest=sha256:b9b4f7e9af8c32b51aa4c7a3c268ee909c50166426bbc7f94fc1cf9fa76af1f8

Observation 8f263129-d093-4f15-ad2a-a9d38abc9478 · outbound

This paper cites Convergence of AdaGrad for non-convex objectives: Simple proofs and relaxed assumptions.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Convergence of AdaGrad for non-convex objectives: Simple proofs and relaxed assumptions

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.303573Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.932986Z digest=sha256:829f1db2a776f9db68c43627cb914e5e6ea7cabd6096b8e8bcd4fbee37e74a3d

Observation 111bb916-7cb6-42ba-9e6a-69d9dd5519d7 · outbound

This paper cites Convergence of AdaGrad for non-convex objectives: Simple proofs and relaxed assumptions.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Convergence of AdaGrad for non-convex objectives: Simple proofs and relaxed assumptions

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.287400Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.937008Z digest=sha256:732fba869c209ac19419beeefd1b50f0c2ea76d0ef60033dfc3c4ca94026e246

Observation c5effdbe-3f6a-4a2d-9c96-7e692818b58a · outbound

This paper cites On the Convergence of Adam under Non-uniform Smoothness: Separability from SGDM and Beyond.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective On the Convergence of Adam under Non-uniform Smoothness: Separability from SGDM and Beyond

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.940732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.940732Z digest=sha256:8e1f3d1b64cc7a235b1bea3d748dae93b0a286351194e484bf16a0f901bbc7dc

Observation 0d6c6492-c62e-493a-a3cf-bed39aa2fb0f · outbound

This paper cites Provable adaptivity of Adam under non-uniform smoothness.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Provable adaptivity of Adam under non-uniform smoothness

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.272498Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.944746Z digest=sha256:4a7be1afb2a59987ce7876f83326986e349ad3a9cd4472d62571100961c7ddc4

Observation 4988bcb3-deb1-4289-acc9-0879ce3e95a6 · outbound

This paper cites Convnext v2: Co-designing and scaling convnets with masked autoencoders.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Convnext v2: Co-designing and scaling convnets with masked autoencoders

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.257319Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.948243Z digest=sha256:8f7e33413bd37059a6a2ed26db9d05c29ea1885c28fd8bb423e82b77102131b1

Observation 7c6d03a7-2de4-4203-a7a9-4740bcf55b6a · outbound

This paper cites Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-06T19:25:24.952647Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:25:24.952647Z digest=sha256:df84145b6183eca32547c815a316f46a8395bd0133b17d67a672736d94b8b6f8

Observation 656af517-df00-4701-a41e-20165d37edcf · outbound

This paper cites Improved analysis of clipping algorithms for non-convex optimization.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Improved analysis of clipping algorithms for non-convex optimization

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.241972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.957837Z digest=sha256:f8fcaf03aa8011e762ecb71420c3a204253e208a757d8b348bbdd5997c997ec6

Observation 016ddfac-a4f9-48b5-a061-a9d4439b32e2 · outbound

This paper cites Why gradient clipping accelerates training: A theoretical justification for adaptivity.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Why gradient clipping accelerates training: A theoretical justification for adaptivity

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.227076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.961251Z digest=sha256:ed6985e0314adc9471e63e1bdd4c2441eea641263f476e3a3ff8849d7d5f6b02

Observation d2556d20-38d5-4809-95ac-bed2b40ba918 · outbound

This paper cites Adam can converge without any modification on update rules.Advances in neural information processing systems, 35:28386–28399, 2022.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Adam can converge without any modification on update rules.Advances in neural information processing systems, 35:28386–28399, 2022

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.212572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.965965Z digest=sha256:f3c9559cfea31fd9719cabeb660f2afdc2ea298c33a3967fc2d3da4bf49976ce

Observation 9d9bc7e9-2622-4c46-8652-5032f800f01d · outbound

This paper cites Recently, [20] provably demonstrate the convergence rate of vanilla Adam in high probability perspective, but it only works with the stronger coordinate-wise affine variance.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective Recently, [20] provably demonstrate the convergence rate of vanilla Adam in high probability perspective, but it only works with the stronger coordinate-wise affine variance

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.196991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.970209Z digest=sha256:8f091b7c5fcde9bf494537dbbb782c5ce9824f3f6347df8f5849998fde6ed3e5

Observation 4c749ebe-f963-4b3d-bde8-d55404ebc44e · outbound

This paper cites [49] posits that it is also equivalent to an affine form of the gradient norm for the first-order differentiable function.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective [49] posits that it is also equivalent to an affine form of the gradient norm for the first-order differentiable function

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.183411Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.974489Z digest=sha256:8b07894647547b9afbc5dd2c211f19aa4ac8c790c4ded7e398bc71cca98700a7

Observation 8f602a4d-d4a5-4547-9308-c1a510dc039f · outbound

This paper cites [30] further extended the linear (L0, L1)-smooth to the generalized polynomial version, and proved that Adam will converged to O poly(lnT) T 1/4 with the weaker assumption.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective [30] further extended the linear (L0, L1)-smooth to the generalized polynomial version, and proved that Adam will converged to O poly(lnT) T 1/4 with the weaker assumption

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.170475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.978113Z digest=sha256:a43153eb76472da10fd339cece72a5cc9958ea83a95f49a93c4accea19b0c6e8

Observation ff9b11ab-3777-4ba9-b2ff-005f85315eb2 · outbound

This paper cites tX k=1 βt−k 1 (gk − ∇F(xk)) 2 # | {z } T2 + 1 T T−1X t=0 E.

Simple Convergence Proof of Adam From a Sign-like Descent Perspective tX k=1 βt−k 1 (gk − ∇F(xk)) 2 # | {z } T2 + 1 T T−1X t=0 E

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T19:25:25.155585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T19:25:24.982987Z digest=sha256:e815a722ea565d6c595faaeaaa4b8fd4ef38e7e61c9f8dc68d52774ba3cb4725

Pith citing papers

Observation 0ac89055-0f85-475c-a8c2-d8c0a1c99366 · inbound

When and Why SignSGD Outperforms SGD: A Theoretical Study Based on $\ell_1$-norm Lower Bounds cites this paper.

When and Why SignSGD Outperforms SGD: A Theoretical Study Based on $\ell_1$-norm Lower Bounds Simple Convergence Proof of Adam From a Sign-like Descent Perspective

Reference 25

Resolution
verified exact
arxiv_id, observed 2026-05-11T19:21:07.519300Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-08T12:14:28.866499Z digest=sha256:c15384594cca4fa4e9ba228009f85bf4b360ac6a4168fe5d48f0081a456b9f71

Observation 17e2f267-9e45-466b-a6e2-68fe92e9bd80 · inbound

Open Problem: Is AdamW Effective Under Heavy-Tailed Noise? cites this paper.

Open Problem: Is AdamW Effective Under Heavy-Tailed Noise? Simple Convergence Proof of Adam From a Sign-like Descent Perspective

Reference 6

Resolution
verified exact
arxiv_id, observed 2026-07-04T10:09:44.608129Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-06-26T09:08:41.993925Z digest=sha256:915e3b6eea1a856037b91c5179e4570d6bb01ce180922b550d5f8e36c95b93ca