Pith. sign in

Paper Citation Record · LEDGER

The Effect of Mini-Batch Noise on the Implicit Bias of Adam

As of 2 August 2026, this Paper Citation Record lists 83 of 83 outbound references and 2 inbound Pith citation observations for arXiv:2602.01642.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2602.01642 v2

Coverage vector

measured 83 of 83 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-16T08:03:15.785558Z

measured 85 of 85 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-01T06:32:01.292127+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-31T02:16:07.806062Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-06-29T13:23:28.008798Z

Reference resolution

83 of 83 outbound references displayed

  • verified exact11
  • verified fuzzy69
  • unresolved1
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 259a5dbe-1e12-4cb3-985c-6e31e3399b34 · outbound

This paper cites A Modern Look at the Relationship between Sharpness and Generalization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam A Modern Look at the Relationship between Sharpness and Generalization

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.246637Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:cf4fdee60a5dea19eaa3595c7e3c07889a0e5dd567f6c64f5ccccfc1e4dfc0fe

Observation a533e2f3-9ffa-4cab-b4f4-049b60b6fd57 · outbound

This paper cites an unresolved cited work.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-05-16T08:07:35.238921Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c0985e3d4a4a0d5d92b202d099802ad404862d9cdf0c70b62eb6084183cfc1c6

Observation 832dfbf4-560c-4635-bfac-10550e5fb72f · outbound

This paper cites PaLM 2 Technical Report.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam PaLM 2 Technical Report

Reference 3

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.265810Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:254a42dda109ff933d5a836be291e4c1303c353ba27956742b76e293821fdc37

Observation fcc4ad15-7c84-43dd-8711-7f9c86f30fae · outbound

This paper cites Understanding Gradient Descent on the Edge of Stability in Deep Learning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Understanding Gradient Descent on the Edge of Stability in Deep Learning

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.236583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:870699a6442d6bf48c76b3b37c0dea238c6553237a8520ed2be0e7ca22bb1fed

Observation 3c4586db-93d4-4e53-8b83-8117d975a3b4 · outbound

This paper cites Implicit Gradient Regularization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Implicit Gradient Regularization

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.223668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:34fa97c37d50d17c8a6f5eb35b9653b4c3c1e849618e80d68c358ee97ce74dc2

Observation 95bf7d69-9f6e-4e84-8459-38618df4df00 · outbound

This paper cites On the Trajectories of SGD Without Replacement.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On the Trajectories of SGD Without Replacement

Reference 6

Resolution
verified exact
arxiv_id, observed 2026-05-16T08:07:34.276285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:4ea8cda49a436e6a03a1c3a0f26e699a4cb67cfa700af149e6951af304a89d39

Observation f31f9aa9-6dfd-4b89-a186-fece1de3b5d5 · outbound

This paper cites Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.211674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:3e69127f5ce55522261918dbb149f1bfcd468d490499b21fd67a2b9a0251eef9

Observation 69b6e555-57d5-46c8-a352-496faf4932bd · outbound

This paper cites Language Models are Few-Shot Learners.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Language Models are Few-Shot Learners

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.195085Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c4a00051ab55ebbc463b31e511b05de04e9269b54a4d5204c9d25d9169665bc3

Observation 4ca4f547-2f58-42fb-a328-998492640079 · outbound

This paper cites Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-05-16T08:07:34.259449Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:0e812fd159aff1549376eef2c2d4824c64062753fa435575ad37211d2941f445

Observation bf2f534f-af61-444e-8a55-98e4085e8553 · outbound

This paper cites On the Implicit Bias of Adam.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On the Implicit Bias of Adam

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.372671Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c15234f34bfe2f720213f12a19bf66e039379d5bcb92ab04dcceb3087dcd9c8e

Observation de1913af-4a88-4af9-9387-2cece511f947 · outbound

This paper cites How Memory in Optimization Algorithms Implicitly Modifies the Loss.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam How Memory in Optimization Algorithms Implicitly Modifies the Loss

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.370174Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:40626428987759218472d3e72d40e4a4c8ca46939c96f671513bd47f885d3aa2

Observation 288e2e44-c8f7-4195-a98d-49667f2f01fe · outbound

This paper cites Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.360484Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:dab8e78d6404dfad17e5601b8e124bd330dadd0d5173fd60e8f4a67007d63d50

Observation 39d63884-eab0-4a5c-a984-123f67e4453a · outbound

This paper cites Transformer-XL: Attentive Language Models beyond a Fixed-Length Context.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Transformer-XL: Attentive Language Models beyond a Fixed-Length Context

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.357917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c9f3ceafff6d3da9205c7e89d02dc08e0dec283aa071ff7d1b62c3c30adf2334

Observation a27417ed-ba7b-4007-b894-955050653dc5 · outbound

This paper cites Label Noise SGD Provably Prefers Flat Global Minimizers.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Label Noise SGD Provably Prefers Flat Global Minimizers

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.350708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:00f52e739270115b11b199cce0d65b9bc4b80e0509497ee2d210ff2e1017e7d4

Observation 19ef7a89-f00f-4b49-867c-c89b776e2aca · outbound

This paper cites Sharp Minima Can Generalize For Deep Nets.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Sharp Minima Can Generalize For Deep Nets

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.343325Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:cbdb70f9d28ece9de79982296fff6caeeb36b8e97d0ac81e752e156696e33a7a

Observation ec112a9b-32ee-4cd2-998e-05a859f10aef · outbound

This paper cites Sharpness-Aware Training for Free.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Sharpness-Aware Training for Free

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.337836Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:ba5737104d6a539b464f8e17548deb688950a2a22b2a6014048dc0df70d4e766

Observation bd88e28f-76a8-4314-b1b3-6176656ec2e8 · outbound

This paper cites The Llama 3 Herd of Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The Llama 3 Herd of Models

Reference 18

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.286211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:53a8cd40d6f81ee486fe00977ef00e6f57ff3fba21edbbf701203de8b9a4877c

Observation d34315e8-9353-4a4c-a54c-67bf0db3f645 · outbound

This paper cites Multiscale analysis of accelerated gradient methods.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Multiscale analysis of accelerated gradient methods

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.334871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c070f7219fe12d27c9677e99d51f6fcc94b9cfed0b224af4884556b883c1a061

Observation 087abeef-3820-45d6-bc1a-9c840dbca434 · outbound

This paper cites Sharpness-aware Minimization for Efficiently Improving Generalization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Sharpness-aware Minimization for Efficiently Improving Generalization

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.331872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:4f570c92b762b69d5f4cc1f12c0823bd8388ce613251fdda9e923a3af14976fd

Observation c085a2bc-86d8-4286-b237-a8ac2d64dc72 · outbound

This paper cites Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.329287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:e1f0b2cad56e91c62a9052cca2dd86c7934a3b3fe8a6376887ddcea6d29db87a

Observation f9c1d5f4-1f30-4b02-948e-7f0625c3448a · outbound

This paper cites Characterizing implicit bias in terms of optimization geometry.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Characterizing implicit bias in terms of optimization geometry

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.326617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:9ccc1cc38639af02b2daa52842a13fe1cc76f1617309f6f9da0f6fb9edd37c82

Observation 1c031d9d-7154-464f-af34-4fe6b2e02efd · outbound

This paper cites Implicit bias of gradient descent on linear convolutional networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Implicit bias of gradient descent on linear convolutional networks

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.323986Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a4223b665c05eb3ebd0687b695ead5293e9b02ae9a5091f733fe5c0082a8b2ad

Observation 110bb86e-2414-4948-926a-0b868e5a835d · outbound

This paper cites SIMPLIFYING NEURAL NETS BY DISCOVERING FLAT MINIMA.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam SIMPLIFYING NEURAL NETS BY DISCOVERING FLAT MINIMA

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.321510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:9b6e90417f1847d65eb563d7b0fd20119181b092f3e3f1185fc6c9b9a211a049

Observation aa510e92-fd0c-48ed-864f-a93649d437f8 · outbound

This paper cites Directional convergence and alignment in deep learning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Directional convergence and alignment in deep learning

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.319080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:35e1170f210a9ffa88dd1b845e7b290b50eacbc6512df2576c60971b4e10aefb

Observation 64d2a43b-906c-4817-870c-e6afb88a40a6 · outbound

This paper cites Gradient descent aligns the layers of deep linear networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Gradient descent aligns the layers of deep linear networks

Reference 26

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.293910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:7871923f36c64bb33f0d5b36314e4f65ecfb26360432c1877ad4dd1818d141ac

Observation 3cb1b50a-8ac2-4b01-85db-9d4476b1c361 · outbound

This paper cites Risk and parameter convergence of logistic regression.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Risk and parameter convergence of logistic regression

Reference 27

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.282618Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:1108263c0dabc60308d2db583f17cd32351fa7c3b6b2c97b23dd09ccdcf3c1f7

Observation bd2f80f0-418c-4f84-aebb-2f8e44bb7aff · outbound

This paper cites The implicit bias of gradient descent on nonseparable data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The implicit bias of gradient descent on nonseparable data

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.316364Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:3decb1417397a8e515897967ff211b8efc1ce7f7e2120e64346e52ea868d5b3e

Observation 00c36c5e-6ba2-42ad-9c45-9061e75029c0 · outbound

This paper cites Fantastic Generalization Measures and Where to Find Them.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Fantastic Generalization Measures and Where to Find Them

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.313439Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a404bd19c124d62fe7db48ed258955c8d92c516ba7ec4e7e124b01305de4c761

Observation 2eb6fef4-4445-43b1-8062-b4b18cd287a7 · outbound

This paper cites On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.310675Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:59b69537307075c3761e077522b89deb041b5352787275c3372b6a2011b2b714

Observation a28c1a92-965a-4bce-bfc5-dedd730955e5 · outbound

This paper cites 2025 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2025 (cit

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.308224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:b42127a7e859ed3bc3e89679f18ce6d75812d71e69f182c5f255636b56f9db5d

Observation a42f1662-81d6-45b4-b176-8bdf817b45b1 · outbound

This paper cites Fisher SAM: Information Geometry and Sharpness Aware Minimisation.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Fisher SAM: Information Geometry and Sharpness Aware Minimisation

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.305756Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:1c10605b2e21db3eb5eb502edcd86209776b6fd67020bebfda275ddc7a12aed7

Observation 1b43ae9a-abae-484a-88b8-cf3ead11ee8b · outbound

This paper cites Adam: A Method for Stochastic Optimization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Adam: A Method for Stochastic Optimization

Reference 33

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.279231Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:077562730bfe94216d93c722ec21961c0809263ef4390b39425d5fb7cebe6008

Observation 715b89a2-cfc2-47d9-bd59-bafa2c18017f · outbound

This paper cites Weight decay induces low-rank attention layers.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Weight decay induces low-rank attention layers

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.303297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:2bd47d691a74028b90f02c34a7ca1322fa904d947a29def584d6322092d51eb8

Observation db789b33-006f-4bad-8421-6c6a9c66e5f5 · outbound

This paper cites Continuous time analysis of momentum methods.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Continuous time analysis of momentum methods

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.300614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f28358d629caf05d2ad9c0efe5a917f834c868618e7ca3eec5c681e90ae51056

Observation a3ada450-cb68-4cb3-bece-a6118061d85c · outbound

This paper cites Noise Is Not the Main Factor Behind the Gap Between Sgd and Adam on Transformers, But Sign Descent Might Be.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Noise Is Not the Main Factor Behind the Gap Between Sgd and Adam on Transformers, But Sign Descent Might Be

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.298083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:44b4abc7267b4f7170e246cfd5549dda83825eb26e011b5e7daad995c22764b3

Observation ea22ca68-e6b1-4053-8d05-5eea4d9d923e · outbound

This paper cites ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.295370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a4a7d92c4664ecded0c33abe20ff027bd18b880c080ebd57ad5c9aa11b38e536

Observation 6c1ff5ba-136e-4b29-b2c8-f7cc7fe528f9 · outbound

This paper cites Enhancing Sharpness-Aware Optimization Through Variance Suppression.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Enhancing Sharpness-Aware Optimization Through Variance Suppression

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.292943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:ef4e0c77d9aae1489b36fd76b65f34889c9c1243eef7f24eb1fe0fb98e77771e

Observation d0daa434-08cd-4b2a-ad5d-0ee45d7ef51e · outbound

This paper cites Friendly Sharpness-Aware Minimization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Friendly Sharpness-Aware Minimization

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.290406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:5785907f29ac268ae53963db1c29125f457cb050e4f9a66bcb685c8d9dd070a4

Observation 59454159-8529-46cb-8817-77d8b02386d5 · outbound

This paper cites Towards Efficient and Scalable Sharpness-Aware Minimization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Towards Efficient and Scalable Sharpness-Aware Minimization

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.287829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a76b380f80d67e34ba9b8ebcc80512683dfffe50d9a134cfd94436ae44b80501

Observation 00ab6625-81c2-4505-9f08-0d67b92687b0 · outbound

This paper cites 2019 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2019 (cit

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.285414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:4e7de1783584151e13b61e9f6668f97a0598743b3e5c66686e6c8b98301c88cb

Observation 30f640a0-f9c6-4080-a86b-63a2450af2e9 · outbound

This paper cites Gradient Descent Maximizes the Margin of Homogeneous Neural Networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Gradient Descent Maximizes the Margin of Homogeneous Neural Networks

Reference 42

Resolution
metadata mismatch
arxiv_id, observed 2026-05-16T08:07:34.269457Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:e97053556d66e26099a52c88a4195d06fbe7ad7df0c2db8fc696fea197a9a4fe

Observation 7fcf2416-1207-4707-b696-328b9d7fd62f · outbound

This paper cites A Qualitative Study of the Dynamic Behavior for Adaptive Gradient Algorithms.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam A Qualitative Study of the Dynamic Behavior for Adaptive Gradient Algorithms

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.282595Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a0f3d89cd6429955c1b4103dfb3db1c8b82142a0baa6b5f7cdb0953971eac882

Observation 1d6211d6-3d05-4cbf-854a-65262e4f1ae0 · outbound

This paper cites On the SDEs and Scaling Rules for Adaptive Gradient Algorithms.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On the SDEs and Scaling Rules for Adaptive Gradient Algorithms

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.280027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:826a748379ef91d20be5065c5f11ed221ecc7a850a7e08453106f161ea7a9de6

Observation 16181f8a-d0b3-40fd-a89b-2b2e1658e3f2 · outbound

This paper cites Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation is Wasteful.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation is Wasteful

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.277495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:8d3870afdd2779e23539fa90cda29fd8350840e90e026cbfc60580e2922a4962

Observation 4c15face-ecea-433f-92c8-ed331fc393eb · outbound

This paper cites 2018 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2018 (cit

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.275114Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:17b87818a02873d6d9f6e356077813025b0a4504b14c6a453040e31b36b30594

Observation b6538872-dfe5-455a-a3f1-b838d7ceb38e · outbound

This paper cites Pointer Sentinel Mixture Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Pointer Sentinel Mixture Models

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.272662Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f7c3cbfca7c4a713ee1c2e376591fda106d3a12739f5a186767d8d9a4db5eb1a

Observation 3344bb9c-119b-4a88-ab21-d25ceda4bede · outbound

This paper cites Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.269969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:06b260b923851c5cf05d9ffb6a4b518b60b12e4936e80da4857cf8f3200f716b

Observation ff12b064-a3fd-4e14-8a2e-3c291ebc7791 · outbound

This paper cites Stochastic gradient descent on separable data: Exact convergence with a fixed learning rate.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Stochastic gradient descent on separable data: Exact convergence with a fixed learning rate

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.267229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:6bb58c39d5d4b2a4c9b06230f5b453b65b33c1857dc3ae0b05b324c8605ff9b9

Observation 08daf478-d343-4b1e-963b-c4846e5f10c4 · outbound

This paper cites Convergence of gradient descent on separable data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Convergence of gradient descent on separable data

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.264615Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:bf1e63aa5188e6ee4c0fa031ffdc7198e94ad37fd4f989601f1422dc43197f7e

Observation 31e4c776-914b-43ea-92ba-de5ef52fe999 · outbound

This paper cites Lexicographic and depth-sensitive margins in homogeneous and non- homogeneous deep models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Lexicographic and depth-sensitive margins in homogeneous and non- homogeneous deep models

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.262083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f5be8150e3087ac8c1272f26777c3025223e434e7edd0c9bb8c6be44adef61b1

Observation 1265a202-8da1-4b5a-b3d1-d617d7563e28 · outbound

This paper cites In Search of Adam’s Secret Sauce.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam In Search of Adam’s Secret Sauce

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.259557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:7f8865d032c6bb73f7ba7c3ccbd41015858a64e14b0f5c479c6e3dd6ebe82a46

Observation dc2f707d-decd-4e56-b804-40ad7df12a50 · outbound

This paper cites The AdEMAMix Optimizer: Better, Faster, Older.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The AdEMAMix Optimizer: Better, Faster, Older

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.257116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:79b5865b61e510813ee5add11dc292ffa5d50e00022ba9af5185386e7699269f

Observation 95d83c9e-79c5-4eb4-a17f-051e62e10bc5 · outbound

This paper cites Resolving Discrepancies in Compute-Optimal Scaling of Language Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Resolving Discrepancies in Compute-Optimal Scaling of Language Models

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.254473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:2fb46b2e43a2b36a4edf28e50754ab00a404562d38ea90abbb5631b3c8554832

Observation d23a6e93-12ce-4db5-9835-606e5c8c98a6 · outbound

This paper cites The implicit bias of adagrad on separable data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The implicit bias of adagrad on separable data

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.251686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:53e04ec779275d61671a2cf830ff11ad483cf488dfc0f36fd30a42dffd3a95e3

Observation d6866641-1196-4d4c-b211-007ffd229156 · outbound

This paper cites A Scale Invariant Measure of Flatness for Deep Network Minima.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam A Scale Invariant Measure of Flatness for Deep Network Minima

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.249163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:5aa469a2f5da65f33ad9b9e32ced354a3163cb2d64a6ddb4db02bf4183e66cb9

Observation 370762c3-036e-422d-88a2-e2d6b9713482 · outbound

This paper cites On a continuous time model of gradient descent dynamics and instability in deep learning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On a continuous time model of gradient descent dynamics and instability in deep learning

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.243902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:8582bc645f20b928f4f748c4f1e4a069aa61d9fe25ac7731581d21a218106564

Observation 2283e755-d5c8-4a02-afb9-0f45653a8253 · outbound

This paper cites Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.241409Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:00b82910836cca04738b43e141ee0d6f8357019a5f81acf2d08701d889240005

Observation 866a2720-3a32-4793-8622-43f1f6cabe4e · outbound

This paper cites Adafactor: Adaptive learning rates with sublinear memory cost.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Adafactor: Adaptive learning rates with sublinear memory cost

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.233969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:35b32e1c4feccb55b67859d81a63b671ff93df77aa5c8d9b36c089a449928444

Observation 28cc48b0-ced5-4761-826e-93bb6deadebe · outbound

This paper cites Optimizer benchmarking needs to account for hyperparameter tuning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Optimizer benchmarking needs to account for hyperparameter tuning

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.231583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a114100e7b56c50b452ff653bf510baee33e11ccd454e8af03a92c8de1a3996d

Observation 4323f4e0-8d94-4844-b184-6c64986940e6 · outbound

This paper cites On the Origin of Implicit Regularization in Stochastic Gradient Descent.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam On the Origin of Implicit Regularization in Stochastic Gradient Descent

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.229043Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:f440877939b4f910500567f01e177cb2b74c05fc1142c2df6d1a52a7476ac409

Observation 0d32c139-575e-4ece-aa04-f899352a79aa · outbound

This paper cites The implicit bias of gradient descent on separable data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The implicit bias of gradient descent on separable data

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.226510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:a0ab9993d344d6611b1376ce1147117aaaf40b883437be665f82527ae341ffa6

Observation f41618bd-64db-4be9-bd58-4943ba72f790 · outbound

This paper cites A Universal Class of Sharpness-Aware Minimization Algorithms.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam A Universal Class of Sharpness-Aware Minimization Algorithms

Reference 63

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.221042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:00dc117edaac00c6b3b602569bb5f5fed14dbcb63a1ec6189f9f33a6f2468ea7

Observation 1c8a7ef0-52e5-4acb-b28d-2902b7d5324e · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 64

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.290223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:e6223b0ef597f64917a9862c3ad205b65483571a7e882a4cb791634e64b7ed28

Observation c627a75c-f7ed-4660-ad95-7b45dfabd633 · outbound

This paper cites Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks Using PAC-Bayesian Analysis.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks Using PAC-Bayesian Analysis

Reference 65

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.217754Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:ad8a148eeb542227f2cdaa21d57326bef0ad0dbe7fb0c28f8c3d6becf63d87c8

Observation 9cd1ed24-92b3-4f1c-ad61-aa4b26c55916 · outbound

This paper cites Position: Will we run out of data? Limits of LLM scaling based on human- generated data.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Position: Will we run out of data? Limits of LLM scaling based on human- generated data

Reference 66

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.214783Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c9ccca6f79d7a711594f42130595d59ef6eb1a07fbdd88c028805d1c6faa37f1

Observation 2a8c0539-9519-40f1-a2ac-6fc754652b3b · outbound

This paper cites Does Momentum Change the Implicit Regularization on Separable Data?.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Does Momentum Change the Implicit Regularization on Separable Data?

Reference 67

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.207880Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:e7d17f9a34399322b43a71c11f6e7f4478c736ac9fa1279aa7f29d7fd8c9ed64

Observation b383f808-8fbb-44e3-9b5e-86223d8dbec8 · outbound

This paper cites The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks

Reference 68

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.204493Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:455751afd6ef74c49f9b083a94740ca47609d54ea5a20c4beb91b3816906c34f

Observation f55999e9-c070-4c34-8f2e-32f7bf92e848 · outbound

This paper cites 2025 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2025 (cit

Reference 69

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.201311Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:4a5ac38fb9ece47b941e47ce822474aedb6633130205d48e84e7701da2bb38b8

Observation d7a884fd-e6d6-4848-b02f-5d4a1f88db54 · outbound

This paper cites 2025 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2025 (cit

Reference 70

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.198347Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:17019a65d3e928d65f5433da613e85fc07f99ca084f82a17bcc0d1ec851588bc

Observation 486f2236-7a9c-42a3-93f3-9cc9313cce3e · outbound

This paper cites Implicit Bias of AdamW: ℓ∞-Norm Constrained Optimization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Implicit Bias of AdamW: ℓ∞-Norm Constrained Optimization

Reference 71

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.191922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:3e479034240595b1490c1496d31049dda0c250ba53ad8e66d5cd8456225e37fa

Observation 5370cd6f-6449-4d01-9cf8-0c99195ba459 · outbound

This paper cites SAMPa: Sharpness-aware Minimization Par- allelized.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam SAMPa: Sharpness-aware Minimization Par- allelized

Reference 72

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.186538Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:dac1e190a980b975f022cae123c62bd053c52fcc56940d8a1331c2b0fabe433d

Observation 7c12507c-d82f-43c5-b542-f53187a90551 · outbound

This paper cites Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momen- tum.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momen- tum

Reference 73

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.183436Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:08e68b6ec4bb5c2c79641547a5c572ba01f359b1f5af8d68a98dd537716d376a

Observation 53d57a2b-9fb2-41fb-a9f2-ef7688952b8a · outbound

This paper cites Positively Scale-Invariant Flatness of ReLU Neural Networks.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Positively Scale-Invariant Flatness of ReLU Neural Networks

Reference 74

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.262668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:975839ea805bbae9db115426fbc69c7fb7209d1c6a3a706740bc0aedc91ca87a

Observation 13fd7bd0-489e-42f6-bf18-0a0a0f143239 · outbound

This paper cites GLM-130B: An Open Bilingual Pre-trained Model.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam GLM-130B: An Open Bilingual Pre-trained Model

Reference 75

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.272853Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:85c0df426b5966bd0cdd8f86eebc63f942cd07a872e58ee6e50e0352b9439786

Observation 835943a9-8a66-423e-8a9c-e5a55b18f916 · outbound

This paper cites Three Mechanisms of Weight Decay Regularization.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Three Mechanisms of Weight Decay Regularization

Reference 76

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.367450Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:c73037999bc61150f7568a0d98fdb5e67f1ab070f9574577e290f2dba43024ed

Observation 1d703a4d-aeee-4919-ad8a-1a9a2335f775 · outbound

This paper cites How Does Critical Batch Size Scale in Pre-training?.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam How Does Critical Batch Size Scale in Pre-training?

Reference 77

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.365192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:0b953d96931c094ec06245c3de3b1c31e477a3c20212a7acd41bdc11ae570ac9

Observation 374e3019-0360-4aec-b731-eb62cdc928fb · outbound

This paper cites Why are adaptive methods good for attention models?.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Why are adaptive methods good for attention models?

Reference 78

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.362818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:1181a6937965859ea980aae543f0644e4e7fbaeff4e2528470e94da71c1cafa4

Observation 92cacf5d-5fa7-4c0b-bcbb-eb44854641df · outbound

This paper cites OPT: Open Pre-trained Transformer Language Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam OPT: Open Pre-trained Transformer Language Models

Reference 79

Resolution
verified exact
local_arxiv, observed 2026-05-16T08:07:34.297829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:8e0f854f9d62bc8876287a627633071e270881cfc1fa0bb450009b27be34ff96

Observation 02cdc0a7-8700-4eba-874c-b44e850afa6e · outbound

This paper cites Deconstructing What Makes a Good Optimizer for Autoregressive Language Models.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Deconstructing What Makes a Good Optimizer for Autoregressive Language Models

Reference 80

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.355502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:df68c49278e20e90e4efddd8b7108baddafaf06f4c90cf605ea4d66f3d20d874

Observation dca82baa-9aa5-46e5-a26d-3b9122a34c47 · outbound

This paper cites Regularizing Neural Networks via Adversarial Model Perturbation.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Regularizing Neural Networks via Adversarial Model Perturbation

Reference 81

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.352864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:6745bd9b2a8a3411bce0b01062dd86ed3dae62480668445fa2ec99b06a51e769

Observation f832ec5b-055c-4287-9e70-71d7f26a5238 · outbound

This paper cites Towards Theoretically Understanding Why Sgd Generalizes Better Than Adam in Deep Learning.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Towards Theoretically Understanding Why Sgd Generalizes Better Than Adam in Deep Learning

Reference 82

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.348475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:3dad7410f6c1c0e0f396bb64a6360411cd90fa012c33d2e3ad7ee6684bbda95a

Observation 79d711d9-4c6d-43da-a334-9b4f314fe7c6 · outbound

This paper cites Towards Understanding Convergence and Generalization of AdamW.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam Towards Understanding Convergence and Generalization of AdamW

Reference 83

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T08:07:35.345758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:17a92431762caf2119f3a6d93aa0405e4b54565673d8cbc776a7ea77e1a52681

Observation f78646ce-893c-4d09-b6ab-bc1624672ba8 · outbound

This paper cites 2022 (cit.

The Effect of Mini-Batch Noise on the Implicit Bias of Adam 2022 (cit

Reference 84

Resolution
malformed identifier
raw_fallback, observed 2026-05-16T08:07:35.340303Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-05-16T08:03:15.785558Z digest=sha256:5dae7a6cebd797d706e9815c8958797ba6c66402177193e1b26d393b92bb486b

Pith citing papers

Observation bf67973f-8e78-4004-a4de-ec8ec8bd0a2c · inbound

Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias cites this paper.

Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias The Effect of Mini-Batch Noise on the Implicit Bias of Adam

Reference 110

Resolution
verified exact
local_arxiv, observed 2026-06-29T13:23:28.010453Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-01T06:32:01.292127+00:00.

source=pdf_text observed=2026-06-29T13:20:54.303605Z digest=sha256:05e63de0341cc50bb4826358201c9889a7cfdf969d2db05cf80c5a9d75a44c53

Observation ef575262-d288-4069-b27f-0b5ed773a300 · inbound

Chimera: Designing and Chinchilla-Scaling Hybrid Visual Diffusion Transformers cites this paper.

Chimera: Designing and Chinchilla-Scaling Hybrid Visual Diffusion Transformers The Effect of Mini-Batch Noise on the Implicit Bias of Adam

Reference 9

Resolution
unresolved
no resolver link, observed 2026-07-31T02:16:07.806062Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-31T02:16:07.806062Z digest=sha256:5ace55c6b07fb2025aacf6e9bdf33d85952f49e8b06f3d605a759206ca40d51e