Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-03T04:21:03.040227Z
Paper Citation Record · LEDGER
As of 9 August 2026, this Paper Citation Record lists 95 of 95 outbound references and 0 inbound Pith citation observations for arXiv:2602.05657.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-03T04:21:03.040227Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
95 of 95 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation c872434e-6588-4d31-b88b-f01ff1233cf8 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization OPT: Open Pre-trained Transformer Language Models
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation eba39e29-0a00-42b0-bb40-40177a1b3f12 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization A stochastic approximation method,
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1e9e8c6c-ad36-4de8-bc90-e10b953e03ce · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Unresolved cited work
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d8aa6507-dfbe-463f-b2e8-9f1145e80615 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Robust stochastic approximation approach to stochastic programming,
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0d778fd5-bff3-4e86-93e8-658bf12b2bc7 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Stochastic first-and zeroth-order methods for nonconvex stochastic programming,
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation af8dd58e-ae79-4af6-98c3-ed660300f127 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Lower bounds for non-convex stochastic optimization,
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 75a4c71e-e74a-4e34-8adc-ba3c30b265c2 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Imagenet classification with deep convo- lutional neural networks,
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0f81d109-a3d5-4b01-a215-ccb5ddac9b1d · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Deep residual learning for image recognition,
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 754309e0-1efd-49e1-8b92-cdbf9616877f · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization BERT: Pre-training of deep bidirec- tional transformers for language understanding,
Reference 9
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8335058d-9871-4fab-b229-aeb4df32a206 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Training Compute-Optimal Large Language Models,
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9a10a911-3a46-4e57-8ada-fcb23504c8d1 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Dembo and O
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0ef98f80-6695-44fc-b266-d2cd21e9f1b6 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization High probability conver- gence of stochastic gradient methods,
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bfad895f-644d-46b5-b70f-d022f7d7e89d · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization High-probability bounds for non-convex stochastic opti- mization with heavy tails,
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 396856df-3f56-4ff8-91ef-e2b9d2d81fa5 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Improved convergence in high probability of clipped gradient methods with heavy tailed noise,
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b4421911-7790-4621-ae77-5c436ef5e2e6 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Optimal High-probability Convergence of Nonlinear SGD under Heavy-tailed Noise via Symmetrization,
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 28a3e9b4-add9-4611-a215-a3d681a7611d · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Large Deviation Upper Bounds and Improved MSE Rates of Nonlinear SGD: Heavy-Tailed Noise and Power of Symme- try,
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ae534bf0-48f0-4482-ad79-fb7e3be927c6 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Armacki,High-Probability and Large Deviations Techniques for Design and Analysis of Large-Scale and Distributed Learning Systems
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2b5e3b03-86de-4bd4-b951-d5071b2f6857 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization An optimal method for stochastic composite optimization,
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cbb2ef33-6a8e-4c41-9189-47f27aa300a4 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Beyond the regret minimization barrier: optimal algorithms for stochastic strongly-convex optimization,
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5b6dea72-b49f-4779-bbcd-512ee5a3212c · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Tight analyses for non-smooth stochastic gradient descent,
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0232f455-3402-4b5c-8748-a7083cee9d57 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization A high probability analysis of adaptive sgd with momentum,
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2f5dafa8-adb9-4670-aebb-24821d3da842 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Revisiting the Last-Iterate Convergence of Stochastic Gradient Methods,
Reference 22
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6a8c36bd-cffa-4863-937d-ce2f054e0420 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Stochastic optimization with heavy-tailed noise via accelerated gradient clipping,
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5e6d2cc4-fa2e-4530-81dd-b9625ba37f25 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation aaea9517-0813-474e-8200-32c4b9d5038b · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization High Probability Bounds for Stochastic Subgradient Schemes with Heavy Tailed Noise
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 634188f8-fbfc-47e9-90ed-a4a9334a170d · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization High probability guarantees for nonconvex stochastic gradient descent with heavy tails,
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 36adae79-ec89-4feb-b054-c040ed1ac495 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization General Tail Bounds for Non-Smooth Stochastic Mirror Descent
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 616844c9-c9dd-49f8-9eaf-3ff091d2656c · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise,
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3e04a9bb-25be-45d4-b111-38b4538e959a · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization High-probability bounds for stochastic optimization and vari- ational inequalities: the case of unbounded variance,
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 45ff2a2c-57d7-46a9-a98f-d001fe3c846a · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Breaking the lower bound with (little) structure: Accel- eration in non-convex stochastic optimization with heavy-tailed noise,
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 826f19e8-bdac-4841-b932-701f19c683ba · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization From Gradient Clipping to Normalization for Heavy Tailed SGD,
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 366e9823-8238-435f-9bdf-87946c3be793 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d52f6695-2656-4cee-9c81-d66e8c586b86 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization High- probability Convergence Bounds for Online Nonlinear Stochastic Gradient Descent un- der Heavy-tailed Noise,
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4b075620-4284-4f70-8124-49c0aa81d5c5 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Large deviations,
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7e22a57e-6853-4812-b480-b6cf1a26c3a1 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Ellis,Entropy, Large Deviations, and Statistical Mechanics
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6ea68ae7-258a-407d-b34f-1fed0889ffe0 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization The large deviation approach to statistical mechanics,
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d469353e-4568-42a3-bcdf-6a7ef4958d55 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Distributed detection via gaussian running consensus: Large deviations asymptotic analysis,
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 15248d46-d021-4c33-88a7-12aa17ba5f61 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Large deviations performance of consensus+innovations distributed detection with non-gaussian observa- tions,
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e54ce035-6643-4024-88b1-40dc4e1df122 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Large deviations analysis of adaptive distributed detection,
Reference 39
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 446b228b-dda4-44d7-9a09-2ec05d1427b0 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Diffusion-Based Adaptive Distributed Detection: Steady-State Performance in the Slow Adaptation Regime,
Reference 40
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 644630ed-e54a-4cba-b9fe-ba31e0972566 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Distributed Detection Over Adaptive Networks: Refined Asymptotics and the Role of Connectivity,
Reference 41
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4b18d6d0-7442-4d5e-ab96-f36586e31efd · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Adaptive social learning,
Reference 42
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 12188cf2-ff5c-4c22-8374-bc17d0d2c14b · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Inaccuracy rates for distributed inference over random networks with ap- plications to social learning,
Reference 43
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1eb92454-0f2a-46a1-9682-467642e0e75b · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Matta, V
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 81591201-fcc0-43e9-8c3c-2a4934de207c · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Statistical hypothesis testing based on machine learning: Large deviations analysis,
Reference 45
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9ac2d24f-a1ea-492c-bd65-e4188814cea2 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Lindhe,Topics on Large Deviations in Artificial Intelligence
Reference 46
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0e43e719-8d1a-40b4-936b-cf31bfd0f556 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization On the diffusion approximation of nonconvex stochastic gradient descent,
Reference 47
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 32fd876d-f777-4a1a-b3c4-8301f177e774 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Large deviations rates for stochastic gradient descent with strongly convex functions,
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 59072f50-2d32-4382-879d-7fec25c7a976 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization A large deviations perspective on policy gradient algorithms,
Reference 49
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 669c76c3-55c5-4898-96a8-622aeb9e479d · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization What is the long-run distri- bution of stochastic gradient descent? A large deviations analysis,
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2aeff284-36a5-48d9-8fe1-4885d9e5280e · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization The global convergence of stochastic gradient descent in non-convex landscapes: Sharp estimates via large devia- tions,
Reference 51
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f832892f-dac9-48db-9d9e-d0b62cace5a7 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Accelerated gradient methods with biased gradient estimates: Risk sensitivity, high-probability guarantees, and large deviation bounds,
Reference 52
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6aa95349-002c-47c3-a367-4e4400e45fe3 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization On the difficulty of training recurrent neu- ral networks,
Reference 53
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5865e802-eb15-4bd7-918f-4706f5d0ed8f · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization A tail-index analysis of stochastic gra- dient noise in deep neural networks,
Reference 54
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ea833266-1915-40cc-a557-9461db7809ec · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Why are adaptive methods good for attention models?,
Reference 55
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 03903ade-3371-4236-8051-93dfd513b8c7 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization The heavy-tail phenomenon in sgd,
Reference 56
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b0f173b3-cfc5-4d24-8e15-64ba8caa654a · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Why gradient clipping accelerates train- ing: A theoretical justification for adaptivity,
Reference 57
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 018d3e45-4b3d-4dd3-81e0-629dcbd37b14 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Understanding Clipping for Feder- ated Learning: Convergence and Client-Level Differential Privacy,
Reference 58
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a7121bbf-1f65-420c-bf5d-2fae22585a15 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization LLaMA: Open and Efficient Foundation Language Models
Reference 59
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0a4cf264-7aaf-4613-946b-fcef40be745c · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization DeepSeek-V3 Technical Report
Reference 60
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 63498b5d-8330-4f12-b5a8-2df896b6fc70 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Safe model-based reinforce- ment learning with stability guarantees,
Reference 61
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2bc5ec51-3ac1-4344-9398-af8728b7664a · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization On the almost sure conver- gence of stochastic gradient descent in non-convex problems,
Reference 62
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 23d2fef0-b94f-4486-8eb1-83b2a31fb880 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Efficient and accu- rate estimation of lipschitz constants for deep neural networks,
Reference 63
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ba6b53f6-76ac-4659-b9dd-486ad4a498d5 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization On lipschitz bounds of general convolutional neural networks,
Reference 64
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 859e75d8-7d83-4a94-b89c-ba7efce3ef09 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Lipschitz certificates for layered network struc- tures driven by averaged activation operators,
Reference 65
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 18ff867b-23cb-4b88-9b86-bb34f70e61ec · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Rethinking lipschitz neural networks and certified robustness: A boolean function perspective,
Reference 66
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b5717a6b-4648-4446-bb88-39de01d93c28 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization The lipschitz constant of self-attention,
Reference 67
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 73f8bfa6-8d69-456f-9c59-76e33c8058fa · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Improved analysis of clipping algorithms for non-convex optimization,
Reference 68
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 53ed9878-2cb8-4fdc-a356-b34090ca04e7 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Convergence of adam under relaxed assump- tions,
Reference 69
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 920fc0c9-f540-4b1a-8e93-46a930d673e9 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization The price of adaptivity in stochastic convex optimization,
Reference 70
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ac0a8342-4da7-448b-b26f-a1e5e51be958 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Making gradient descent optimal for strongly convex stochastic optimization,
Reference 71
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e25fed18-5e65-4340-9a6e-01f5052d99b2 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Optimal stochastic approximation algorithms for strongly convex stochastic composite optimization i: A generic algorithmic framework,
Reference 72
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a7ace59c-251d-4553-b3b5-53cfd907849a · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization An improved analysis of stochastic gradient descent with momentum,
Reference 73
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 154c9865-b0da-4fd3-82d5-16fb14eb01c8 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Distributed Pareto Optimization via Diffusion Strategies,
Reference 74
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 28088e53-2da6-4132-a6ec-67df68f2799b · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Better theory for SGD in the nonconvex world,
Reference 75
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6514e671-4a30-4c76-9b61-4b13d836b5ac · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Non- linear gradient mappings and stochastic optimization: A general framework with appli- cations to heavy-tail noise,
Reference 76
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 336a1e9c-2b8d-4589-995b-99fb2b2dc7ea · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Nonconvex stochastic optimization under heavy-tailed noises: Op- timal convergence without gradient clipping,
Reference 77
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation be4f8a0d-2833-4aa7-a299-89f568f3a002 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Revisiting gradient normalization and clipping for non- convex sgd under heavy-tailed noise: Necessity, sufficiency, and acceleration,
Reference 78
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5ce41586-4c2c-46a6-9e9f-b6aa9ba657e9 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Gradient convergence in gradient methods with errors,
Reference 79
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 02987cf8-cfdf-414d-9ce2-0537b679c141 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization On the convergence of stochastic gradient descent with adaptive stepsizes,
Reference 80
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dfd0accc-195a-4e82-905c-6b27f460fb31 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Almost sure convergence rates for stochastic gradient descent and stochastic heavy ball,
Reference 81
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation be16adb1-361b-453f-983f-855bc7a34b81 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Convex and non-convex opti- mization under generalized smoothness,
Reference 82
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 03e86d2c-95ab-41ce-9ecc-b058c4d52291 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Does Standard Nonconvex SGD Really Diverge under Heavy-Tailed Noise?
Reference 83
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bfdd59c8-0fdd-4e39-a084-c98a16c38a82 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Can sgd handle heavy-tailed noise?,
Reference 84
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7739d66f-a3ee-4951-a026-6c73989e96b5 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization NIST Digital Library of Mathematical Functions
Reference 85
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 38daa0ef-967b-4523-a521-c5dd7bedd153 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Robust Estimation of a Location Parameter,
Reference 86
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ed1acffd-64da-454a-804a-21feaf619437 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Gradient Based Clustering,
Reference 87
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1e86b19a-43f2-4da9-bf00-c5b947a715de · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Unresolved cited work
Reference 88
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 299d0fd8-d28e-4f93-befd-ccd42c5fd242 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Unresolved cited work
Reference 89
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a29c322e-dd70-43c1-aed2-814181270649 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Proof.The first claim follows directly from Assumption 3 and Definition 1
Reference 90
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 62152ad7-b3ce-4707-b892-87cb97a0fef0 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Unresolved cited work
Reference 91
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation acd72c83-33fa-49c5-887c-47da6a04f7da · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Unresolved cited work
Reference 92
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0eda0391-13ef-41ec-a883-227aab40d4d4 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Proof.To prove the first part, note that from Assumption 2, the choice of clipping threshold in (42) and the definition ofB p, we have, for anyt≥B p ∥∇f(x t)∥ ≤G≤ γt 2
Reference 93
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9df927d3-6840-429a-b17d-62f14957b8cb · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Unresolved cited work
Reference 94
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 846f0cbe-969a-4814-a616-e2a1381f28e5 · outbound
Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization Proof.Recall that we showed the following inequality in Appendix F, for allk≥1 f(x k+1)≤f(x k)− αk 2 ∥∇f(x k)∥2 −α k⟨∇f(x k), θu k ⟩+ αk 2 ∥θb k∥2 + α2 kγ2 kL 2
Reference 95
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
No inbound Pith citation observations are available.