Pith. sign in

REVIEW 2 major objections 5 minor 300 references

Benign Overfitting Does Not Occur in Diffusion Models

T0 review · 2 major / 5 minor · reviewed 2026-07-12 · grok-4.5

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Diffusion models cannot overfit training data and still generalize unless the sample size grows exponentially with dimension.

desk verdict Clean architecture-independent impossibility of simultaneous small train/test score-matching losses, plus exact linear asymptotics that isolate why score matching lacks the alignment that makes regression benignly overfit. read the letter →

arxiv 2607.02671 v1 pith:HOIBCMWX submitted 2026-07-02 stat.ML cs.LG

Tyler Farghly , Benjamin Dupuis , Alain Durmus , Umut Simsekli This is my paper
classification stat.MLcs.LG MSC 68T0762G0560H10
keywords diffusionmodelsbenignoverfittingdoubledescentscorematchingimplicitregularizationrandomfeaturegeneralization
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Diffusion models reuse the same neural nets and regression-style losses that, in ordinary deep learning, famously allow perfect training fit to coexist with good test performance (benign overfitting and double descent). This paper shows that score matching does not work that way. Unless the number of samples grows exponentially with the intrinsic dimension of the data, the empirical and population score-matching losses cannot both be small. As a result the test risk forms a classical U-shaped curve in model size rather than a second descent. The authors isolate the mechanical reason: ordinary regression can exploit an alignment between the target and the empirical covariance that cancels residual error in the null space of the data; the score target has no such alignment, so the same residual explodes as noise vanishes. Time-smoothness of a single network trained across noise levels and early stopping act as built-in regularizers that keep models away from this harmful regime, which the authors confirm on high-dimensional image models. The upshot is that the generalization story for diffusion is governed by different mechanisms than classical regression and needs its own theory.

What carries the argument

A Fisher-information / total-variation lower bound (Lemma 3.1 and Theorem 3.1) that forces the empirical and population measures at small noise to be close, together with an exact asymptotic comparison of linear random-feature score matching versus multi-output regression that isolates the missing alignment.

What would settle it

Train a single score network on a data distribution of known positive intrinsic dimension d' with sample size well below the exponential threshold of Theorem 3.1, drive the empirical score-matching loss to near zero, and check whether the population ESM loss (or reverse-process KL) remains bounded away from zero as claimed; a simultaneous drop of both losses would refute the impossibility result.

Watch

Extended reading notes

Core claim

Unless the sample size grows exponentially with the data's lower Rényi dimension, the population and empirical score-matching losses cannot be simultaneously small; consequently the population loss follows a classical U-shaped curve in model complexity rather than double descent. The structural reason is that score matching admits no target-covariance alignment of the kind that makes residual error small in ordinary regression.

Load-bearing premise

The quantitative exponential sample-size lower bound needs the time-weighting density to be non-decreasing on an interval and both horizon and ambient dimension to be large enough; the rate also collapses if the data measure has zero lower Rényi dimension.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. The paper argues that benign overfitting and double descent, which are central to modern deep-learning theory, do not occur for diffusion models under practical sample sizes. Architecture-independent impossibility results (Lemma 3.1, Theorem 3.1) show that the empirical and population explicit score-matching losses cannot be simultaneously small unless n grows exponentially with the lower Rényi dimension of the data; consequently the population risk is U-shaped in model complexity. A linear random-feature analysis (Proposition 4.1) makes the mechanism precise by contrasting score matching with ordinary regression: the latter benefits from alignment of the target with the empirical covariance, while the former does not. Time-smoothness of the score and early stopping are identified as implicit regularizers that keep the population loss controlled (Propositions 5.1–5.2). High-dimensional U-Net experiments on a CIFAR-10 subset corroborate the U-shaped curves and the regularizing effect of time range and early stopping.

Significance. If correct, the result cleanly separates the generalization theory of score-based generative models from the benign-overfitting paradigm that has dominated supervised deep learning. The architecture-free lower bound of Theorem 3.1 is especially valuable: it rests only on Girsanov, Pinsker and Rényi dimension, applies to any score network, and already covers the ELBO and variance weightings used in practice. The linear-RFNN asymptotics supply an explicit, Marchenko–Pastur-based explanation of why the null-space contribution explodes as t→0, and the identification of time-smoothness and early stopping as built-in regularizers is both theoretically clean and experimentally supported. Together these contributions motivate a distinct theoretical program for diffusion models and give practitioners concrete guidance on when memorization becomes inevitable.

major comments (2)
  1. [Section 3.2, Theorem 3.1] Theorem 3.1 and Remark 3.1: the exponential lower bound is stated for weightings whose density is non-decreasing on [ϵ,T]. While ELBO and variance weightings satisfy this, many practical schedules (e.g., cosine or truncated-SNR) do not. A short extension or counter-example for non-monotone ϖ would clarify the scope of the impossibility claim.
  2. [Section 4, Proposition 4.1] Proposition 4.1 and the surrounding comparison with regression: the argument that score matching admits “no alignment” relies on the isotropic Gaussian assumption (Assumption 4.1) and on the exact ERM solution AW=−Σ̂t−1. For non-Gaussian or low-rank data the residual on ker(Σ̂) need not explode as σt−2; a brief remark on the robustness of this mechanism would strengthen the claim that the phenomenon is generic rather than Gaussian-specific.
minor comments (5)
  1. [Figure 1, Appendix C.1] Figure 1 caption and Appendix C.1: the random-feature diffusion experiment uses a Monte-Carlo approximation of the DSM expectation (Ng=10). A one-sentence statement of the resulting bias would help readers assess the plotted train/test curves.
  2. [Appendix A.1] Definition A.1 and Remark A.2: the lower Rényi dimension is introduced without a pointer to the more common Hausdorff or Minkowski dimensions used in the manifold-hypothesis literature; a short cross-reference would improve accessibility.
  3. [Proposition 4.1] Equation (7) and the O(1/ψd) remainder: the asymptotic is stated for ψd,ψp>1; the transition regime ψp≈ψd is left implicit. A sentence noting continuity of the limiting expressions would remove a minor ambiguity.
  4. [Figure 2] Figure 2 (right panel): the nearest-train-image comparison is shown only for NF=8. Displaying the same panel for a larger NF (e.g., 64) would make the memorization claim visually complete.
  5. [Title page and Appendix A] Typographical: “Umut S ¸ims ¸ekli” and several occurrences of “R ´enyi” retain LaTeX spacing artifacts; these should be cleaned for the camera-ready version.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: impossibility bounds and linear asymptotics are derived from first principles without self-definitional or fitted-input reductions.

full rationale

The central claims rest on Lemma 3.1 / Theorem 3.1 (architecture-independent lower bounds via relative Fisher information, Girsanov, Pinsker and the lower Rényi dimension) and on Proposition 4.1 / 5.1 / 5.2 (exact Marchenko–Pastur asymptotics of an explicitly solvable linear ERM problem). None of these steps defines a quantity in terms of the target phenomenon and then re-labels it as a prediction; no free parameter is fitted to data and then used to “predict” a closely related observable; and the few self-citations (Farghly et al. 2026a,b; Dupuis et al. 2025) appear only as contextual motivation or complementary generalization bounds, never as load-bearing uniqueness theorems that force the present conclusions. The modeling idealizations (Gaussian data, linear features, non-decreasing density of ϖ) are stated explicitly and the resulting U-shaped excess-risk curves follow by direct calculation, not by construction. Consequently the derivation chain is self-contained and non-circular.

Assumptions & free parameters 2 free parameters · 4 assumptions · 0 invented entities

The central impossibility claim rests on standard concentration and information-theoretic inequalities plus the definition of lower Rényi dimension; the fine-grained linear analysis rests on the Marchenko-Pastur theorem and Gaussian data. No free parameters are fitted to produce the qualitative U-shape; experimental hyper-parameters affect only the illustrative figures.

free parameters (2)
  • ridge λ in random-feature experiments
    Set by hand to 10^{-4} for numerical stability; does not enter the theoretical claims.
  • time-horizon T and early-stop ϵ
    Chosen large/small enough for the asymptotic statements; concrete numerical values appear only in experiments.
assumptions (4)
  • standard math Marchenko-Pastur theorem for empirical covariance spectra under i.i.d. entries with 4+ε moments
    Invoked in the proofs of Propositions 4.1 and 5.1 to obtain almost-sure limits of the ESM and DSM losses.
  • standard math Girsanov theorem relating path-space KL to integrated score error
    Used to convert small ESM losses into small KL(p_δ || q_{T-δ}) in the proof of Theorem 3.1.
  • domain assumption Data distribution ν has finite second moments and positive lower Rényi dimension d'
    Required for the quantitative sample-size lower bound of Theorem 3.1; holds for compact manifolds and many practical image distributions.
  • ad hoc to paper Score network is a two-layer linear random-feature model with Gaussian weights (Assumption 4.1)
    Simplifying modeling choice that enables exact asymptotics; the impossibility results of Section 3 do not rely on it.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Benign Overfitting Does Not Occur in Diffusion Models." pith.science (2026). https://pith.science/paper/HOIBCMWX

@misc{pith2026260702671,
  author       = {Pith},
  title        = {Pith review of: Benign Overfitting Does Not Occur in Diffusion Models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/HOIBCMWX}},
  note         = {Machine review of arXiv:2607.02671}
}
read the original abstract

Benign overfitting and double descent have come to shape our understanding of generalization in deep learning, establishing that overfitting is not only compatible with good generalization but can actively benefit it. Diffusion models share much of the machinery of standard deep learning, so it is natural to assume that they also exhibit these properties. In this work, we show that this assumption is largely incorrect. We first establish fundamental impossibility results showing that, unless the sample size grows exponentially with the data dimension, overfitting and good generalization cannot occur simultaneously. Consequently, the population loss follows a classical U-shaped curve in model complexity rather than exhibiting double descent. Analyzing a simplified setting, we identify a key difference between regression and score matching: regression benefits from an alignment between the target and the empirical covariance; score matching admits no such alignment, leaving overfitting irreparably harmful. We further identify implicit regularization stemming from time-smoothness of the score and early stopping during training as mechanisms that prevent such overfitting and verify our findings with high-dimensional image generation experiments. Our results reveal that generalization in diffusion models is governed by mechanisms distinct from those of traditional regression, motivating the development of new theory.

Figures

Figures reproduced from arXiv: 2607.02671 by the authors.

Figure 1
Figure 1. (Left) 2-layer random feature network regression, displaying the classical double descent curve. (Right) 2-layer random feature network diffusion, showing the absence of benign overfitting. Details on the setup and hyperparameters for these experiments are available in Section C.1. known as benign overfitting (Bartlett et al., 2020). This is explained by theoretical analysis showing that generalization is maintained… view at source ↗
Figure 2
Figure 2. We train a DDPM U-Net model on a subset of CIFAR10 to convergence. We observe train and test error for different configurations of the model, varying the number of features (NF) in the U-Net. (Left) Test and train error at convergence varying NF and thus, varying the number of parameters in the model. (Center) The same setting but for the population negative log-likelihood. (Right) Generated samples for different NF… view at source ↗
Figure 3
Figure 3. Linear random features under Assumption 4.1. (Left) time is fixed at t = 10−1 and ψp varies. (Center) ψd is fixed at 102 and t varies. (Right) time integrated losses (as in Section 5.1) with π the uniform distribution on [0, T]. Train error denotes the empirical DSM loss with the weighting used in training in practice. Test error is the population ESM loss with ELBO weighting. Theorem 3.1. Suppose that ϖ is a positi… view at source ↗
Figures from the paper (1 more)
Figure 5
Figure 5. Figure 5: The same setting as [PITH_FULL_IMAGE:figures/full_fig_p009_5.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

300 extracted references · 68 linked inside Pith

  1. [1]

    Random Features for Large-Scale Kernel Machines , volume =

    Rahimi, Ali and Recht, Benjamin , booktitle =. Random Features for Large-Scale Kernel Machines , volume =

  2. [2]

    The Eleventh International Conference on Learning Representations , year=

    Statistical Efficiency of Score Matching: The View from Isoperimetry , author=. The Eleventh International Conference on Learning Representations , year=

  3. [3]

    The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=

    Diffusion Models and the Manifold Hypothesis: Log-Domain Smoothing is Geometry Adaptive , author=. The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=

  4. [4]

    EurIPS 2025 Workshop on Principles of Generative Modeling (PriGM) , year=

    Generalization Dynamics of Linear Diffusion Models , author=. EurIPS 2025 Workshop on Principles of Generative Modeling (PriGM) , year=

    2025

  5. [5]

    Marchenko, V. A. and Pastur, L. A. , year=. Distribution of Eigenvalues for some Sets of Random Matrices , volume=. Mathematics of the USSR-Sbornik , publisher=

  6. [6]

    2023 , eprint=

    Six Lectures on Linearized Neural Networks , author=. 2023 , eprint=

    2023

  7. [7]

    ICLR 2026 Workshop on Geometry-grounded Representation Learning and Generative Modeling , year=

    Manifold Generalization Provably Proceeds Memorization in Diffusion Models , author=. ICLR 2026 Workshop on Geometry-grounded Representation Learning and Generative Modeling , year=

    2026

  8. [8]

    Comment on: ``

    Otto, Felix and Villani, C. Comment on: ``. 2001 , journal =

    2001

Show all 300 references
  1. [9]

    Procaccia and P

    I. Procaccia and P. Grassberger and H. G. E. Hentschel , title =. Dynamical Systems and Chaos , year =

  2. [10]

    1993 , month = may, journal =

    On Rigorous Mathematical Definitions of Correlation Dimension and Generalized Spectrum for Dimensions , author =. 1993 , month = may, journal =. doi:10.1007/BF01058436 , urldate =

    1993 doi

  3. [11]

    The Fourteenth International Conference on Learning Representations , year=

    Provable Separations between Memorization and Generalization in Diffusion Models , author=. The Fourteenth International Conference on Learning Representations , year=

  4. [12]

    Denoising

    George, Anand Jerry and Veiga, Rodrigo and Macris, Nicolas , year =. Denoising

  5. [13]

    Reversible

    Aldous, David and Allen Fill, James , year =. Reversible

  6. [14]

    Explicit Error Bounds for

    Rudolf, Daniel , year =. Explicit Error Bounds for. Dissertationes Mathematicae , volume =. 1108.3201 , primaryclass =

    arXiv

  7. [15]

    Nakkiran, Preetum and Kaplun, Gal and Bansal, Yamini and Yang, Tristan and Barak, Boaz and Sutskever, Ilya , year =. Deep. ICLR 2020 , eprint =

    2020

  8. [16]

    Fractional

    Tristani, Isabelle , year =. Fractional. Commun. Math. Sci. 13 , eprint =

  9. [17]

    Proceedings of the Thirty-Second Conference on Learning Theory , pages =

    Normal Approximation for Stochastic Gradient Descent via Non-Asymptotic Rates of Martingale CLT , author=. Proceedings of the Thirty-Second Conference on Learning Theory , pages =. 2019 , volume =

    2019

  10. [18]

    The Cifar-10 Dataset , author =

  11. [19]

    2009 , url=

    Learning Multiple Layers of Features from Tiny Images , author=. 2009 , url=

    2009

  12. [20]

    , year =

    Hodgkinson, Liam and Mahoney, Michael W. , year =. Multiplicative Noise and Heavy Tails in Stochastic Optimization , booktitle =. 2006.06293 , primaryclass =

    2006 arXiv

  13. [21]

    Journal of Machine Learning Research , volume=

    Topology of deep neural networks , author=. Journal of Machine Learning Research , volume=

  14. [22]

    Very Deep Convolutional Networks for Large-Scale Image Recognition , booktitle =

    Karen Simonyan and Andrew Zisserman , editor =. Very Deep Convolutional Networks for Large-Scale Image Recognition , booktitle =

  15. [23]

    He, Kaiming and Zhang, Xiangyu and Ren, Shaoqing and Sun, Jian , booktitle =

  16. [24]

    North American Chapter of the Association for Computational Linguistics , year=

    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , author=. North American Chapter of the Association for Computational Linguistics , year=

  17. [25]

    Language

    Brown, Tom and Mann, Benjamin and Ryder, Nick and Subbiah, Melanie and Kaplan, Jared D and Dhariwal, Prafulla and Neelakantan, Arvind and Shyam, Pranav and Sastry, Girish and Askell, Amanda and Agarwal, Sandhini and. Language. Advances in. 2020 , volume =

    2020

  18. [26]

    and Monro, S

    Robbins, H. and Monro, S. , journal =

  19. [27]

    Bottou, L. The. Advances in. 2007 , volume =

    2007

  20. [28]

    , year =

    Krizhevsky, Alex and Sutskever, Ilya and Hinton, Geoffrey E. , year =. Communications of the ACM , volume =

  21. [29]

    Foundations of

    Kallenberg, Olav , year =. Foundations of. doi:10.1007/978-3-030-61871-1 , urldate =

    doi

  22. [30]

    2023 IEEE 6th International Conference on Pattern Recognition and Artificial Intelligence (PRAI) , pages=

    Deep neural networks architectures from the perspective of manifold learning , author=. 2023 IEEE 6th International Conference on Pattern Recognition and Artificial Intelligence (PRAI) , pages=. 2023 , organization=

    2023

  23. [31]

    arXiv preprint arXiv:2204.08624 , year=

    Topology and geometry of data manifold in deep learning , author=. arXiv preprint arXiv:2204.08624 , year=

    arXiv

  24. [32]

    Understanding Machine Learning: From Theory to Algorithms , publisher=

    Shalev-Shwartz, Shai and Ben-David, Shai , year=. Understanding Machine Learning: From Theory to Algorithms , publisher=

  25. [33]

    Understanding Machine Learning: From Theory to Algorithms , publisher=

    Bach, Francis , series =. Understanding Machine Learning: From Theory to Algorithms , publisher=

  26. [34]

    Theory of Probability and its Applications , year =

    Vladimir Vapnik and Alexey Chervonenkis , title =. Theory of Probability and its Applications , year =

  27. [35]

    Doklady Akademii Nauk USSR , year =

    Vladimir Vapnik and Alexey Chervonenkis , title =. Doklady Akademii Nauk USSR , year =

  28. [36]

    Differentially

    Kuru, Nurdan and Birbil,. Differentially. 2022 , month = jun, journal =. 2008.01989 , primaryclass =

    2022 arXiv

  29. [37]

    and Blei, David M

    Mandt, Stephan and Hoffman, Matthew D. and Blei, David M. , year =. A. International

  30. [38]

    2023 , eprint=

    Equivalences of Geometric Ergodicity of Markov Chains , author=. 2023 , eprint=

    2023

  31. [39]

    Pertti Mattila , title =

  32. [40]

    John Mackay and Jeremy Tyson , title =

  33. [41]

    Estimating

    Herrera, Calypso and Krach, Florian and Teichmann, Josef , year =. Estimating. Estimating Full Lipschitz Constants of Deep Neural Networks , eprint =

  34. [42]

    2018 , month = jan, journal =

    Stochastic Gradient Descent Performs Variational Inference, Converges to Limit Cycles for Deep Networks , author =. 2018 , month = jan, journal =. 1710.11029 , primaryclass =

    2018 arXiv

  35. [43]

    , year =

    Chaudhuri, Kamalika and Monteleoni, Claire and Sarwate, Anand D. , year =. Differentially. Journal of Machine Learning Research , volume =. 0912.0071 , primaryclass =

    arXiv

  36. [44]

    Annals of Mathematics and Artificial Intelligence , volume=

    Topological measurement of deep neural networks using persistent homology , author=. Annals of Mathematics and Artificial Intelligence , volume=. 2022 , publisher=

    2022

  37. [45]

    and Tweedie, Richard L

    Meyn, Sean P. and Tweedie, Richard L. , year =. Markov

  38. [46]

    and Braun, H

    Riedmiller, M. and Braun, H. , booktitle=. A direct adaptive method for faster backpropagation learning: the RPROP algorithm , year=

  39. [47]

    Fashion-

    Xiao, Han and Rasul, Kashif and Vollgraf, Roland , year =. Fashion-. 1708.07747 , primaryclass =

    arXiv

  40. [48]

    High-dimensional limit theorems for SGD: Effective dynamics and critical scaling , booktitle=

    Gerard Ben Arous and Reza Gheissari and Aukosh Jagannath , year=. High-dimensional limit theorems for SGD: Effective dynamics and critical scaling , booktitle=. 2206.04030 , archivePrefix=

    arXiv

  41. [49]

    Evolution of the

    Alfonsi, Aur. Evolution of the. 2016 , month = dec, number =. doi:10.48550/arXiv.1606.02994 , urldate =. 1606.02994 , primaryclass =

    2016 doi arXiv

  42. [50]

    and Orbanz, Peter , year =

    Zhou, Wenda and Veitch, Victor and Austern, Morgane and Adams, Ryan P. and Orbanz, Peter , year =. Non-Vacuous. International

  43. [51]

    2024 , keywords =

    Alquier, Pierre , journal=. 2024 , keywords =

    2024

  44. [52]

    Thinking Outside the Ball: Optimal Learning with Gradient Descent for Generalized Linear Stochastic Convex Optimization , volume =

    Amir, Idan and Livni, Roi and Srebro, Nati , booktitle =. Thinking Outside the Ball: Optimal Learning with Gradient Descent for Generalized Linear Stochastic Convex Optimization , volume =

  45. [53]

    Advances in Neural Information Processing Systems (NeurIPS) , year =

    Ron Amit and Baruch Epstein and Shay Moran and Ron Meir , title =. Advances in Neural Information Processing Systems (NeurIPS) , year =

  46. [54]

    Topological

    Andreeva, Rayna and Dupuis, Benjamin and Sarkar, Rik and Birdal, Tolga and Simsekli, Umut , year =. Topological. 38th. 2407.08723 , primaryclass =

    arXiv

  47. [55]

    ICML 2023 Workshop on Topological, Algebraic and Geometric Learning , year =

    Rayna Andreeva and Katharina Limbeck and Bastian Rieck and Rik Sarkar , title =. ICML 2023 Workshop on Topological, Algebraic and Geometric Learning , year =

    2023

  48. [56]

    Metric Space Magnitude for Evaluating the Diversity of Latent Representations , volume =

    Limbeck, Katharina and Andreeva, Rayna and Sarkar, Rik and Rieck, Bastian , booktitle =. Metric Space Magnitude for Evaluating the Diversity of Latent Representations , volume =. doi:10.52202/079017-3937 , editor =

    doi

  49. [57]

    Deep Learning in Optical Metrology: A Review , shorttitle =

    Zuo, Chao and Qian, Jiaming and Feng, Shijie and Yin, Wei and Li, Yixuan and Fan, Pengfei and Han, Jing and Qian, Kemao and Chen, Qian , year =. Deep Learning in Optical Metrology: A Review , shorttitle =. Light: Science & Applications , volume =

  50. [58]

    1999 , publisher =

    Neural Network Learning: Theoretical Foundations , author =. 1999 , publisher =

    1999

  51. [59]

    , year =

    Andrieu, Christophe and Lee, Anthony and Power, Sam and Wang, Andi Q. , year =. Poincar. 2208.05239 , publisher =

    arXiv

  52. [60]

    On Logarithmic

    An. On Logarithmic. 2000 , journal =

    2000

  53. [61]

    Estimating

    Aristoff, David , year =. Estimating. 1205.2400 , primaryclass =

    arXiv

  54. [62]

    and Abbe, Emmanuel and Verd

    Asadi, Amir R. and Abbe, Emmanuel and Verd. Chaining. 2019 , month = jul, number =. 1806.03803 , primaryclass =

    2019 arXiv

  55. [63]

    Analysis and

    Bakry, Dominique and Gentil, Ivan and Ledoux, Michel , year =. Analysis and

  56. [64]

    Probability Measures on Groups , author =

    Functional. Probability Measures on Groups , author =. 2004 , pages =

    2004

  57. [65]

    2024 , eprint=

    Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent , author=. 2024 , eprint=

    2024

  58. [66]

    and Larchev, M

    Schertzer, D. and Larchev, M. and Duan, J. and Yanovsky, V. V. and Lovejoy, S. , year =. Fractional. Journal of Mathematical Physics , volume =. math/0409486 , pages =

    arXiv

  59. [67]

    Freitag, Eberhard and Rusam, Rolf , year =. Complex

  60. [68]

    Lang, Serge , year =. Complex

  61. [69]

    Distributions and

    Grubb, Gerd , year =. Distributions and

  62. [70]

    International Conference on Learning Representations , year=

    A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat Minima , author=. International Conference on Learning Representations , year=

  63. [71]

    Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics , pages =

    Stable behaviour of infinitely wide deep neural networks , author =. Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics , pages =. 2020 , editor =

    2020

  64. [72]

    Stochastic

    Wojtowytsch, Stephan , year =. Stochastic. Journal of Nonlinear Science , volume =

  65. [73]

    Modified Log-

    Adamczak, Rados. Modified Log-. 2022 , month = apr, journal =. 2007.10209 , primaryclass =

    2022 arXiv

  66. [74]

    International Conference on Learning Representations , year=

    An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , author=. International Conference on Learning Representations , year=

  67. [75]

    SIAM Journal on Mathematics of Data Science , volume=

    KL convergence guarantees for score diffusion models under minimal data assumptions , author=. SIAM Journal on Mathematics of Data Science , volume=. 2025 , publisher=

    2025

  68. [76]

    1982 , issn =

    Reverse-time diffusion equation models , journal =. 1982 , issn =

    1982

  69. [77]

    Jung, Paul and Lee, Hoil and Lee, Jiho and Yang, Hongseok , year =. alpha-. Advances in Applied Probability , Volume 55 , Issue 4 , eprint =

  70. [78]

    2020 , journal =

    A Fractal Dimension for Measures via Persistent Homology , author =. 2020 , journal =. 1808.01079 , primaryclass =

    2020 arXiv

  71. [79]

    Frontiers in Artificial Intelligence , volume=

    Topology applied to machine learning: From global to local , author=. Frontiers in Artificial Intelligence , volume=. 2021 , publisher=

    2021

  72. [80]

    Stability

    Banerjee, Arindam and Chen, Tiancong and Li, Xinyan and Zhou, Yingxue , year =. Stability. arXiv.org , urldate =

  73. [81]

    Journal of Machine Learning Research , year =

    Peter Bartlett and Shahar Mendelson , title =. Journal of Machine Learning Research , year =

  74. [82]

    Algorithmic

    Bassily, Raef and Nissim, Kobbi and Smith, Adam and Steinke, Thomas and Stemmer, Uri and Ullman, Jonathan , year =. Algorithmic. doi:10.48550/arXiv.1511.02513 , urldate =. 1511.02513 , primaryclass =

    doi arXiv

  75. [83]

    and Monfardini, G

    Gori, M. and Monfardini, G. and Scarselli, F. , booktitle=. A new model for learning in graph domains , year=

  76. [84]

    Stability of

    Bassily, Raef and Feldman, Vitaly and Guzm. Stability of. Advances in. 2020 , volume =

    2020

  77. [85]

    2014 , pages=

    Bassily, Raef and Smith, Adam and Thakurta, Abhradeep , booktitle=. 2014 , pages=

    2014

  78. [86]

    Baudoin, Fabrice and Bonnefont, Michel , year =. Reverse. 1504.00603 , primaryclass =

    arXiv

  79. [87]

    Ripser: Efficient Computation of

    Bauer, Ulrich , year =. Ripser: Efficient Computation of. Journal of Applied and Computational Topology , volume =. 1908.02518 , primaryclass =

    1908 arXiv

  80. [88]

    2019 , month = aug, journal =

    Reconciling Modern Machine Learning Practice and the Bias-Variance Trade-Off , author =. 2019 , month = aug, journal =. 1812.11118 , primaryclass =

    2019 arXiv

  81. [89]

    Differentially

    Yu, Lei and Liu, Ling and Pu, Calton and Gursoy, Mehmet Emre and Truex, Stacey , year =. Differentially. 2019

    2019

  82. [90]

    and Pantazis, Yannis and

    Birrell, Jeremiah and Dupuis, Paul and Katsoulakis, Markos A. and Pantazis, Yannis and. (F,. 2022 , journal =

    2022

  83. [91]

    and Getoor, Ronald K

    Blumenthal, Robert M. and Getoor, Ronald K. , year =. Transactions of the American Mathematical Society , pages =

  84. [92]

    , year =

    Bobkov, S. , year =. A. Journal of Functional Analysis , volume =

  85. [93]

    G and Ledoux, M , year =

    Bobkov, S. G and Ledoux, M , year =. On. Journal of Functional Analysis , volume =

  86. [94]

    and Tetali, Prasad , year =

    Bobkov, Sergey G. and Tetali, Prasad , year =. Modified. Journal of Theoretical Probability , volume =

  87. [95]

    Probability in

    Ledoux, Michel and Talagrand, Michel , year =. Probability in

  88. [96]

    and Ledoux, Michel , year =

    Bobkov, Sergey G. and Ledoux, Michel , year =. Weighted. The Annals of Probability , volume =

  89. [97]

    2007 , volume =

    Measure Theory , author =. 2007 , volume =

    2007

  90. [98]

    Asymptotics of

    Borodin, Alexei and Okounkov, Andrei and Olshanski, Grigori , year =. Asymptotics of. doi:10.48550/arXiv.math/9905032 , urldate =. math/9905032 , publisher =

    doi arXiv

  91. [99]

    Fantastic

    Jiang, Yiding and Neyshabur, Behnam and Mobahi, Hossein and Krishnan, Dilip and Bengio, Samy , year =. Fantastic. ICLR 2020 , eprint =

    2020

  92. [100]

    1938 , journal =

    A New Reasure of Rank Correlation , author =. 1938 , journal =

    1938

  93. [101]

    B. L. 2013 , series =. doi:10.1007/978-3-319-02684-8 , urldate =

    2013 doi

  94. [102]

    Differentially

    Wang, Di and Ye, Minwei and Xu, Jinhui , year =. Differentially

  95. [103]

    Concentration Inequalities -

    Boucheron, St. Concentration Inequalities -. 2013 , publisher =

    2013

  96. [104]

    2020 , month = may, journal =

    Sharper Bounds for Uniformly Stable Algorithms , author =. 2020 , month = may, journal =. 1910.07833 , primaryclass =

    2020 arXiv

  97. [105]

    2002 , journal =

    Stability and Generalization , author =. 2002 , journal =

    2002

  98. [106]

    Diffusion Approximations and Control Variates for

    Brosse, Nicolas and Durmus, Alain and Meyn, Sean and Moulines, Eric and Radhakrishnan, Anand , year =. Diffusion Approximations and Control Variates for. 1808.01665 , publisher =

    arXiv

  99. [107]

    Journal de Math\'

    Mouhot, Cl. Journal de Math\'. 2011 , number =

    2011

  100. [108]

    Advances in Neural Information Processing Systems , volume=

    A pac-bayesian generalization bound for equivariant networks , author=. Advances in Neural Information Processing Systems , volume=

  101. [109]

    The Promises and Pitfalls of

    Brosse, Nicolas and Durmus, Alain and Moulines, Eric , year =. The Promises and Pitfalls of. 1811.10072 , primaryclass =

    arXiv

  102. [110]

    , year =

    Bu, Yuheng and Zou, Shaofeng and Veeravalli, Venugopal V. , year =. Tightening. IEEE Journal on Selected Areas in Information Theory , volume =. 1901.04609 , primaryclass =

    1901 arXiv

  103. [111]

    Camuto, Alexander and Deligiannidis, George and Erdogdu, Murat A. and G. Fractal. 2021 , month = jun, journal =. 2106.04881 , primaryclass =

    2021 arXiv

  104. [112]

    Electronic Journal of Probability , number =

    Pietro Caputo and Zongchen Chen and Yuzhou Gu and Yury Polyanskiy , title =. Electronic Journal of Probability , number =. 2025 , doi =

    2025

  105. [113]

    Advances in Neural Information Processing Systems , volume=

    Towards theoretically understanding why sgd generalizes better than adam in deep learning , author=. Advances in Neural Information Processing Systems , volume=

  106. [114]

    International

    On. International. 2005 , month = jan, pages =

    2005

  107. [115]

    Casado, Ioar and Ortega, Luis A. and P. 2024 , month = oct, number =. 2401.01148 , primaryclass =

    2024 arXiv

  108. [116]

    Catoni, Olivier , year =. Pac-. IMS Lecture Notes Monograph Series , volume =. 0712.0248 , primaryclass =

    arXiv

  109. [117]

    2008 , month = jul, number =

    Functional Inequalities for Heavy Tails Distributions and Application to Isoperimetry , author =. 2008 , month = jul, number =. 0807.3112 , primaryclass =

    2008 arXiv

  110. [118]

    Some Remarks on Weighted Logarithmic

    Cattiaux, Patrick and Guillin, Arnaud and Wu, Liming , year =. Some Remarks on Weighted Logarithmic. 1005.3908 , primaryclass =

    arXiv

  111. [119]

    Binomial-

    Chafai, Djalil , year =. Binomial-. ESAIM: Probability and Statistics , volume =. math/0510488 , pages =

    arXiv

  112. [120]

    An Elementary Proof of Some Functional Inequalities on Paths Space for

    Chafai, Djalil , year =. An Elementary Proof of Some Functional Inequalities on Paths Space for

  113. [121]

    2004 , month = jan, journal =

    Entropies, Convexity, and Functional Inequalities , author =. 2004 , month = jan, journal =. math/0211103 , urldate =

    2004 arXiv

  114. [122]

    On Fine Properties of Mixtures with Respect to Concentration of Measure and

    Chafai, Djalil and Malrieu, Florent , year =. On Fine Properties of Mixtures with Respect to Concentration of Measure and. Annales de l'Institut Henri Poincar. 0805.0987 , primaryclass =

    arXiv

  115. [123]

    Logarithmic Sobolev Inequalities Essentials , author =

  116. [124]

    Couillet, Romain and Liao, Zhenyu , year =. Random. doi:10.1017/9781009128490 , urldate =

    doi

  117. [125]

    2018 , month = apr, journal =

    A Random Matrix Approach to Neural Networks , author =. 2018 , month = apr, journal =

    2018

  118. [126]

    Asymptotic

    George, Anand Jerry and Macris, Nicolas , year =. Asymptotic. doi:10.48550/arXiv.2603.22962 , urldate =. arXiv , keywords =:2603.22962 , primaryclass =

    doi arXiv

  119. [127]

    2022 , month = jun, number =

    Minkowski Dimension for Measures , author =. 2022 , month = jun, number =. 2001.07055 , primaryclass =

    2022 arXiv

  120. [128]

    2022 , month = aug, journal =

    On the Generalization of Learning Algorithms That Do Not Converge , author =. 2022 , month = aug, journal =. 2208.07951 , primaryclass =

    2022 arXiv

  121. [129]

    Proceedings of the 40th International Conference on Machine Learning , pages =

    Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions , author =. Proceedings of the 40th International Conference on Machine Learning , pages =. 2023 , editor =

    2023

  122. [130]

    The Logarithmic

    Chen, Guan-Yu and Liu, Wai-Wai and. The Logarithmic. 2008 , journal =

    2008

  123. [131]

    Costantini, Cristina and Gobet, Emmanuel and Zadourian, Antonin , journal=

  124. [132]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    Swin transformer: Hierarchical vision transformer using shifted windows , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  125. [133]

    2021 , school=

    The q-spread dimension and the maximum diversity of square grid metric spaces , author=. 2021 , school=

    2021

  126. [134]

    Journal of Statistical Physics , volume =

    Cao, Yu and Lu, Jianfeng and Lu, Yulong , year =. Journal of Statistical Physics , volume =

  127. [135]

    Stability and

    Chen, Yuansi and Jin, Chi and Yu, Bin , year =. Stability and. 1804.01619 , primaryclass =

    arXiv

  128. [136]

    2017 , author =

    Journal of Differential Equations , volume =. 2017 , author =

    2017

  129. [137]

    and Hong, Mingyi , year =

    Chen, Xiangyi and Wu, Steven Z. and Hong, Mingyi , year =. Understanding. Advances in

  130. [138]

    Chen, Xuxing and Balasubramanian, Krishnakumar and Ghosal, Promit and Agrawalla, Bhavya , year =. From. 2310.01687 , primaryclass =

    arXiv

  131. [139]

    arXiv preprint arXiv:1711.07553 , year=

    Residual gated graph convnets , author=. arXiv preprint arXiv:1711.07553 , year=

    arXiv

  132. [140]

    Chevyrev, Ilya and Kormilitzin, Andrey , year =. A. doi:10.48550/arXiv.1603.03788 , urldate =. 1603.03788 , primaryclass =

    doi

  133. [141]

    Transactions on Machine Learning Research , issn=

    Mean-Field Langevin Dynamics : Exponential Convergence and Annealing , author=. Transactions on Machine Learning Research , issn=

  134. [142]

    Holland, Finbarr , year =

  135. [143]

    Differential

    Chourasia, Rishav and Ye, Jiayuan and Shokri, Reza , year =. Differential. Advances in

  136. [144]

    Majorizing

    Chu, Yifeng and Raginsky, Maxim , year =. Majorizing. 2305.02960 , primaryclass =

    arXiv

  137. [145]

    Journal of Machine Learning Research , year =

    Ben Chugg and Hongjian Wang and Aaditya Ramdas , title =. Journal of Machine Learning Research , year =

  138. [146]

    On the Variational Interpretation of Local Logarithmic

    Clerc, Gauthier and Conforti, Giovanni and Gentil, Ivan , year =. On the Variational Interpretation of Local Logarithmic. 2011.05207 , primaryclass =

    2011 arXiv

  139. [147]

    Clerico, Eugenio and Shidani, Amitis and Deligiannidis, George and Doucet, Arnaud , year =. Chained. Proceedings of Thirty Fifth Conference on Learning Theory , eprint =

  140. [148]

    Proceedings of The 36th International Conference on Algorithmic Learning Theory , pages =

    Generalisation under gradient descent via deterministic PAC-Bayes , author =. Proceedings of The 36th International Conference on Algorithmic Learning Theory , pages =. 2025 , editor =

    2025

  141. [149]

    Journal of Mathematical Physics , year = 1959, volume=

    Gautschi, Walter , title =. Journal of Mathematical Physics , year = 1959, volume=

    1959

  142. [150]

    Implicit Regularisation in Diffusion Models: An Algorithm-Dependent Generalisation Analysis

    Farghly, Tyler and Rebeschini, Patrick and Deligiannidis, George and Doucet, Arnaud. Implicit Regularisation in Diffusion Models: An Algorithm-Dependent Generalisation Analysis. The Fourteenth International Conference on Learning Representations

  143. [151]

    Dalalyan, Arnak S. and. On Sampling from a Log-Concave Density Using Kinetic. 2018 , month = dec, number =. 1807.09382 , primaryclass =

    2018 arXiv

  144. [152]

    The Eleventh International Conference on Learning Representations , year=

    Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions , author=. The Eleventh International Conference on Learning Representations , year=

  145. [153]

    Generalization in

    Qi CHEN and Jierui Zhu and Florian Shkurti , booktitle=. Generalization in

  146. [154]

    2024 , eprint=

    Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions , author=. 2024 , eprint=

    2024

  147. [155]

    Lions, Pierre-Louis and Sznitman, Alain-Sol , journal=

  148. [156]

    Journal of the Royal Statistical Society Series B: Statistical Methodology , year =

    Arnak Dalalyan , title =. Journal of the Royal Statistical Society Series B: Statistical Methodology , year =

  149. [157]

    , year =

    Damian, Alex and Ma, Tengyu and Lee, Jason D. , year =. Label. 2106.06530 , primaryclass =

    arXiv

  150. [158]

    Asoodeh, Shahab and Diaz, Mario , year =. Privacy

  151. [159]

    and Kosut, Oliver and Sankar, Lalitha , year =

    Asoodeh, Shahab and Liao, Jiachun and Calmon, Flavio P. and Kosut, Oliver and Sankar, Lalitha , year =. Three. IEEE Journal on Selected Areas in Information Theory , volume=

  152. [160]

    and Ledoux, M

    Del Moral, P. and Ledoux, M. and Miclo, L. , year =. On Contraction Properties of. Probability Theory and Related Fields , volume =

  153. [161]

    and Xu, Lihu , year =

    Deng, Changsong and Schilling, Rene L. and Xu, Lihu , year =. Wasserstein-\ 1\ Distance between. doi:10.48550/arXiv.2302.03372 , urldate =. 2302.03372 , primaryclass =

    doi arXiv

  154. [162]

    Iterated

    Diaconis, Persi and Freedman, David , year =. Iterated. SIAM Review , volume =. doi:10.1137/S0036144598338446 , urldate =

    doi

  155. [163]

    1996 , journal =

    Logarithmic Sobolev Inequalities for Finite Markov Chains , author =. 1996 , journal =

    1996

  156. [164]

    Bridging the

    Dieuleveut, Aymeric and Durmus, Alain and Bach, Francis , year =. Bridging the. 1707.06386 , primaryclass =

    arXiv

  157. [165]

    Statistics and Computing , volume=

    Quantitative bounds of convergence for geometrically ergodic Markov chain in the Wasserstein distance with application to the Metropolis adjusted Langevin algorithm , author=. Statistics and Computing , volume=. 2015 , publisher=

    2015

  158. [166]

    Dobrushin, R. L. , year =. Central. Theory of Probability & Its Applications , volume =. doi:10.1137/1101006 , urldate =

    doi

  159. [167]

    Dobrushin, R. L. , year =. Central. Theory of Probability & Its Applications , volume =

  160. [168]

    Douc, Randal and Moulines, Eric and Priouret, Pierre and Soulier, Philippe , year =. Markov. doi:10.1007/978-3-319-97704-1 , isbn =

    doi

  161. [169]

    Advances in

    Dupuis, Benjamin and Jacot, Arthur , year =. Advances in

  162. [170]

    2010 , publisher =

    Frank Olver and Daniel Lozier and Ronald Boisvert and Charles Clark , title =. 2010 , publisher =

    2010

  163. [171]

    arXiv preprint arXiv:2210.07240 , year=

    How to train vision transformer on small-scale datasets? , author=. arXiv preprint arXiv:2210.07240 , year=

    arXiv

  164. [172]

    Attention is All you Need , volume =

    Vaswani, Ashish and Shazeer, Noam and Parmar, Niki and Uszkoreit, Jakob and Jones, Llion and Gomez, Aidan N and Kaiser, ukasz and Polosukhin, Illia , booktitle =. Attention is All you Need , volume =

  165. [173]

    Proceedings, Part I, of the 14th International Conference on Theory of Cryptography - Volume 9985 , pages =

    Bun, Mark and Steinke, Thomas , title =. Proceedings, Part I, of the 14th International Conference on Theory of Cryptography - Volume 9985 , pages =. 2016 , publisher =

    2016

  166. [174]

    Probabilistic methods for algorithmic discrete mathematics , publisher =

    Colin McDiarmid , title =. Probabilistic methods for algorithmic discrete mathematics , publisher =

  167. [175]

    Generalization

    Dupuis, Benjamin and Simsekli, Umut , year =. Generalization. Proceedings of the 41st

  168. [176]

    International Conference on Machine Learning , pages=

    Fractional langevin monte carlo: Exploring l. International Conference on Machine Learning , pages=. 2017 , organization=

    2017

  169. [177]

    Ganesh, Arun and Talwar, Kunal , year =. Faster. Advances in

  170. [178]

    Dupuis, Benjamin and Viallard, Paul , year =. From. 2312.00427 , primaryclass =

    arXiv

  171. [179]

    Journal of Machine Learning Research , year =

    Benjamin Dupuis and Paul Viallard and George Deligiannidis and Umut Simsekli , title =. Journal of Machine Learning Research , year =

  172. [180]

    The best constants in the Khintchine inequality , volume =

    Haagerup, Uffe , journal =. The best constants in the Khintchine inequality , volume =

  173. [181]

    and Leiserson, Charles E

    Cormen, Thomas H. and Leiserson, Charles E. and Rivest, Ronald L. and Stein, Clifford , description =

  174. [182]

    2025 , booktitle=

    Algorithm- and Data-Dependent Generalization Bounds for Score-Based Generative Models , author=. 2025 , booktitle=

    2025

  175. [183]

    Advances in Neural Information Processing Systems (NIPS) , year =

    Ralf Herbrich and Thore Graepel , title =. Advances in Neural Information Processing Systems (NIPS) , year =

  176. [184]

    Journal of Machine Learning Research , year =

    John Langford , title =. Journal of Machine Learning Research , year =

  177. [185]

    Advances in Neural Information Processing Systems (NIPS) , year =

    John Langford and Rich Caruana , title =. Advances in Neural Information Processing Systems (NIPS) , year =

  178. [186]

    Advances in Neural Information Processing Systems (NIPS) , year =

    John Langford and John Shawe. Advances in Neural Information Processing Systems (NIPS) , year =

  179. [187]

    Journal of Machine Learning Research , year =

    Emilio Parrado. Journal of Machine Learning Research , year =

  180. [188]

    Advances in Neural Information Processing Systems (NIPS) , year =

    Amiran Ambroladze and Emilio Parrado. Advances in Neural Information Processing Systems (NIPS) , year =

  181. [189]

    Journal of Machine Learning Research , year =

    Pascal Germain and Alexandre Lacasse and Fran. Journal of Machine Learning Research , year =

  182. [190]

    Advances in Neural Information Processing Systems (NeurIPS) , year =

    Valentina Zantedeschi and Paul Viallard and Emilie Morvant and R. Advances in Neural Information Processing Systems (NeurIPS) , year =

  183. [191]

    Conference on Learning Theory (COLT) , year =

    Gilles Blanchard and Fran. Conference on Learning Theory (COLT) , year =

  184. [192]

    Valiant, L. G. , title =. Commun. ACM , pages =. 1984 , publisher =

    1984

  185. [193]

    Advances in Neural Information Processing Systems (NIPS) , year =

    Peter Bartlett and Dylan Foster and Matus Telgarsky , title =. Advances in Neural Information Processing Systems (NIPS) , year =

  186. [194]

    Conference on Learning Theory (COLT) , year =

    Behnam Neyshabur and Ryota Tomioka and Nathan Srebro , title =. Conference on Learning Theory (COLT) , year =

  187. [195]

    CoRR , volume =

    Pranjal Awasthi and Natalie Frank and Mehryar Mohri , title =. CoRR , volume =. 2020 , eprinttype =

    2020

  188. [196]

    Advances in Neural Information Processing Systems (NIPS) , year =

    Sham Kakade and Karthik Sridharan and Ambuj Tewari , title =. Advances in Neural Information Processing Systems (NIPS) , year =

  189. [197]

    Mehryar Mohri and Afshin Rostamizadeh and Ameet Talwalkar , title =

  190. [198]

    International Conference on Machine Learning , year =

    Benjamin Dupuis and George Deligiannidis and Umut Simsekli , title =. International Conference on Machine Learning , year =

  191. [199]

    IEEE Transactions on Information Theory , year =

    Vladimir Koltchinskii , title =. IEEE Transactions on Information Theory , year =

  192. [200]

    Privacy of

    Altschuler, Jason and Talwar, Kunal , year =. Privacy of. Advances in

  193. [201]

    Advances in Neural Information Processing Systems (NIPS) , year =

    Cynthia Dwork and Vitaly Feldman and Moritz Hardt and Toniann Pitassi and Omer Reingold and Aaron Roth , title =. Advances in Neural Information Processing Systems (NIPS) , year =

  194. [202]

    Rényi Differential Privacy for Heavy-Tailed

    Benjamin Dupuis and Mert Gürbüzbalaban and Umut Simsekli and Jian Wang and Sinan Yildirim and Lingjiong Zhu , year=. Rényi Differential Privacy for Heavy-Tailed

  195. [203]

    Holley, Richard and Stroock, Daniel , year =

  196. [204]

    Differentially

    Ye, Jiayuan and Shokri, Reza , year =. Differentially. Advances in Neural Information Processing Systems , pages =

  197. [205]

    and Abed, Eyad H

    Zawacki, Christopher C. and Abed, Eyad H. , year =. Heavy-

  198. [206]

    Dwork, Cynthia and Roth, Aaron , year =. The. Foundations and Trends

  199. [207]

    Differential

    Dwork, Cynthia , editor =. Differential. Automata,. 2006 , pages =

    2006

  200. [208]

    and Vadhan, Salil , year =

    Dwork, Cynthia and Rothblum, Guy N. and Vadhan, Salil , year =. 2010 IEEE 51st Annual Symposium on Foundations of Computer Science , address=

    2010

  201. [209]

    Mironov, Ilya , year =. Renyi. 2017. 1702.07476 , primaryclass =

    2017 arXiv

  202. [210]

    , year =

    Dwork, Cynthia and Rothblum, Guy N. , year =. Concentrated

  203. [211]

    arXiv , volume =

    Vladimir Koltchinskii and Dmitriy Panchenko , title =. arXiv , volume =

  204. [212]

    Advances in

    Krizhevsky, Alex and Sutskever, Ilya and Hinton, Geoffrey E , year =. Advances in

  205. [213]

    Langevin

    Chien, Eli and Wang, Haoyu and Chen, Ziang and Li, Pan , year =. Langevin. Advances in Neural Information Processing Systems , volume=

  206. [214]

    Machine Learning , year =

    Peter Bartlett and St. Machine Learning , year =

  207. [215]

    Advances in Neural Information Processing Systems (NeurIPS) , year =

    Umut. Advances in Neural Information Processing Systems (NeurIPS) , year =

  208. [216]

    Stochastic

    Durmus, Alain and Simsekli, Umut and Moulines, Eric and Badeau, Roland and RICHARD, Ga. Stochastic. Advances in. 2016 , volume =

    2016

  209. [217]

    Jean-Daniel Boissonnat and Fr

  210. [218]

    Kingma and Jimmy Ba , title=

    Diederik P. Kingma and Jimmy Ba , title=. 2015 , cdate=

    2015

  211. [219]

    , year =

    Dziugaite, Gintare Karolina and Roy, Daniel M. , year =. Computing. 1703.11008 , primaryclass =

    arXiv

  212. [220]

    A Dimension-Free Reverse Logarithmic

    Eldan, Ronen and Ledoux, Michel , year =. A Dimension-Free Reverse Logarithmic. 1903.07093 , primaryclass =

    1903 arXiv

  213. [221]

    and Mackey, Lester and Shamir, Ohad , year =

    Erdogdu, Murat A. and Mackey, Lester and Shamir, Ohad , year =. Global. 1810.12361 , primaryclass =

    arXiv

  214. [222]

    Even, Mathieu and Berthier, Rapha. A. 2021 , month = jun, journal =

    2021

  215. [223]

    Stochastic

    Even, Mathieu , year =. Stochastic

  216. [224]

    Time-Independent

    Farghly, Tyler and Rebeschini, Patrick , year =. Time-Independent. 35th. 2111.12876 , primaryclass =

    arXiv

  217. [225]

    Proceedings of the Thirty-Second Conference on Learning Theory , pages =

    High probability generalization bounds for uniformly stable algorithms with nearly optimal rate , author =. Proceedings of the Thirty-Second Conference on Learning Theory , pages =. 2019 , editor =

    2019

  218. [226]

    Feldman, Vitaly and Mironov, Ilya and Talwar, Kunal and Thakurta, Abhradeep , year =. Privacy. 2018

    2018

  219. [227]

    and Greenberg, Spencer and Kale, Satyen and Luo, Haipeng and Mohri, Mehryar and Sridharan, Karthik , year =

    Foster, Dylan J. and Greenberg, Spencer and Kale, Satyen and Luo, Haipeng and Mohri, Mehryar and Sridharan, Karthik , year =. Hypothesis. Advances in Neural Information Processing Systems 32 (NeurIPS 2019) , eprint =

    2019

  220. [228]

    , year =

    Franchi, Bruno and Lu, Guozhen and Wheeden, Richard L. , year =. Representation Formulas and Weighted. Annales de l'Institut Fourier , volume =. doi:10.5802/aif.1466 , urldate =

    doi

  221. [229]

    Learning

    Fu, Jingwen and Zhang, Zhizheng and Yin, Dacheng and Lu, Yan and Zheng, Nanning , year =. Learning. Advances in Neural Information Processing Systems , volume =

  222. [230]

    Futami, Futoshi and Fujisawa, Masahiro , year =. Time-. 7th. 2311.01046 , primaryclass =

    arXiv

  223. [231]

    The Twelfth International Conference on Learning Representations,

    Michael Gastpar and Ido Nachum and Jonathan Shafer and Thomas Weinberger , title =. The Twelfth International Conference on Learning Representations,. 2024 , keywords =

    2024

  224. [232]

    Xu, Jing and Teng, Jiaye and Yuan, Yang and Yao, Andrew , year =. Towards. Advances in Neural Information Processing Systems , volume =

  225. [233]

    Logarithmic

    Gentil, Ivan and Imbert, Cyril , year =. Logarithmic. Asymptotic analysis , eprint =

  226. [234]

    Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction , volume =

    Lyu, Kaifeng and Li, Zhiyuan and Arora, Sanjeev , booktitle =. Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction , volume =

  227. [235]

    Proceedings of the 26th

    Germain, Pascal and Lacasse, Alexandre and Laviolette, Fran. Proceedings of the 26th. 2009 , month = jun, series =

    2009

  228. [236]

    NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications , year=

    Classifier-Free Diffusion Guidance , author=. NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications , year=

    2021

  229. [237]

    International Conference on Learning Representations , year=

    Progressive Distillation for Fast Sampling of Diffusion Models , author=. International Conference on Learning Representations , year=

  230. [238]

    Heat Flow on

    Gigli, Nicola and Kuwada, Kazumasa and Ohta, Shin-ichi , year =. Heat Flow on. doi:10.48550/arXiv.1008.1319 , urldate =. arXiv , keywords =:1008.1319 , primaryclass =

    doi arXiv

  231. [239]

    Discrete and Continuous Dynamical Systems - Series A , pages =

    Gigli, Nicola and Ledoux, Michel , year =. Discrete and Continuous Dynamical Systems - Series A , pages =

  232. [240]

    and Varoquaux, G

    Pedregosa, F. and Varoquaux, G. and Gramfort, A. and Michel, V. and Thirion, B. and Grisel, O. and Blondel, M. and Prettenhofer, P. and Weiss, R. and Dubourg, V. and Vanderplas, J. and Passos, A. and Cournapeau, D. and Brucher, M. and Perrot, M. and Duchesnay, E. , journal=. S...

  233. [241]

    2025 , eprint=

    Rate of convergence of the smoothed empirical Wasserstein distance , author=. 2025 , eprint=

    2025

  234. [242]

    Optimal Control and Partial Differential Equations , publisher=

    Bourgain, Jean and Brezis, Ha. Optimal Control and Partial Differential Equations , publisher=

  235. [243]

    1985 , publisher=

    Menaldi, Jose-Luis , booktitle=. 1985 , publisher=

    1985

  236. [244]

    Modified Logarithmic

    Goel, Sharad , year =. Modified Logarithmic. Stochastic Processes and their Applications , volume =

  237. [245]

    Transport

    Gozlan, Nathael and L. Transport. 2010 , month = mar, number =. doi:10.48550/arXiv.1003.3852 , urldate =. arXiv , keywords =:1003.3852 , publisher =

    2010 doi arXiv

  238. [246]

    Logarithmic

    Gross, Leonard , year =. Logarithmic. American Journal of Mathematics , volume =. 2373688 , eprinttype =

  239. [247]

    Tweedie's Formula and Selection Bias , urldate =

    Bradley Efron , journal =. Tweedie's Formula and Selection Bias , urldate =

  240. [248]

    Peter D. Gr. Algorithmic Learning Theory (ALT) , year =

  241. [249]

    Gr. The. 2007 , month = mar, publisher =

    2007

  242. [250]

    IEEE Transactions on Information Theory , year=

    Strong Data Processing Inequalities and Phi-Sobolev Inequalities for Discrete Channels , author=. IEEE Transactions on Information Theory , year=

  243. [251]

    Advances in neural information processing systems , volume=

    Do vision transformers see like convolutional neural networks? , author=. Advances in neural information processing systems , volume=

  244. [252]

    Zico Kolter , title =

    Vaishnavh Nagarajan and J. Zico Kolter , title =. Advances in Neural Information Processing Systems (NeurIPS) , year =

  245. [253]

    The Annals of Applied Probability , number =

    Antonio Blanca and Pietro Caputo and Daniel Parisi and Alistair Sinclair and Eric Vigoda , title =. The Annals of Applied Probability , number =. 2022 , doi =

    2022

  246. [254]

    Transportation-Information Inequalities for

    Guillin, Arnaud and Leonard, Christian and Wu, Liming and Yao, Nian , year =. Transportation-Information Inequalities for. 0706.4193 , primaryclass =

    arXiv

  247. [255]

    Gupta, Chirag and Balakrishnan, Sivaraman and Ramdas, Aaditya , year =. Path

  248. [256]

    2000 , journal =

    Dimension of a Measure , author =. 2000 , journal =

    2000

  249. [257]

    Cyclic and

    G. Cyclic and. 2023 , month = feb, journal =

    2023

  250. [258]

    Fractional Moment-Preserving Initialization Schemes for Training Deep Neural Networks , booktitle =

    Gurbuzbalaban, Mert and Hu, Yuanhan , year =. Fractional Moment-Preserving Initialization Schemes for Training Deep Neural Networks , booktitle =. 2005.11878 , primaryclass =

    2005 arXiv

  251. [259]

    Proceedings of the 38th International Conference on Machine Learning , pages =

    The Heavy-Tail Phenomenon in SGD , author =. Proceedings of the 38th International Conference on Machine Learning , pages =. 2021 , editor =

    2021

  252. [260]

    Nguyen, Thanh Huy and. First. 2019 , month = jun, eprint =

    2019

  253. [261]

    Bernoulli , year=

    Absolute continuity for some one-dimensional processes , author=. Bernoulli , year=

  254. [262]

    Maxime Haddouche and Benjamin Guedj , journal=

  255. [263]

    Haddouche, Maxime and Viallard, Paul and Simsekli, Umut and Guedj, Benjamin , year =. A. 2402.08508 , primaryclass =

    arXiv

  256. [264]

    Wasserstein

    Haddouche, Maxime and Guedj, Benjamin , year =. Wasserstein. doi:10.48550/arXiv.2304.07048 , urldate =. arXiv , keywords =:2304.07048 , primaryclass =

    doi arXiv

  257. [265]

    and Dziugaite, Gintare Karolina , year =

    Haghifam, Mahdi and Negrea, Jeffrey and Khisti, Ashish and Roy, Daniel M. and Dziugaite, Gintare Karolina , year =. Sharpened. 2004.12983 , primaryclass =

    2004 arXiv

  258. [266]

    , year =

    Haghifam, Mahdi and Dziugaite, Gintare Karolina and Moran, Shay and Roy, Daniel M. , year =. Towards a. doi:10.48550/arXiv.2111.05275 , urldate =. arXiv , keywords =:2111.05275 , primaryclass =

    doi arXiv

  259. [267]

    Train Faster, Generalize Better:

    Hardt, Moritz and Recht, Benjamin and Singer, Yoram , year =. Train Faster, Generalize Better:. 1509.01240 , primaryclass =

    arXiv

  260. [268]

    Conference on Learning Theory (COLT) , year =

    Thomas Steinke and Lydia Zakynthinou , title =. Conference on Learning Theory (COLT) , year =

  261. [269]

    2025 , eprint=

    Tighter CMI-Based Generalization Bounds via Stochastic Projection and Quantization , author=. 2025 , eprint=

    2025

  262. [270]

    arXiv preprint arXiv:1609.02907 , year=

    Semi-supervised classification with graph convolutional networks , author=. arXiv preprint arXiv:1609.02907 , year=

    arXiv

  263. [271]

    General Bounds on the Mutual Information between a Parameter and n Conditionally Independent Observations

    Haussler, David and Opper, Manfred , urldate =. General Bounds on the Mutual Information between a Parameter and n Conditionally Independent Observations

  264. [272]

    The Annals of Probability , volume=

    Time Reversal of Diffusions , author=. The Annals of Probability , volume=. 1986 , publisher=

    1986

  265. [273]

    Generalization

    Hellstr. Generalization. 2020 , month = nov, journal =. 2005.08044 , primaryclass =

    2020 arXiv

  266. [274]

    Proceedings of the 19th International Conference on Artificial Intelligence and Statistics , pages =

    Controlling Bias in Adaptive Data Analysis Using Information Theory , author =. Proceedings of the 19th International Conference on Artificial Intelligence and Statistics , pages =. 2016 , editor =

    2016

  267. [275]

    Proceedings of The 28th Conference on Learning Theory , pages =

    Norm-Based Capacity Control in Neural Networks , author =. Proceedings of The 28th Conference on Learning Theory , pages =. 2015 , editor =

    2015

  268. [276]

    2021 , month = oct, journal =

    Information-Theoretic Generalization Bounds for Black-Box Learning Algorithms , author =. 2021 , month = oct, journal =. 2110.01584 , primaryclass =

    2021 arXiv

  269. [277]

    Path-SGD: Path-Normalized Optimization in Deep Neural Networks , volume =

    Neyshabur, Behnam and Salakhutdinov, Russ R and Srebro, Nati , booktitle =. Path-SGD: Path-Normalized Optimization in Deep Neural Networks , volume =

  270. [278]

    Denoising Diffusion Probabilistic Models , volume =

    Ho, Jonathan and Jain, Ajay and Abbeel, Pieter , booktitle =. Denoising Diffusion Probabilistic Models , volume =

  271. [279]

    Automatica , volume=

    Ito, Kaito and Kawano, Yu and Kashima, Kenji , title =. Automatica , volume=

  272. [280]

    and Bottou, L

    Lecun, Y. and Bottou, L. and Bengio, Y. and Haffner, P. , journal=. Gradient-based learning applied to document recognition , year=

  273. [281]

    International conference on machine learning , pages=

    Training data-efficient image transformers & distillation through attention , author=. International conference on machine learning , pages=. 2021 , organization=

    2021

  274. [282]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    Going deeper with image transformers , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  275. [283]

    Stronger

    Arora, Sanjeev and Ge, Rong and Neyshabur, Behnam and Zhang, Yi , year =. Stronger. Proceedings of the 35th

  276. [284]

    Arora, Sanjeev and Du, Simon and Hu, Wei and Li, Zhiyuan and Wang, Ruosong , year =. Fine-. Proceedings of the 36th

  277. [285]

    Compression Based Bound for Non-Compressed Network: Unified Generalization Error Analysis of Large Compressible Deep Neural Network , shorttitle =

    Suzuki, Taiji and Abe, Hiroshi and Nishimura, Tomoaki , year =. Compression Based Bound for Non-Compressed Network: Unified Generalization Error Analysis of Large Compressible Deep Neural Network , shorttitle =. ICLR 2020 , eprint =

    2020

  278. [286]

    Generalization

    Hellstr. Generalization. 2023 , month = sep, number =. 2309.04381 , primaryclass =

    2023 arXiv

  279. [287]

    Generalization

    Hellstr. Generalization. 2024 , month = mar, number =. doi:10.48550/arXiv.2309.04381 , urldate =. arXiv , keywords =:2309.04381 , primaryclass =

    2024 doi arXiv

  280. [288]

    , year =

    Hinton, rey E. , year =. Training

  281. [289]

    Large Deviations for Random Dynamical Systems and Applications to Hidden

    Hu, Shulan and Wu, Liming , year =. Large Deviations for Random Dynamical Systems and Applications to Hidden. Stochastic Processes and their Applications , volume =. doi:10.1016/j.spa.2010.07.003 , urldate =

    2010 doi

  282. [290]

    1997 , month = may, journal =

    Sparse Spatial Autoregressions , author =. 1997 , month = may, journal =. doi:10.1016/S0167-7152(96)00140-X , langid =

    1997 doi

  283. [291]

    Homogenization of

    Huang, Qiao and Duan, Jinqiao and Song, Renming , year =. Homogenization of. doi:10.48550/arXiv.1812.11624 , urldate =. 1812.11624 , primaryclass =

    doi arXiv

  284. [292]

    Advances in Neural Information Processing Systems , editor=

    Maximum Likelihood Training of Score-Based Diffusion Models , author=. Advances in Neural Information Processing Systems , editor=

  285. [293]

    Proceedings of the 32nd International Conference on Machine Learning , pages =

    Deep Unsupervised Learning using Nonequilibrium Thermodynamics , author =. Proceedings of the 32nd International Conference on Machine Learning , pages =

  286. [294]

    Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding , volume =

    Saharia, Chitwan and Chan, William and Saxena, Saurabh and Li, Lala and Whang, Jay and Denton, Emily L and Ghasemipour, Kamyar and Gontijo Lopes, Raphael and Karagol Ayan, Burcu and Salimans, Tim and Ho, Jonathan and Fleet, David and Norouzi, Mohammad , booktitle =. Photoreali...

  287. [295]

    2025 , eprint=

    Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance , author=. 2025 , eprint=

    2025

  288. [296]

    Nguyen and Lingjiong Zhu , title =

    Xuefeng Gao and Hoang M. Nguyen and Lingjiong Zhu , title =. Journal of Machine Learning Research , year =

  289. [297]

    Generative Modeling by Estimating Gradients of the Data Distribution , volume =

    Song, Yang and Ermon, Stefano , booktitle =. Generative Modeling by Estimating Gradients of the Data Distribution , volume =

  290. [298]

    On the Generalization Properties of Diffusion Models , volume =

    Li, Puheng and Li, Zhong and Zhang, Huishuai and Bian, Jiang , booktitle =. On the Generalization Properties of Diffusion Models , volume =

  291. [299]

    The Twelfth International Conference on Learning Representations , year=

    Generalization in diffusion models arises from geometry-adaptive harmonic representations , author=. The Twelfth International Conference on Learning Representations , year=

  292. [300]

    2026 , eprint=

    Generalization Properties of Score-matching Diffusion Models for Intrinsically Low-dimensional Data , author=. 2026 , eprint=

    2026

Pith tools

Reviewed July 12, 2026 · model on record in the stance chip above.