The reviewed record of science sign in
Pith

arxiv: 2605.06845 · v2 · pith:SWCAX6XU · submitted 2026-05-07 · math.ST · stat.TH

Convergence Rates for Latent Mixing Measures in Infinite Homoscedastic Location-Scale Mixture Models

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel 2026-06-30 23:00 UTCgrok-4.3pith:SWCAX6XUrecord.jsonopen to challenge →

classification math.ST stat.TH
keywords posterior contractionmixing measureslocation-scale mixturesDirichlet processWasserstein distanceoperator normmixture kernelsBayesian nonparametrics
0
0 comments X

The pith

The paper establishes the first contraction rates for latent mixing measures in infinite homoscedastic location-scale mixture models with unknown shared scale by deriving new lower bounds on the L1 distance between densities.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The authors derive novel lower-bounds that connect the L1 distance between mixture densities to discrepancies based on Wasserstein distances and the operator norm between the underlying mixing measures and scale matrices. Their approach uses the dual formulation of the W1 distance combined with functional-analytic approximation techniques. These general inequalities depend on the smoothness of the mixture kernel and a key lower-bound on the L1 metric. Specializing to Gaussian, Cauchy, and Laplace kernels yields contraction rates for Dirichlet process mixtures with unknown shared scale, distinguishing convergence of locations from scales.

Core claim

Posterior contraction rates for mixing measures in homoscedastic location-scale mixture models with infinitely many components are obtained by bounding the L1 distance between mixture densities in terms of Wasserstein distances between mixing measures and operator norm discrepancies between scale matrices, with the bounds determined by the decay rate of the kernel's characteristic function and a PDE inversion condition for sharper results in ordinary-smooth cases. This leads to the first such rates for Dirichlet process mixtures where the scale parameter is unknown and shared across components.

What carries the argument

Novel lower-bounds connecting the L1 distance between mixture densities to Wasserstein distances and operator norm discrepancies between mixing measures and scale matrices, derived from the dual formulation of W1 distance and functional-analytic techniques.

If this is right

  • Contraction rates hold for Dirichlet process mixtures with unknown shared scale parameter.
  • The convergence rate of the location mixing measure can differ from that of the scale parameter depending on the kernel.
  • The strength of the inequalities is governed by the rate of decay of the characteristic function of the mixture kernel.
  • A PDE inversion condition provides sharper inequalities for ordinary-smooth kernels like Laplace.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The techniques could potentially extend to heteroscedastic models if similar bounds can be established.
  • These rates might guide the choice of priors in Bayesian mixture modeling for better posterior concentration.
  • Numerical simulations on synthetic data with known mixing measures could verify the predicted rates for different kernels.

Load-bearing premise

A key lower-bound exists on the L1 metric that involves the operator norm discrepancy between scale parameters.

What would settle it

A counterexample where the L1 distance between two mixture densities is small but the operator norm difference between their scale matrices is large would falsify the key inequality and thus the contraction rates.

read the original abstract

We study posterior contraction rates for mixing measures in homoscedastic location-scale mixture models with infinitely many components. While posterior convergence at the level of densities is well understood, ensuring convergence of the latent mixing measure is more challenging and has remained an open problem in settings where both location and scale parameters are unknown. We address this by deriving novel lower-bounds that connect the $L^1$ distance between mixture densities to discrepancies, based on the Wasserstein distances and the operator norm, between the underlying mixing measures and scale matrices. Our approach combines the dual formulation of the $W_1$ distance with functional-analytic approximation techniques. This leads to general inequalities, whose strength is determined (i) by the smoothness of the mixture kernel via the rate of decay of its characteristic function, and (ii) by a key lower-bound on the $L^1$ metric involving the operator norm discrepancy between scale parameters. Moreover, a novel PDE inversion condition yields a sharper inequality for important ordinary-smooth cases. We specialize these bounds to popular mixtures based on multivariate Gaussian, Cauchy, and Laplace kernels. As a consequence, we obtain first-of-their-kind contraction rates in the context of Dirichlet process mixtures with an unknown scale parameter shared across components. As a byproduct of our inequalities, we can distinguish the convergence behavior of the location mixing measure from that of the scale parameter across a range of kernel choices, leading to nuanced insights into their respective rates.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

1 major / 2 minor

Summary. The paper studies posterior contraction rates for mixing measures in homoscedastic location-scale mixture models with infinitely many components and unknown shared scale. It derives novel lower bounds connecting the L1 distance between mixture densities to Wasserstein distances and operator norm discrepancies between the mixing measures, using the dual W1 formulation and functional-analytic approximation techniques. A novel PDE inversion condition is introduced for ordinary-smooth cases, leading to sharper inequalities. The bounds are specialized to Gaussian, Cauchy, and Laplace kernels, yielding first contraction rates for Dirichlet process mixtures with unknown scale, and distinguishing convergence of location and scale parameters.

Significance. If the derived inequalities and resulting contraction rates hold, this work fills an important gap in Bayesian nonparametric statistics by providing the first results on mixing measure convergence in location-scale mixtures with unknown scale. The technical approach combining dual Wasserstein formulation with PDE inversion is innovative and could have broader applications. The ability to obtain nuanced rates for location versus scale is a notable contribution. The paper ships theoretical derivations that are parameter-free in the sense of not relying on fitted quantities.

major comments (1)
  1. Abstract (paragraph on general inequalities): the key lower-bound on the L1 metric involving the operator norm discrepancy between scale parameters is load-bearing for the general inequalities and thus for the contraction rates; the manuscript should provide an explicit statement and proof of this bound, including the conditions under which it holds, to allow assessment of its validity for the specialized kernels.
minor comments (2)
  1. Consider adding a table or summary figure comparing the contraction rates across the different kernels (Gaussian, Cauchy, Laplace) for location and scale to improve readability of the results.
  2. The abstract could be clarified by separating the description of the method from the consequences more distinctly.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for the positive evaluation and the constructive comment on the abstract. We address the point below.

read point-by-point responses
  1. Referee: [—] Abstract (paragraph on general inequalities): the key lower-bound on the L1 metric involving the operator norm discrepancy between scale parameters is load-bearing for the general inequalities and thus for the contraction rates; the manuscript should provide an explicit statement and proof of this bound, including the conditions under which it holds, to allow assessment of its validity for the specialized kernels.

    Authors: We agree that an explicit statement of this central lower bound will improve accessibility. The bound itself (connecting L1 density distance to the operator-norm discrepancy on scale parameters) is stated and proved as Theorem 3.2 under the stated conditions on the kernel characteristic function and the PDE inversion property for ordinary-smooth kernels. In the revision we will insert a concise, self-contained statement of the bound (with its precise hypotheses) immediately after the abstract paragraph in question and add a forward reference to the proof in Section 3. This is a minor clarification that does not alter any results or proofs. revision: yes

Circularity Check

0 steps flagged

No significant circularity; derivation self-contained

full rationale

The paper derives novel lower bounds on L1 distances between mixture densities in terms of Wasserstein and operator-norm discrepancies between mixing measures, using the dual W1 formulation, functional-analytic approximations, and a PDE inversion condition for ordinary-smooth kernels. These inequalities are then specialized to Gaussian, Cauchy, and Laplace kernels to obtain contraction rates for Dirichlet process mixtures with shared unknown scale. No quoted step reduces a claimed prediction or rate to a fitted parameter, self-defined quantity, or load-bearing self-citation by construction; the central results are presented as independent analytic derivations from the stated assumptions on kernel smoothness and metric lower bounds.

Axiom & Free-Parameter Ledger

0 free parameters · 3 axioms · 0 invented entities

Only abstract available; ledger populated from stated assumptions in the abstract. Full paper may contain additional domain assumptions not visible here.

axioms (3)
  • domain assumption smoothness of the mixture kernel via the rate of decay of its characteristic function
    Determines strength of the general inequalities (abstract).
  • domain assumption key lower-bound on the L1 metric involving the operator norm discrepancy between scale parameters
    Central to connecting density distance to mixing-measure distance (abstract).
  • ad hoc to paper novel PDE inversion condition for ordinary-smooth cases
    Yields sharper inequality; introduced in the paper (abstract).

pith-pipeline@v0.9.1-grok · 5796 in / 1372 out tokens · 38852 ms · 2026-06-30T23:00:49.011270+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Posterior concentration and adaptation of the mixing measure in Dirichlet process mixtures

    math.ST 2026-06 unverdicted novelty 7.0

    In the well-specified case, the posterior mass on extra components beyond the true K vanishes at rate n^{-1/2}, yielding nearly optimal Wasserstein contraction for the mixing measure and logarithmic cluster growth wit...

Reference graph

Works this paper leans on

80 extracted references · 80 canonical work pages · cited by 1 Pith paper

  1. [1]

    Ascolani, F., Lijoi, A., Rebaudo, G., and Zanella, G. (2023). Clustering consistency with Dirichlet process mixtures . Biometrika , 110(2):551--558

  2. [2]

    Bariletto, N., Flores, B., and Walker, S. G. (2025). Posterior Consistency in Parametric Models via a Tighter Notion of Identifiability . arXiv preprint arXiv:2504.11360

  3. [3]

    Barron, A., Schervish, M., and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. The Annals of Statistics , 27:536--561

  4. [4]

    Butzer, P. L. and Nessel, R. J. (1971). Fourier analysis and approximation, Vol. 1 , volume 7. Birkh \"a user Basel

  5. [5]

    Caillerie, C., Chazal, F., Dedecker, J., and Michel, B. (2011). Deconvolution for the W asserstein metric and geometric inference. Electronic Journal of Statistics , 5:1394--1423

  6. [6]

    and De Blasi, P

    Canale, A. and De Blasi, P. (2017). Posterior asymptotics of nonparametric location-scale mixtures for multivariate density estimation. Bernoulli , 23(1):379--404

  7. [7]

    Castillo, I. (2024). Bayesian Nonparametric Statistics . École d’Été de Probabilités de Saint-Flour LI - 2023. Springer Nature

  8. [8]

    and Lavenant, H

    Catalano, M. and Lavenant, H. (2025). Measures of dependence based on W asserstein distances. arXiv preprint arXiv:2510.06034

  9. [9]

    Catalano, M., Lavenant, H., Lijoi, A., and Pr \"u nster, I. (2024). A W asserstein index of dependence for random measures. Journal of the American Statistical Association , 119(547):2396--2406

  10. [10]

    Catalano, M., Lijoi, A., and Pr \"u nster, I. (2021). Measuring dependence in the Wasserstein distance for Bayesian nonparametric models . The Annals of Statistics , 49(5):2916--2947

  11. [11]

    and Walker, S

    Chae, M. and Walker, S. G. (2017). A novel approach to Bayesian consistency . Electronic Journal of Statistics , 11(2):4723--4745

  12. [12]

    H., Pr \"u nster, I., and Ruggiero, M

    De Blasi, P., Favaro, S., Lijoi, A., Mena, R. H., Pr \"u nster, I., and Ruggiero, M. (2015). Are Gibbs -type priors the most natural generalization of the Dirichlet process? IEEE Transactions on Pattern Analysis and Machine Intelligence , 37(2):212--229

  13. [13]

    Dedecker, J., Fischer, A., and Michel, B. (2015). Improved rates for W asserstein deconvolution with ordinary smooth error in dimension one. Electronic Journal of Statistics , 9(1):234--265

  14. [14]

    and Michel, B

    Dedecker, J. and Michel, B. (2013). Minimax rates of convergence for W asserstein deconvolution with supersmooth errors in any dimension. Journal of Multivariate Analysis , 122:278--291

  15. [15]

    DeVore, R. A. and Lorentz, G. G. (1993). Constructive approximation , volume 303. Springer Science & Business Media

  16. [16]

    Escobar, M. D. and West, M. (1995). Bayesian density estimation and inference using mixtures. Journal of the American Statistical Association , 90(430):577--588

  17. [17]

    Ferguson, T. (1973). A B ayesian analysis of some nonparametric problems. The Annals of Statistics , 1:209--230

  18. [18]

    Ferguson, T. S. (1983). Bayesian density estimation by mixtures of normal distributions. In Recent advances in statistics , pages 287--302. Elsevier

  19. [19]

    Folland, G. B. (1999). Real analysis: modern techniques and their applications . John Wiley & Sons

  20. [20]

    and Raftery, A

    Fraley, C. and Raftery, A. E. (2002). Model-based clustering, discriminant analysis, and density estimation. Journal of the American Statistical Association , 97(458):611--631

  21. [21]

    Franzolini, B., Lijoi, A., Pr \"u nster, I., and Rebaudo, G. (2025). Multivariate species sampling models. arXiv preprint arXiv:2503.24004

  22. [22]

    and van der Vaart, A

    Gao, F. and van der Vaart, A. (2016). Posterior contraction rates for deconvolution of Dirichlet-Laplace mixtures. Electronic Journal of Statistics , 10(1):608--627

  23. [23]

    Genovese, C. R. and Wasserman, L. (2000). Rates of convergence for the Gaussian mixture sieve . The Annals of Statistics , 28(4):1105--1127

  24. [24]

    K., and Ramamoorthi, R

    Ghosal, S., Ghosh, J. K., and Ramamoorthi, R. V. (1999). Posterior consistency of D irichlet mixtures in density estimation. The Annals of Statistics , 27:143--158

  25. [25]

    K., and van der Vaart, A

    Ghosal, S., Ghosh, J. K., and van der Vaart, A. (2000). Convergence rates of posterior distributions. The Annals of Statistics , 28:500--531

  26. [26]

    and van der Vaart, A

    Ghosal, S. and van der Vaart, A. (2007a). Convergence rates of posterior distributions for noniid observations . The Annals of Statistics , 35(1):192 -- 223

  27. [27]

    and van der Vaart, A

    Ghosal, S. and van der Vaart, A. (2007b). Posterior convergence rates of D irichlet mixtures at smooth densities. The Annals of Statistics , 35:697--723

  28. [28]

    and Van der Vaart, A

    Ghosal, S. and Van der Vaart, A. (2017). Fundamentals of nonparametric Bayesian inference , volume 44. Cambridge University Press

  29. [29]

    and van der Vaart, A

    Ghosal, S. and van der Vaart, A. W. (2001). Entropies and rates of convergence for maximum likelihood and B ayes estimation for mixtures of normal densities. The Annals of Statistics , 29(5):1233--1263

  30. [30]

    and Nickl, R

    Gin \'e , E. and Nickl, R. (2011). Rates of contraction for posterior distributions in L^r -metrics, 1 r . The Annals of Statistics , 39(6):2883 -- 2911

  31. [31]

    and Pitman, J

    Gnedin, A. and Pitman, J. (2006). Exchangeable Gibbs partitions and Stirling triangles . Journal of Mathematical Sciences , 138(3):5674--5685

  32. [32]

    Guha, A., Ho, N., and Nguyen, X. (2021). On posterior contraction of parameters and interpretability in Bayesian mixture modeling. Bernoulli , 27(4):2159--2188

  33. [33]

    Heinonen, J. (2001). Lectures on analysis on metric spaces . Springer Science & Business Media

  34. [34]

    and Nguyen, X

    Ho, N. and Nguyen, X. (2016a). Convergence rates of parameter estimation for some weakly identifiable finite mixtures. The Annals of Statistics , 44:2726--2755

  35. [35]

    and Nguyen, X

    Ho, N. and Nguyen, X. (2016b). On strong identifiability and convergence rates of parameter estimation in finite mixtures. Electronic Journal of Statistics , 10:271--307

  36. [36]

    Kingman, J. F. (1978). The representation of partition structures. Journal of the London Mathematical Society , 2(2):374--380

  37. [37]

    Kingman, J. F. C. (1967). Completely random measures. Pacific Journal of Mathematics , 21(1):59--78

  38. [38]

    Lee, J. M. (2013). Introduction to Smooth Manifolds , volume 218 of Graduate Texts in Mathematics . Springer, New York, 2 edition

  39. [39]

    H., and Pr \"u nster, I

    Lijoi, A., Mena, R. H., and Pr \"u nster, I. (2005a). Hierarchical mixture modeling with normalized inverse- Gaussian priors. Journal of the American Statistical Association , 100(472):1278--1291

  40. [40]

    Lijoi, A., Nipoti, B., and Pr \"u nster, I. (2014). Bayesian inference with dependent normalized completely random measures. Bernoulli , pages 1260--1291

  41. [41]

    u nster, I. (2010). Models beyond the Dirichlet process. In Hjort, N. L., Holmes, C., M \

    Lijoi, A. and Pr \"u nster, I. (2010). Models beyond the Dirichlet process. In Hjort, N. L., Holmes, C., M \"u ller, P., and Walker, S. G., editors, Bayesian Nonparametrics , pages 80--136. Cambridge University Press

  42. [42]

    Lijoi, A., Pr \"u nster, I., and Walker, S. G. (2005b). On consistency of nonparametric normal mixtures for B ayesian density estimation. Journal of the American Statistical Association , 100(472):1292--1296

  43. [43]

    Lo, A. Y. (1984). On a Class of Bayesian Nonparametric Estimates: I. Density Estimates . The Annals of Statistics , 12(1):351--357

  44. [44]

    MacEachern, S. N. and M \"u ller, P. (1998). Estimating mixture of D irichlet process models. Journal of Computational and Graphical Statistics , 7(2):223--238

  45. [45]

    Majumdar, S. (1992). On topological support of D irichlet prior. Statistics & Probability Letters , 15(5):381--384

  46. [46]

    McLachlan, G. J. and Peel, D. (2000). Finite Mixture Models . John Wiley & Sons

  47. [47]

    McShane, E. J. (1934). Extension of range of functions. Bulletin of the American Mathematical Society , 40:837--842

  48. [48]

    Miller, J. W. and Harrison, M. T. (2013). A simple example of D irichlet process mixture inconsistency for the number of components. In Advances in Neural Information Processing Systems , volume 26

  49. [49]

    Miller, J. W. and Harrison, M. T. (2014). Inconsistency of P itman-- Y or process mixtures for the number of components. Journal of Machine Learning Research , 15:3333--3370

  50. [50]

    Neal, R. M. (2000). Markov chain sampling methods for Dirichlet process mixture models . Journal of Computational and Graphical Statistics , 9(2):249--265

  51. [51]

    Nguyen, X. (2013). Convergence of latent mixing measures in finite and infinite mixture models. The Annals of Statistics , 4(1):370--400

  52. [52]

    E., Pr \"u nster, I., and Walker, S

    Nieto-Barajas, L. E., Pr \"u nster, I., and Walker, S. G. (2004). Normalized random measures driven by increasing additive processes. The Annals of Statistics , 32(6):2343--2360

  53. [53]

    Perman, M., Pitman, J., and Yor, M. (1992). Size-biased sampling of Poisson point processes and excursions. Probability Theory and Related Fields , 92(1):21--39

  54. [54]

    Petralia, F., Rao, V., and Dunson, D. (2012). Repulsive mixtures. Advances in neural information processing systems , 25

  55. [55]

    Pitman, J. (1996). Some developments of the Blackwell-MacQueen urn scheme. In Statistics, Probability and Game Theory: Papers in Honor of David Blackwell , volume 30, pages 245--267. Institute of Mathematical Statistics

  56. [56]

    and Yor, M

    Pitman, J. and Yor, M. (1997). The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator. The Annals of Probability , 25(2):855--900

  57. [57]

    Regazzini, E., Lijoi, A., and Pr \"u nster, I. (2003). Distributional results for means of normalized random measures with independent increments. The Annals of Statistics , 31(2):560--585

  58. [58]

    B., and Gelfand, A

    Rodriguez, A., Dunson, D. B., and Gelfand, A. E. (2008). The nested D irichlet process. Journal of the American Statistical Association , 103(483):1131--1154

  59. [59]

    and Mengersen, K

    Rousseau, J. and Mengersen, K. (2011). Asymptotic behaviour of the posterior distribution in overfitted mixture models. Journal of the Royal Statistical Society Series B: Statistical Methodology , 73(5):689--710

  60. [60]

    and Scricciolo, C

    Rousseau, J. and Scricciolo, C. (2024). Wasserstein convergence in Bayesian and frequentist deconvolution models . The Annals of Statistics , 52(4):1691--1715

  61. [61]

    Rudin, W. (1991). Functional Analysis . McGraw-Hill, New York, second edition

  62. [62]

    Schwartz, L. (1966). Th \'e orie des distributions . Hermann, Paris

  63. [63]

    Scricciolo, C. (2011). Posterior rates of convergence for Dirichlet mixtures of exponential power densities . Electronic Journal of Statistics , 5:270--308

  64. [64]

    Scricciolo, C. (2014). Adaptive Bayesian density estimation in Lp-metrics with Pitman-Yor or normalized inverse-Gaussian process kernel mixtures . Bayesian Analysis , 9(2):475--520

  65. [65]

    Scricciolo, C. (2018). Bayes and maximum likelihood for L1 -Wasserstein deconvolution of L aplace mixtures . Statistical Methods & Applications , 27(2):333--362

  66. [66]

    Sethuraman, J. (1994). A constructive definition of D irichlet priors. Statistica Sinica , 4:639--650

  67. [67]

    and Wasserman, L

    Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. The Annals of Statistics , 29(3):687--714

  68. [68]

    Teh, Y., Jordan, M., Beal, M., and Blei, D. (2006). Hierarchical D irichlet processes. Journal of the American Statistical Association , 101:1566--1581

  69. [69]

    Tokdar, S. T. (2006). Posterior consistency of D irichlet location-scale mixture of normals in density estimation and regression. Sankhy \=a : The Indian Journal of Statistics , 67(4):90--110

  70. [70]

    Tokdar, S. T. (2013). Adaptive Bayesian multivariate density estimation with Dirichlet mixtures . Biometrika , 100(3):623--640

  71. [71]

    Villani, C. (2003). Topics in Optimal Transportation . American Mathematical Society

  72. [72]

    Villani, C. (2008). Optimal transport: Old and New . Springer

  73. [73]

    Wade, S. (2023). Bayesian cluster analysis. Philosophical Transactions of the Royal Society A , 381(2247):20220149

  74. [74]

    Walker, S. G. (2004). New approaches to Bayesian consistency . The Annals of Statistics , 32(5):2028 -- 2043

  75. [75]

    Walker, S. G. (2007). Sampling the D irichlet mixture model with slices. Communications in Statistics—Simulation and Computation , 36(1):45--54

  76. [76]

    Walker, S. G. and Hjort, N. L. (2001). On B ayesian consistency. Journal of the Royal Statistical Society, Series B , 63:811--821

  77. [77]

    G., Lijoi, A., and Pr \"u nster, I

    Walker, S. G., Lijoi, A., and Pr \"u nster, I. (2007). On rates of convergence for posterior distributions in infinite-dimensional models . The Annals of Statistics , 35(2):738--746

  78. [78]

    Whitney, H. (1934). Analytic extensions of differentiable functions defined in closed sets. Transactions of the American Mathematical Society , 36:63

  79. [79]

    and Ghosal, S

    Wu, Y. and Ghosal, S. (2010). The L_1 -consistency of Dirichlet mixtures in multivariate Bayesian density estimation . Journal of Multivariate Analysis , 101(10):2411--2419

  80. [80]

    Xu, Y., M \"u ller, P., and Telesca, D. (2016). Bayesian inference for latent biologic structure with determinantal point processes (dpp). Biometrics , 72(3):955--964