Convergence Rates for Latent Mixing Measures in Infinite Homoscedastic Location-Scale Mixture Models
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel 2026-06-30 23:00 UTCgrok-4.3pith:SWCAX6XUrecord.jsonopen to challenge →
The pith
The paper establishes the first contraction rates for latent mixing measures in infinite homoscedastic location-scale mixture models with unknown shared scale by deriving new lower bounds on the L1 distance between densities.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Posterior contraction rates for mixing measures in homoscedastic location-scale mixture models with infinitely many components are obtained by bounding the L1 distance between mixture densities in terms of Wasserstein distances between mixing measures and operator norm discrepancies between scale matrices, with the bounds determined by the decay rate of the kernel's characteristic function and a PDE inversion condition for sharper results in ordinary-smooth cases. This leads to the first such rates for Dirichlet process mixtures where the scale parameter is unknown and shared across components.
What carries the argument
Novel lower-bounds connecting the L1 distance between mixture densities to Wasserstein distances and operator norm discrepancies between mixing measures and scale matrices, derived from the dual formulation of W1 distance and functional-analytic techniques.
If this is right
- Contraction rates hold for Dirichlet process mixtures with unknown shared scale parameter.
- The convergence rate of the location mixing measure can differ from that of the scale parameter depending on the kernel.
- The strength of the inequalities is governed by the rate of decay of the characteristic function of the mixture kernel.
- A PDE inversion condition provides sharper inequalities for ordinary-smooth kernels like Laplace.
Where Pith is reading between the lines
- The techniques could potentially extend to heteroscedastic models if similar bounds can be established.
- These rates might guide the choice of priors in Bayesian mixture modeling for better posterior concentration.
- Numerical simulations on synthetic data with known mixing measures could verify the predicted rates for different kernels.
Load-bearing premise
A key lower-bound exists on the L1 metric that involves the operator norm discrepancy between scale parameters.
What would settle it
A counterexample where the L1 distance between two mixture densities is small but the operator norm difference between their scale matrices is large would falsify the key inequality and thus the contraction rates.
read the original abstract
We study posterior contraction rates for mixing measures in homoscedastic location-scale mixture models with infinitely many components. While posterior convergence at the level of densities is well understood, ensuring convergence of the latent mixing measure is more challenging and has remained an open problem in settings where both location and scale parameters are unknown. We address this by deriving novel lower-bounds that connect the $L^1$ distance between mixture densities to discrepancies, based on the Wasserstein distances and the operator norm, between the underlying mixing measures and scale matrices. Our approach combines the dual formulation of the $W_1$ distance with functional-analytic approximation techniques. This leads to general inequalities, whose strength is determined (i) by the smoothness of the mixture kernel via the rate of decay of its characteristic function, and (ii) by a key lower-bound on the $L^1$ metric involving the operator norm discrepancy between scale parameters. Moreover, a novel PDE inversion condition yields a sharper inequality for important ordinary-smooth cases. We specialize these bounds to popular mixtures based on multivariate Gaussian, Cauchy, and Laplace kernels. As a consequence, we obtain first-of-their-kind contraction rates in the context of Dirichlet process mixtures with an unknown scale parameter shared across components. As a byproduct of our inequalities, we can distinguish the convergence behavior of the location mixing measure from that of the scale parameter across a range of kernel choices, leading to nuanced insights into their respective rates.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper studies posterior contraction rates for mixing measures in homoscedastic location-scale mixture models with infinitely many components and unknown shared scale. It derives novel lower bounds connecting the L1 distance between mixture densities to Wasserstein distances and operator norm discrepancies between the mixing measures, using the dual W1 formulation and functional-analytic approximation techniques. A novel PDE inversion condition is introduced for ordinary-smooth cases, leading to sharper inequalities. The bounds are specialized to Gaussian, Cauchy, and Laplace kernels, yielding first contraction rates for Dirichlet process mixtures with unknown scale, and distinguishing convergence of location and scale parameters.
Significance. If the derived inequalities and resulting contraction rates hold, this work fills an important gap in Bayesian nonparametric statistics by providing the first results on mixing measure convergence in location-scale mixtures with unknown scale. The technical approach combining dual Wasserstein formulation with PDE inversion is innovative and could have broader applications. The ability to obtain nuanced rates for location versus scale is a notable contribution. The paper ships theoretical derivations that are parameter-free in the sense of not relying on fitted quantities.
major comments (1)
- Abstract (paragraph on general inequalities): the key lower-bound on the L1 metric involving the operator norm discrepancy between scale parameters is load-bearing for the general inequalities and thus for the contraction rates; the manuscript should provide an explicit statement and proof of this bound, including the conditions under which it holds, to allow assessment of its validity for the specialized kernels.
minor comments (2)
- Consider adding a table or summary figure comparing the contraction rates across the different kernels (Gaussian, Cauchy, Laplace) for location and scale to improve readability of the results.
- The abstract could be clarified by separating the description of the method from the consequences more distinctly.
Simulated Author's Rebuttal
We thank the referee for the positive evaluation and the constructive comment on the abstract. We address the point below.
read point-by-point responses
-
Referee: [—] Abstract (paragraph on general inequalities): the key lower-bound on the L1 metric involving the operator norm discrepancy between scale parameters is load-bearing for the general inequalities and thus for the contraction rates; the manuscript should provide an explicit statement and proof of this bound, including the conditions under which it holds, to allow assessment of its validity for the specialized kernels.
Authors: We agree that an explicit statement of this central lower bound will improve accessibility. The bound itself (connecting L1 density distance to the operator-norm discrepancy on scale parameters) is stated and proved as Theorem 3.2 under the stated conditions on the kernel characteristic function and the PDE inversion property for ordinary-smooth kernels. In the revision we will insert a concise, self-contained statement of the bound (with its precise hypotheses) immediately after the abstract paragraph in question and add a forward reference to the proof in Section 3. This is a minor clarification that does not alter any results or proofs. revision: yes
Circularity Check
No significant circularity; derivation self-contained
full rationale
The paper derives novel lower bounds on L1 distances between mixture densities in terms of Wasserstein and operator-norm discrepancies between mixing measures, using the dual W1 formulation, functional-analytic approximations, and a PDE inversion condition for ordinary-smooth kernels. These inequalities are then specialized to Gaussian, Cauchy, and Laplace kernels to obtain contraction rates for Dirichlet process mixtures with shared unknown scale. No quoted step reduces a claimed prediction or rate to a fitted parameter, self-defined quantity, or load-bearing self-citation by construction; the central results are presented as independent analytic derivations from the stated assumptions on kernel smoothness and metric lower bounds.
Axiom & Free-Parameter Ledger
axioms (3)
- domain assumption smoothness of the mixture kernel via the rate of decay of its characteristic function
- domain assumption key lower-bound on the L1 metric involving the operator norm discrepancy between scale parameters
- ad hoc to paper novel PDE inversion condition for ordinary-smooth cases
Forward citations
Cited by 1 Pith paper
-
Posterior concentration and adaptation of the mixing measure in Dirichlet process mixtures
In the well-specified case, the posterior mass on extra components beyond the true K vanishes at rate n^{-1/2}, yielding nearly optimal Wasserstein contraction for the mixing measure and logarithmic cluster growth wit...
Reference graph
Works this paper leans on
-
[1]
Ascolani, F., Lijoi, A., Rebaudo, G., and Zanella, G. (2023). Clustering consistency with Dirichlet process mixtures . Biometrika , 110(2):551--558
work page 2023
- [2]
-
[3]
Barron, A., Schervish, M., and Wasserman, L. (1999). The consistency of posterior distributions in nonparametric problems. The Annals of Statistics , 27:536--561
work page 1999
-
[4]
Butzer, P. L. and Nessel, R. J. (1971). Fourier analysis and approximation, Vol. 1 , volume 7. Birkh \"a user Basel
work page 1971
-
[5]
Caillerie, C., Chazal, F., Dedecker, J., and Michel, B. (2011). Deconvolution for the W asserstein metric and geometric inference. Electronic Journal of Statistics , 5:1394--1423
work page 2011
-
[6]
Canale, A. and De Blasi, P. (2017). Posterior asymptotics of nonparametric location-scale mixtures for multivariate density estimation. Bernoulli , 23(1):379--404
work page 2017
-
[7]
Castillo, I. (2024). Bayesian Nonparametric Statistics . École d’Été de Probabilités de Saint-Flour LI - 2023. Springer Nature
work page 2024
-
[8]
Catalano, M. and Lavenant, H. (2025). Measures of dependence based on W asserstein distances. arXiv preprint arXiv:2510.06034
-
[9]
Catalano, M., Lavenant, H., Lijoi, A., and Pr \"u nster, I. (2024). A W asserstein index of dependence for random measures. Journal of the American Statistical Association , 119(547):2396--2406
work page 2024
-
[10]
Catalano, M., Lijoi, A., and Pr \"u nster, I. (2021). Measuring dependence in the Wasserstein distance for Bayesian nonparametric models . The Annals of Statistics , 49(5):2916--2947
work page 2021
-
[11]
Chae, M. and Walker, S. G. (2017). A novel approach to Bayesian consistency . Electronic Journal of Statistics , 11(2):4723--4745
work page 2017
-
[12]
H., Pr \"u nster, I., and Ruggiero, M
De Blasi, P., Favaro, S., Lijoi, A., Mena, R. H., Pr \"u nster, I., and Ruggiero, M. (2015). Are Gibbs -type priors the most natural generalization of the Dirichlet process? IEEE Transactions on Pattern Analysis and Machine Intelligence , 37(2):212--229
work page 2015
-
[13]
Dedecker, J., Fischer, A., and Michel, B. (2015). Improved rates for W asserstein deconvolution with ordinary smooth error in dimension one. Electronic Journal of Statistics , 9(1):234--265
work page 2015
-
[14]
Dedecker, J. and Michel, B. (2013). Minimax rates of convergence for W asserstein deconvolution with supersmooth errors in any dimension. Journal of Multivariate Analysis , 122:278--291
work page 2013
-
[15]
DeVore, R. A. and Lorentz, G. G. (1993). Constructive approximation , volume 303. Springer Science & Business Media
work page 1993
-
[16]
Escobar, M. D. and West, M. (1995). Bayesian density estimation and inference using mixtures. Journal of the American Statistical Association , 90(430):577--588
work page 1995
-
[17]
Ferguson, T. (1973). A B ayesian analysis of some nonparametric problems. The Annals of Statistics , 1:209--230
work page 1973
-
[18]
Ferguson, T. S. (1983). Bayesian density estimation by mixtures of normal distributions. In Recent advances in statistics , pages 287--302. Elsevier
work page 1983
-
[19]
Folland, G. B. (1999). Real analysis: modern techniques and their applications . John Wiley & Sons
work page 1999
-
[20]
Fraley, C. and Raftery, A. E. (2002). Model-based clustering, discriminant analysis, and density estimation. Journal of the American Statistical Association , 97(458):611--631
work page 2002
- [21]
-
[22]
Gao, F. and van der Vaart, A. (2016). Posterior contraction rates for deconvolution of Dirichlet-Laplace mixtures. Electronic Journal of Statistics , 10(1):608--627
work page 2016
-
[23]
Genovese, C. R. and Wasserman, L. (2000). Rates of convergence for the Gaussian mixture sieve . The Annals of Statistics , 28(4):1105--1127
work page 2000
-
[24]
Ghosal, S., Ghosh, J. K., and Ramamoorthi, R. V. (1999). Posterior consistency of D irichlet mixtures in density estimation. The Annals of Statistics , 27:143--158
work page 1999
-
[25]
Ghosal, S., Ghosh, J. K., and van der Vaart, A. (2000). Convergence rates of posterior distributions. The Annals of Statistics , 28:500--531
work page 2000
-
[26]
Ghosal, S. and van der Vaart, A. (2007a). Convergence rates of posterior distributions for noniid observations . The Annals of Statistics , 35(1):192 -- 223
-
[27]
Ghosal, S. and van der Vaart, A. (2007b). Posterior convergence rates of D irichlet mixtures at smooth densities. The Annals of Statistics , 35:697--723
-
[28]
Ghosal, S. and Van der Vaart, A. (2017). Fundamentals of nonparametric Bayesian inference , volume 44. Cambridge University Press
work page 2017
-
[29]
Ghosal, S. and van der Vaart, A. W. (2001). Entropies and rates of convergence for maximum likelihood and B ayes estimation for mixtures of normal densities. The Annals of Statistics , 29(5):1233--1263
work page 2001
-
[30]
Gin \'e , E. and Nickl, R. (2011). Rates of contraction for posterior distributions in L^r -metrics, 1 r . The Annals of Statistics , 39(6):2883 -- 2911
work page 2011
-
[31]
Gnedin, A. and Pitman, J. (2006). Exchangeable Gibbs partitions and Stirling triangles . Journal of Mathematical Sciences , 138(3):5674--5685
work page 2006
-
[32]
Guha, A., Ho, N., and Nguyen, X. (2021). On posterior contraction of parameters and interpretability in Bayesian mixture modeling. Bernoulli , 27(4):2159--2188
work page 2021
-
[33]
Heinonen, J. (2001). Lectures on analysis on metric spaces . Springer Science & Business Media
work page 2001
-
[34]
Ho, N. and Nguyen, X. (2016a). Convergence rates of parameter estimation for some weakly identifiable finite mixtures. The Annals of Statistics , 44:2726--2755
-
[35]
Ho, N. and Nguyen, X. (2016b). On strong identifiability and convergence rates of parameter estimation in finite mixtures. Electronic Journal of Statistics , 10:271--307
-
[36]
Kingman, J. F. (1978). The representation of partition structures. Journal of the London Mathematical Society , 2(2):374--380
work page 1978
-
[37]
Kingman, J. F. C. (1967). Completely random measures. Pacific Journal of Mathematics , 21(1):59--78
work page 1967
-
[38]
Lee, J. M. (2013). Introduction to Smooth Manifolds , volume 218 of Graduate Texts in Mathematics . Springer, New York, 2 edition
work page 2013
-
[39]
Lijoi, A., Mena, R. H., and Pr \"u nster, I. (2005a). Hierarchical mixture modeling with normalized inverse- Gaussian priors. Journal of the American Statistical Association , 100(472):1278--1291
-
[40]
Lijoi, A., Nipoti, B., and Pr \"u nster, I. (2014). Bayesian inference with dependent normalized completely random measures. Bernoulli , pages 1260--1291
work page 2014
-
[41]
u nster, I. (2010). Models beyond the Dirichlet process. In Hjort, N. L., Holmes, C., M \
Lijoi, A. and Pr \"u nster, I. (2010). Models beyond the Dirichlet process. In Hjort, N. L., Holmes, C., M \"u ller, P., and Walker, S. G., editors, Bayesian Nonparametrics , pages 80--136. Cambridge University Press
work page 2010
-
[42]
Lijoi, A., Pr \"u nster, I., and Walker, S. G. (2005b). On consistency of nonparametric normal mixtures for B ayesian density estimation. Journal of the American Statistical Association , 100(472):1292--1296
-
[43]
Lo, A. Y. (1984). On a Class of Bayesian Nonparametric Estimates: I. Density Estimates . The Annals of Statistics , 12(1):351--357
work page 1984
-
[44]
MacEachern, S. N. and M \"u ller, P. (1998). Estimating mixture of D irichlet process models. Journal of Computational and Graphical Statistics , 7(2):223--238
work page 1998
-
[45]
Majumdar, S. (1992). On topological support of D irichlet prior. Statistics & Probability Letters , 15(5):381--384
work page 1992
-
[46]
McLachlan, G. J. and Peel, D. (2000). Finite Mixture Models . John Wiley & Sons
work page 2000
-
[47]
McShane, E. J. (1934). Extension of range of functions. Bulletin of the American Mathematical Society , 40:837--842
work page 1934
-
[48]
Miller, J. W. and Harrison, M. T. (2013). A simple example of D irichlet process mixture inconsistency for the number of components. In Advances in Neural Information Processing Systems , volume 26
work page 2013
-
[49]
Miller, J. W. and Harrison, M. T. (2014). Inconsistency of P itman-- Y or process mixtures for the number of components. Journal of Machine Learning Research , 15:3333--3370
work page 2014
-
[50]
Neal, R. M. (2000). Markov chain sampling methods for Dirichlet process mixture models . Journal of Computational and Graphical Statistics , 9(2):249--265
work page 2000
-
[51]
Nguyen, X. (2013). Convergence of latent mixing measures in finite and infinite mixture models. The Annals of Statistics , 4(1):370--400
work page 2013
-
[52]
E., Pr \"u nster, I., and Walker, S
Nieto-Barajas, L. E., Pr \"u nster, I., and Walker, S. G. (2004). Normalized random measures driven by increasing additive processes. The Annals of Statistics , 32(6):2343--2360
work page 2004
-
[53]
Perman, M., Pitman, J., and Yor, M. (1992). Size-biased sampling of Poisson point processes and excursions. Probability Theory and Related Fields , 92(1):21--39
work page 1992
-
[54]
Petralia, F., Rao, V., and Dunson, D. (2012). Repulsive mixtures. Advances in neural information processing systems , 25
work page 2012
-
[55]
Pitman, J. (1996). Some developments of the Blackwell-MacQueen urn scheme. In Statistics, Probability and Game Theory: Papers in Honor of David Blackwell , volume 30, pages 245--267. Institute of Mathematical Statistics
work page 1996
-
[56]
Pitman, J. and Yor, M. (1997). The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator. The Annals of Probability , 25(2):855--900
work page 1997
-
[57]
Regazzini, E., Lijoi, A., and Pr \"u nster, I. (2003). Distributional results for means of normalized random measures with independent increments. The Annals of Statistics , 31(2):560--585
work page 2003
-
[58]
Rodriguez, A., Dunson, D. B., and Gelfand, A. E. (2008). The nested D irichlet process. Journal of the American Statistical Association , 103(483):1131--1154
work page 2008
-
[59]
Rousseau, J. and Mengersen, K. (2011). Asymptotic behaviour of the posterior distribution in overfitted mixture models. Journal of the Royal Statistical Society Series B: Statistical Methodology , 73(5):689--710
work page 2011
-
[60]
Rousseau, J. and Scricciolo, C. (2024). Wasserstein convergence in Bayesian and frequentist deconvolution models . The Annals of Statistics , 52(4):1691--1715
work page 2024
-
[61]
Rudin, W. (1991). Functional Analysis . McGraw-Hill, New York, second edition
work page 1991
-
[62]
Schwartz, L. (1966). Th \'e orie des distributions . Hermann, Paris
work page 1966
-
[63]
Scricciolo, C. (2011). Posterior rates of convergence for Dirichlet mixtures of exponential power densities . Electronic Journal of Statistics , 5:270--308
work page 2011
-
[64]
Scricciolo, C. (2014). Adaptive Bayesian density estimation in Lp-metrics with Pitman-Yor or normalized inverse-Gaussian process kernel mixtures . Bayesian Analysis , 9(2):475--520
work page 2014
-
[65]
Scricciolo, C. (2018). Bayes and maximum likelihood for L1 -Wasserstein deconvolution of L aplace mixtures . Statistical Methods & Applications , 27(2):333--362
work page 2018
-
[66]
Sethuraman, J. (1994). A constructive definition of D irichlet priors. Statistica Sinica , 4:639--650
work page 1994
-
[67]
Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. The Annals of Statistics , 29(3):687--714
work page 2001
-
[68]
Teh, Y., Jordan, M., Beal, M., and Blei, D. (2006). Hierarchical D irichlet processes. Journal of the American Statistical Association , 101:1566--1581
work page 2006
-
[69]
Tokdar, S. T. (2006). Posterior consistency of D irichlet location-scale mixture of normals in density estimation and regression. Sankhy \=a : The Indian Journal of Statistics , 67(4):90--110
work page 2006
-
[70]
Tokdar, S. T. (2013). Adaptive Bayesian multivariate density estimation with Dirichlet mixtures . Biometrika , 100(3):623--640
work page 2013
-
[71]
Villani, C. (2003). Topics in Optimal Transportation . American Mathematical Society
work page 2003
-
[72]
Villani, C. (2008). Optimal transport: Old and New . Springer
work page 2008
-
[73]
Wade, S. (2023). Bayesian cluster analysis. Philosophical Transactions of the Royal Society A , 381(2247):20220149
work page 2023
-
[74]
Walker, S. G. (2004). New approaches to Bayesian consistency . The Annals of Statistics , 32(5):2028 -- 2043
work page 2004
-
[75]
Walker, S. G. (2007). Sampling the D irichlet mixture model with slices. Communications in Statistics—Simulation and Computation , 36(1):45--54
work page 2007
-
[76]
Walker, S. G. and Hjort, N. L. (2001). On B ayesian consistency. Journal of the Royal Statistical Society, Series B , 63:811--821
work page 2001
-
[77]
G., Lijoi, A., and Pr \"u nster, I
Walker, S. G., Lijoi, A., and Pr \"u nster, I. (2007). On rates of convergence for posterior distributions in infinite-dimensional models . The Annals of Statistics , 35(2):738--746
work page 2007
-
[78]
Whitney, H. (1934). Analytic extensions of differentiable functions defined in closed sets. Transactions of the American Mathematical Society , 36:63
work page 1934
-
[79]
Wu, Y. and Ghosal, S. (2010). The L_1 -consistency of Dirichlet mixtures in multivariate Bayesian density estimation . Journal of Multivariate Analysis , 101(10):2411--2419
work page 2010
-
[80]
Xu, Y., M \"u ller, P., and Telesca, D. (2016). Bayesian inference for latent biologic structure with determinantal point processes (dpp). Biometrics , 72(3):955--964
work page 2016
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.