REVIEW 2 major objections 6 minor 56 references
Dirichlet kernel density estimation on the simplex with missing data
T0 review · 2 major / 6 minor · reviewed 2026-07-15 · grok-4.5
Pith's one-line read Inverse-probability-weighted Dirichlet kernels estimate densities on the simplex under missing-at-random sampling without imputation.
desk verdict Solid, usable IPW Dirichlet KDE on the simplex under MAR; asymptotics check out and the p < d caveat is stated honestly. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The feasible IPW Dirichlet kernel estimator ˆf_n,b(s) = n^{-1} ∑ (δ_i / ˆπ_i) κ_{s,b}(Y_i), where κ_{s,b} is the adaptive Dirichlet kernel centered at s with bandwidth b and ˆπ_i is the Nadaraya–Watson estimate of the propensity score; its bias–variance expansions and asymptotic normality are derived by Taylor expansion of 1/ˆπ around 1/π together with the known L^{2} asymptotics of the Dirichlet kernel.
What would settle it
Generate data from a known Dirichlet mixture on the 2-simplex with a logistic MAR mechanism whose propensity is bounded away from zero, compute the IPW Dirichlet estimator with LSCV bandwidth, and check whether the Monte-Carlo mean integrated squared error tracks the predicted n^{-4/(d+4)} rate and whether the studentized estimator is approximately standard normal; systematic failure of either check would falsify the central asymptotic claim.
Extended reading notes
Core claim
Under a missing-at-random mechanism the inverse-probability-weighted Dirichlet kernel density estimator on the simplex has the same first-order bias expansion as the full-data Dirichlet estimator, while its variance is inflated only by the factor 1 + ζ(s) that encodes the variability of the inverse propensity weights; when the propensities themselves are estimated by Nadaraya–Watson regression the same leading asymptotics continue to hold whenever the covariate dimension is strictly smaller than the simplex dimension.
Load-bearing premise
The observation probability must stay bounded away from zero, and the number of continuous covariates must be smaller than the dimension of the simplex, otherwise the error from estimating the propensities swamps the density estimate.
Editorial extensions
If this is right
- Density estimation for microbiome or geochemical compositions can proceed by inverse-probability weighting without first imputing missing taxa or assays.
- The leading bias term is identical to the complete-data case, so existing bandwidth rules for Dirichlet kernels remain asymptotically valid under MAR.
- When covariates are low-dimensional relative to the simplex, nonparametric propensity estimation does not degrade the first-order rate of the density estimator.
- The same weighting-plus-Dirichlet construction immediately supplies a density estimate whose mode can be read as a typical compositional profile (as done for NHANES leukocytes).
Reading between the lines
- The p < d restriction suggests that, for high-dimensional metadata, practitioners will need either dimension reduction or a parametric propensity model before the asymptotic normality guarantee applies.
- The second-order variance reduction term −n^{-1}ξ(s) that appears when propensities are estimated hints that mild misspecification of π may still be tolerable at the rates considered here.
- Extending the same IPW-Dirichlet construction to structural zeros (common in microbiome data) would require only a zero-handling pre-step and would inherit the same bias expansion.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper develops inverse-probability-weighted Dirichlet kernel density estimators for compositional responses on the simplex under MAR missingness. It studies a pseudo estimator with known propensities and a feasible estimator that plugs in Nadaraya–Watson propensity estimates, derives pointwise bias/variance expansions, MSE rates, and asymptotic normality (with the feasible limit requiring p < d), and supports the theory with Monte Carlo experiments (two Dirichlet mixtures, n up to 800, missing rates up to 40%, 1000 replications) and an NHANES leukocyte-composition illustration. Simulations indicate that the IPW Dirichlet KDE outperforms IPW alr- and ilr-based KDEs for the chosen targets, and the application identifies a modal immune profile near (0.57, 0.32, 0.11).
Significance. If the asymptotics hold as stated, the paper cleanly extends Dirichlet kernel density estimation to incomplete compositional data without imputation, preserving nonnegativity and boundary behavior on the simplex. The bias of the pseudo estimator matches the full-data Dirichlet KDE by design of the Horvitz–Thompson weights, while MAR enters the variance through the explicit factor 1+ζ(s); the feasible estimator’s second-order variance reduction −n^{-1}ξ(s) is a useful efficiency observation. Strengths include full pointwise expansions and normality theorems, an IPW-adapted LSCV bandwidth criterion, a reproducible GitHub code repository, and a transparent real-data illustration. The contribution is incremental but well-executed for the nonparametric compositional-data literature and is of practical interest in microbiome, geochemistry, and survey settings where MAR is plausible.
major comments (2)
- Section 5.1 sets d=2 and p=2 (bivariate X and Y∈S²), so the Monte Carlo design operates at p=d. Theorem 4.8 and Remark 1 establish first-order asymptotic normality of the feasible estimator ˆfn,b only under p<d (so that the NW propensity rate is o of the Dirichlet rate). Finite-sample ISE comparisons remain informative, but the paper should either (i) add at least one configuration with p<d, (ii) explicitly flag that the reported simulations lie outside the regime of Theorem 4.8, or (iii) invoke the higher-order-kernel/Hölder extension sketched in Remark 1. Without one of these, the link between the feasible-estimator theory and the simulation design is incomplete.
- Assumption (A5) requires π≥π_min>0 on the support of X, and Section 7 recommends flooring or stabilizing extreme weights in practice. The simulation design (logistic MAR up to 40% missing) can produce small estimated propensities, yet the manuscript does not report whether a floor, truncation, or stabilized weights were used when computing ˆfn,b or LSCV. Because inverse-probability weights drive both the estimator and the bandwidth criterion (5.2), a short statement of the numerical safeguards (or confirmation that none were needed) is load-bearing for reproducibility of Tables 1–2 and Figures 6–8.
minor comments (6)
- Abstract and §5.4 claim outperformance “for certain target densities.” The two Dirichlet mixtures are reasonable but narrow; a brief caveat that the ranking may reverse for densities with strong boundary mass or multimodality would temper the claim.
- Figures 1–3 and 9 use placeholder-style glyphs in the manuscript text (e.g., boxes for axis labels). Ensure final production figures have readable axis labels, legends, and color scales; contour levels in Figures 2–3 would aid comparison of mode location and height.
- Notation: κs,b is introduced after the full-data estimator; a one-line reminder that it is the Dirichlet kernel with parameters s/b+1 and (1−∥s∥1)/b+1 would help readers less familiar with [44].
- Assumption (C1) on q(x)=E[κs,b(Y1)|X1=x] is used in the feasible-estimator proofs but is not discussed in the main text; a short remark that it is a standard smoothness condition on the smoothed regression of the kernel would improve transparency.
- NHANES analysis (§6) correctly notes that survey design weights and clustering are ignored. Consider adding one sentence on how the modal composition might change under design-based weighting, or flag this more prominently as a limitation for population inference.
- Typos/style: “Fr´ ed´ eric” and similar accented names appear with spacing artifacts in the author list; “H¨ older” in Remark 1; ensure consistent use of efn,b vs. ˆfn,b in the abstract and introduction.
Circularity Check
No significant circularity: IPW identities and standard kernel expansions yield the asymptotics; self-citations supply independent full-data Dirichlet lemmas, not the missing-data claims.
full rationale
The derivation chain is self-contained and non-circular. Under MAR, E[efn,b(s)] = E[κs,b(Y1)] by conditional independence and E[δ|X]=π(X), so Bias[efn,b] equals the full-data Dirichlet bias by Horvitz–Thompson construction (Prop. 4.1 / §8.1), not by fitting f. Variance follows from the law of total variance (8.1)–(8.3), producing the explicit IPW inflation factor 1+ζ(s); asymptotic normality uses a standard Lindeberg argument with the local kernel bound. For the feasible estimator, the Taylor expansion of 1/ˆπ, NW moment bounds, and the L2 comparison n^{1/2}b^{d/4}(ˆfn,b−efn,b)→0 when p<d are ordinary nonparametric calculations (Props. 4.5–4.6, Thm. 4.8). Citations to Ouimet–Tolosana-Delgado and related Dirichlet-kernel papers supply full-data bias/variance expansions and technical lemmas (L2 norm, max bound); those results do not include the MAR/IPW target and are not used as uniqueness or ansatz smuggling. Bandwidth LSCV and propensity estimation are data-driven tools for practice, not inputs that force the asymptotic statements. No self-definitional loop, fitted-as-prediction, or load-bearing uniqueness import appears.
Assumptions & free parameters
free parameters (3)
- Dirichlet bandwidth b
- Propensity bandwidth h
- LSCV candidate grid and ISE grid (res, ε)
assumptions (6)
- domain assumption Responses are MAR: P(δ=1|Y,X)=P(δ=1|X)=π(X).
- domain assumption π is bounded away from zero on {g>0} (A5).
- standard math Target density f is twice continuously differentiable on S_d (A3) for bias; Lipschitz (A2) for variance.
- domain assumption Covariate density g has bounded support and is bounded below on its support (A4); π and g have continuous bounded second derivatives (B2).
- ad hoc to paper For asymptotic normality of ˆfn,b, p < d so n^{-4/(p+4)}=o(n^{-4/(d+4)}).
- standard math Classical kernel K* is bounded, symmetric, with finite second moments (B3).
Cite this review
Pith. "Pith review of Dirichlet kernel density estimation on the simplex with missing data." pith.science (2026). https://pith.science/paper/3PBZE7MD
@misc{pith2026260307447,
author = {Pith},
title = {Pith review of: Dirichlet kernel density estimation on the simplex with missing data},
year = {2026},
howpublished = {\url{https://pith.science/paper/3PBZE7MD}},
note = {Machine review of arXiv:2603.07447}
}
read the original abstract
Nonparametric density estimation for compositional data supported on the simplex is examined under a missing at random mechanism. Rather than imputing missing values and estimating the density from a completed data set, we adopt a strategy based on inverse probability weighting. The proposed estimator uses an adaptive Dirichlet kernel, which ensures nonnegativity on the simplex and favorable behavior near the boundary. When the observation probabilities are unknown, they are estimated through a Nadaraya-Watson regression step. The large-sample properties of the estimator are derived, including pointwise bias and variance expansions, optimal smoothing rates, and asymptotic normality. A simulation study investigates its finite-sample performance under varying sample sizes and missing rates. Simulations show our method outperforms inverse-probability-weighted kernel density estimators based on additive and isometric log-ratio transformations of the data for certain target densities. The methodology is further illustrated through an application to leukocyte composition data from the National Health and Nutrition Examination Survey (NHANES), which allows for the identification of the modal immune profile in the sampled population.
Reference graph
Works this paper leans on
-
[1]
A. Aboubacar and C. C. Kokonendji. Asymptotic results for recursive multivariate associated-kernel estimators of the probability density mass function of a data stream.Comm. Statist. Theory Methods, 54(7):2109–2129, 2025.DOI:10.1080/03610926.2024.2360041
-
[2]
K. G. Abraham, A. Maitland, and S. M. Bianchi. Nonresponse in the american time use survey: Who is missing from the data and how much does it matter?Public Opin. Q., 70(5):676–703, 2006. DOI:10.1093/poq/nfl037
-
[3]
J. Aitchison. The statistical analysis of compositional data.J. R. Stat. Soc. Ser. B. Stat. Methodol., 44(2):139–160, 1982.DOI:10.1111/j.2517-6161.1982.tb01195.x
-
[4]
Aitchison.The statistical analysis of compositional data
J. Aitchison.The statistical analysis of compositional data. Monographs on Statistics and Applied Probability. Chapman & Hall, London, 1986. ISBN 0-412-28060-4.DOI:10.1007/978-94-009-410 9-0
-
[5]
J. Aitchison and I. J. Lauder. Kernel density estimation for compositional data.J. R. Stat. Soc. Ser. C. Appl. Stat., 34(2):129–137, 1985.DOI:10.2307/2347365
-
[6]
Alwadeai, S
A. Alwadeai, S. Khardani, S. Bouzebda, and W. Jedidi. Beta kernel density estimation with missing data.Preprint, 2026
2026
-
[7]
K. Bertin, C. Genest, N. Klutchnikoff, and F. Ouimet. Minimax properties of Dirichlet kernel density estimators.J. Multivariate Anal., 195:Paper No. 105158, 16 pp., 2023.DOI:10.1016/j.jmva.202 3.105158
-
[8]
S. Bouzebda, A. Nezzal, and I. Elhattab. Limit theorems for nonparametric conditionalU-statistics smoothed by asymmetric kernels.AIMS Math., 9(9):26195–26282, 2024.DOI:10.3934/math.20241 280. 29
Show all 56 references
-
[9]
Buonacera, B
A. Buonacera, B. Stancanelli, M. Colaci, and L. Malatino. Neutrophil to lymphocyte ratio: An emerging marker of the relationships between the immune system and diseases.Int. J. Mol. Sci., 23 (7):3636, 2022.DOI:10.3390/ijms23073636
2022 doi
-
[10]
E. J. M. Carranza. Analysis and mapping of geochemical anomalies using logratio-transformed stream sediment data with censored values.J. Geochem. Explor., 110(2):167–185, 2011.DOI: 10.1016/j.gexplo.2011.05.007
2011 doi
-
[11]
J. E. Chac´ on, G. Mateu-Figueras, and J. A. Mart´ ın-Fern´ andez. Gaussian kernels for density estima- tion with compositional data.Comput. Geosci., 37(5):702–711, 2011.DOI:10.1016/j.cageo.2009 .12.011
2011 doi
-
[12]
S. F. M. Chastin, J. Palarea-Albaladejo, M. L. Dontje, and D. A. Skelton. Combined effects of time spent in physical activity, sedentary behaviors and sleep on obesity and cardio-metabolic health markers: A novel compositional data analysis approach.PLoS One, 10(10):e0139984, ...
2015 doi
-
[13]
Daayeb and F
H. Daayeb and F. Ouimet. DirichletKDEMissingData, 2026. GitHub repository available online at https://github.com/FredericOuimetMcGill/DirichletKDEMissingData
2026
- [14]
-
[15]
Daayeb, S
H. Daayeb, S. Khardani, and F. Ouimet. Dirichlet kernel density estimation for strongly mixing sequences on the simplex.To appear in Math. Methods Statist., 2026.DOI:10.48550/arXiv.2506. 08816
2026 doi
- [16]
-
[17]
J. J. Egozcue, V. Pawlowsky-Glahn, G. Mateu-Figueras, and C. Barcel´ o-Vidal. Isometric logratio transformations for compositional data analysis.Math. Geol., 35(3):279–300, 2003.DOI:10.1023/A: 1023818214614
2003 doi
-
[18]
Endres, L
C. Endres, L. Ale, R. Gentleman, and D. Sarkar. nhanesA: NHANES Data Retrieval, 2025. R package version 1.4. doi:10.32614/CRAN.package.nhanesA
2025 doi
-
[19]
Ertefaie, N
A. Ertefaie, N. S. Hejazi, and M. J. van der Laan. Nonparametric inverse-probability-weighted estimators based on the highly adaptive lasso.Biometrics, 79(2):1029–1041, 2023.DOI:10.1111/bi om.13719
2023 doi
-
[20]
Esstafa, C
Y. Esstafa, C. C. Kokonendji, and T.-B.-T. Ngˆ o. Asymptotic properties of continuous associated- kernel density estimators.Comm. Statist. Theory Methods, 55(5):1568–1588, 2026.DOI:10.1080/ 03610926.2025.2530135
2026
-
[21]
T. H. I. Fakhouri, C. B. Martin, T. C. Chen, L. J. Akinbami, C. L. Ogden, R. Paulose-Ram, M. K. Riddles, W. Van de Kerckhove, S. B. Roth, J. Clark, L. K. Mohadjer, and R. E. Fay. An investigation of nonresponse bias and survey location variability in the 2017–2018 national hea...
2017
-
[22]
Forget, C
P. Forget, C. Khalifa, J.-P. Defour, D. Latinne, M.-C. Van Pel, and M. De Kock. What is the normal value of the neutrophil-to-lymphocyte ratio?BMC Res. Notes, 10(1):12, 2017.DOI:10.1186/s131 04-016-2335-5
2017 doi
-
[23]
Funke and R
B. Funke and R. Kawka. Nonparametric density estimation for multivariate bounded data using two non-negative multiplicative bias correction methods.Comput. Statist. Data Anal., 92:148–162, 2015. DOI:10.1016/j.csda.2015.07.006
2015 doi
-
[24]
G. Geenens. Explicit formula for asymptotic higher moments of the Nadaraya-Watson estimator. Sankhya A, 76(1):77–100, 2014.DOI:10.1007/s13171-013-0035-y
2014 doi
-
[25]
Genest and F
C. Genest and F. Ouimet. Local linear smoothing for regression surfaces on the simplex using Dirichlet kernels.Statist. Papers, 66(4):97, 2025.DOI:10.1007/s00362-025-01708-8. 30
2025 doi
- [26]
-
[27]
G. B. Gloor, J. M. Macklaim, V. Pawlowsky-Glahn, and J. J. Egozcue. Microbiome datasets are compositional: And this is not optional.Front. Microbiol., 8:6 pp., 2017.DOI:10.3389/fmicb.20 17.02224
2017 doi
-
[28]
R. M. Groves and E. Peytcheva. The impact of nonresponse rates on nonresponse bias: A meta- analysis.Public Opin. Q., 72(2):167–189, 2008.DOI:10.1093/poq/nfn011
2008 doi
-
[29]
E. C. Grunsky and P. de Caritat. State-of-the-art analysis of geochemical data for mineral explo- ration.Geochem.: Explor. Environ. Anal., 20(2):217–232, 2020.DOI:10.1144/geochem2019-031
2020 doi
-
[30]
Gueorguieva, R
R. Gueorguieva, R. Rosenheck, and D. Zelterman. Dirichlet component regression and its applications to psychiatric data.Comput. Statist. Data Anal., 52(12):5344–5355, 2008.DOI:10.1016/j.csda.2 008.05.030
2008 doi
-
[31]
D. G. Horvitz and D. J. Thompson. A generalization of sampling without replacement from a finite universe.J. Amer. Statist. Assoc., 47(260):663–685, 1952.DOI:10.1080/01621459.1952.10483446
1952 doi
-
[32]
K. Hron, M. Templ, and P. Filzmoser. Imputation of missing values for compositional data using classical and robust methods.Comput. Statist. Data Anal., 54(12):3095–3107, 2010.DOI:10.1016/ j.csda.2009.11.023
2010
-
[33]
Z. Hu, D. A. Follmann, and J. Qin. Semiparametric dimension reduction estimation for mean response with missing data.Biometrika, 97(2):305–319, 2010.DOI:10.1093/biomet/asq005
2010 doi
-
[34]
Structure, function and diversity of the healthy human microbiome.Nature, 486:207–214, 2012.DOI:10.1038/nature11234
Human Microbiome Project Consortium. Structure, function and diversity of the healthy human microbiome.Nature, 486:207–214, 2012.DOI:10.1038/nature11234
2012 doi
-
[35]
Jiang, W
R. Jiang, W. V. Li, and J. J. Li. mbImpute: an accurate and robust imputation method for microbiome data.Genome Biol., 22:192, 2021.DOI:10.1186/s13059-021-02400-4
2021 doi
-
[36]
C. C. Kokonendji and S. M. Som´ e. On multivariate associated kernels to estimate general density functions.J. Korean Statist. Soc., 47(1):112–126, 2018.DOI:10.1016/j.jkss.2017.10.002
2018 doi
-
[37]
C. C. Kokonendji and S. M. Som´ e. Bayesian bandwidths in semiparametric modelling for nonnegative orthant data with diagnostics.Stats, 4(1):162–183, 2021.DOI:10.3390/stats4010013
2021 doi
-
[38]
Kratz, M
A. Kratz, M. Ferraro, P. M. Sluss, and K. B. Lewandrowski. Normal reference laboratory values.N. Engl. J. Med., 351(15):1548–1563, 2004.DOI:10.1056/NEJMcpc049016
2004 doi
-
[39]
M. L. C. Leite. Applying compositional data methodology to nutritional epidemiology.Stat. Methods Med. Res., 25(6):3057–3065, 2016.DOI:10.1177/0962280214560047
2016 doi
-
[40]
R. J. A. Little and D. B. Rubin.Statistical Analysis with Missing Data. John Wiley & Sons, 3rd edition, 2019. ISBN 9780470526798.DOI:10.1002/9781119482260
2019 doi
-
[41]
J. A. Mart´ ın-Fern´ andez, C. Barcel´ o-Vidal, and V. Pawlowsky-Glahn. Dealing with zeros and missing values in compositional data sets using nonparametric imputation.Math. Geol., 35(3):253–278, 2003. DOI:10.1023/A:1023866030544
2003 doi
-
[42]
F. Ouimet. Asymptotic properties of Bernstein estimators on the simplex.J. Multivariate Anal., 185:Paper No. 104784, 20 pp., 2021.DOI:10.1016/j.jmva.2021.104784
2021 doi
-
[43]
F. Ouimet. On the boundary properties of Bernstein estimators on the simplex.Open Stat., 3(1): 48–62, 2022.DOI:10.1515/stat-2022-0111
2022 doi
-
[44]
Ouimet and R
F. Ouimet and R. Tolosana-Delgado. Asymptotic properties of Dirichlet kernel density estimators. J. Multivariate Anal., 187:Paper No. 104832, 25 pp., 2022.DOI:10.1016/j.jmva.2021.104832
2022 doi
-
[45]
Pal and C
S. Pal and C. Heumann. Clustering compositional data using Dirichlet mixture model.PLoS One, 17(5):e0268438, 2022.DOI:10.1371/journal.pone.0268438
2022 doi
-
[46]
Palarea-Albaladejo and J
J. Palarea-Albaladejo and J. A. Mart´ ın-Fern´ andez. Values below detection limit in compositional chemical data.Anal. Chim. Acta, 764:32–43, 2013.DOI:10.1016/j.aca.2012.12.029. 31
2013 doi
-
[47]
Pawlowsky-Glahn, J
V. Pawlowsky-Glahn, J. Egozcue, and R. Tolosana-Delgado.Modeling and Analysis of Compositional Data. John Wiley & Sons, Ltd, Chichester, UK, 2015. ISBN 978-1-118-44306-4.DOI:10.1002/9781 119003144
2015 doi
-
[48]
Peleg and E
O. Peleg and E. Borenstein. Interpolation of microbiome composition in longitudinal data sets. mBio, 15(9):e01150–24, 2024.DOI:10.1128/mbio.01150-24
2024 doi
-
[49]
J. M. Robins. Correcting for non-compliance in randomized trials using structural nested mean models.Comm. Statist. Theory Methods, 23(8):2379–2412, 1994.DOI:10.1080/03610929408831393
1994 doi
-
[50]
D. B. Rubin. Inference and missing data.Biometrika, 63(3):581–592, 1976.DOI:10.1093/biomet /63.3.581
1976 doi
-
[51]
S. R. Seaman and I. R. White. Review of inverse probability weighting for dealing with missing data.Stat. Methods Med. Res., 22(3):278–295, 2013.DOI:10.1177/0962280210395740
2013 doi
-
[52]
Tenbusch
A. Tenbusch. Two-dimensional Bernstein polynomial density estimators.Metrika, 41:233–253, 1994. DOI:10.1007/BF01895321
1994 doi
-
[53]
A. A. Tsiatis.Semiparametric Theory and Missing Data. Springer, 2006.DOI:10.1007/0-387-373 45-4
2006 doi
-
[54]
Vega-G´ amez and P
F. Vega-G´ amez and P. J. Alonso-Gonz´ alez. How likely is it to beat the target at different investment horizons: an approach using compositional data in strategic portfolios.Financ Innov, 10:125, 2024. DOI:10.1186/s40854-023-00601-3
2024 doi
-
[55]
L. Wang. Dimension reduction for kernel-assisted M-estimators with missing response at random. Ann. Inst. Stat. Math., 71(4):889–910, 2019.DOI:10.1007/s10463-018-0664-y
2019 doi
-
[56]
J. Xie, Y. Wang, and E. Garc´ ıa-Portugu´ es. Density estimation for compositional data using non- parametric mixtures.arXiv e-prints, 2025.DOI:10.48550/arXiv.2510.07608. 32
2025 doi
Reviewed July 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.