Adjusted Wasserstein distances for bridging empirical and true distributions with applications to MDS
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel 2026-06-30 04:54 UTCgrok-4.3pith:6JAYFJDRrecord.jsonopen to challenge →
The pith
Max-D-SW aggregates sliced Wasserstein distances over orthonormal bases to improve MDS embeddings, especially for heavy-tailed data, while retaining comparable sample complexity.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Max-D-SW aggregates contributions over orthonormal bases rather than optimizing over single unit directions. This modification yields a clear numerical advantage in MDS outcomes, particularly for heavy-tailed distributions. Sample-complexity bounds remain statistically tractable and comparable to those of the max-sliced counterpart. Better sample complexity for a metric does not necessarily translate into better performance when that metric serves as input to MDS.
What carries the argument
Max-D-SW distance, formed by aggregating sliced Wasserstein distances over orthonormal bases instead of maximizing over single directions.
If this is right
- MDS embeddings computed with Max-D-SW exhibit improved numerical outcomes relative to those using the max-sliced Wasserstein distance.
- The improvement appears most clearly when the underlying data follow heavy-tailed distributions.
- Sample-complexity rates for Max-D-SW match the order of the max-sliced version, keeping the method statistically tractable.
- Superior sample complexity of a metric does not guarantee superior MDS performance when the metric is supplied as input.
Where Pith is reading between the lines
- The aggregation step may capture directional information that single-direction maximization misses, offering a route to more stable embeddings when tails are heavy.
- The observed gap between statistical rates and task performance suggests that metric design for visualization should be evaluated directly on the downstream embedding task rather than on general convergence bounds.
- Similar base-aggregation adjustments could be tested on other sliced or projected distances used in nonlinear dimensionality reduction.
Load-bearing premise
Aggregating sliced Wasserstein distances over orthonormal bases produces a metric whose empirical behavior inside MDS is reliably superior for heavy-tailed data without introducing compensating distortions.
What would settle it
A controlled MDS experiment on heavy-tailed synthetic data in which Max-D-SW embeddings show equal or worse stress or visual quality than max-sliced Wasserstein embeddings would falsify the claimed numerical advantage.
Figures
read the original abstract
This paper examines how metric adjustments to Multidimensional Scaling (MDS) can enhance its effectiveness as a visual tool for pattern recognition. The distance under consideration, referred to as Max-D-SW, is an adjustment of the Max-Sliced Wasserstein distance. In contrast to the original formulation, which optimizes over single unit directions, Max-D-SW aggregates contributions over orthonormal bases. This modification provides a clear numerical advantage in MDS outcomes, particularly when applied to heavy-tailed distributions. We also establish sample-complexity bounds showing that Max-D-SW remains statistically tractable, with rates comparable to those of its max-sliced counterpart. Moreover, we show that a better sample complexity for a metric does not necessarily translate into better performance when the metric is used as an input for MDS.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Max-D-SW, a modification of the max-sliced Wasserstein distance that aggregates contributions over orthonormal bases rather than optimizing over single directions. It claims this yields a clear numerical advantage when used as a metric in multidimensional scaling (MDS), especially for heavy-tailed distributions, while establishing sample-complexity bounds comparable to the max-sliced version. The paper also observes that improved sample complexity does not necessarily imply better MDS performance.
Significance. If the numerical advantage and bounds hold, the work could offer a practical adjustment for MDS on non-light-tailed data and clarify the relationship between statistical rates and embedding quality. The explicit decoupling of sample complexity from MDS utility is a useful observation, but the heavy-tailed emphasis rests on empirical behavior whose connection to the stated tractability is not yet demonstrated.
major comments (1)
- [Abstract / sample-complexity section] Abstract and theoretical claims: the sample-complexity bounds are stated to remain 'comparable' to max-sliced Wasserstein, yet the highlighted application is to heavy-tailed distributions. Standard Wasserstein theory requires E[||X||^p]<∞ for the p-Wasserstein distance; if the proof of the Max-D-SW bound invokes this moment condition (as is typical), the bound cannot be invoked for the very regime where the numerical advantage is claimed. This makes the tractability statement load-bearing for the central empirical claim.
minor comments (2)
- [Introduction] The abstract refers to 'Max-D-SW' without an explicit definition or equation; a short displayed equation or pseudocode in the introduction would clarify the aggregation over orthonormal bases versus single-direction optimization.
- [Method] No mention of how the orthonormal bases are chosen or whether the aggregation is normalized; this detail affects both the metric property and computational cost.
Simulated Author's Rebuttal
We thank the referee for the careful reading and for identifying this important clarification needed regarding the moment conditions in our sample-complexity analysis. We address the comment below and will revise the manuscript accordingly.
read point-by-point responses
-
Referee: [Abstract / sample-complexity section] Abstract and theoretical claims: the sample-complexity bounds are stated to remain 'comparable' to max-sliced Wasserstein, yet the highlighted application is to heavy-tailed distributions. Standard Wasserstein theory requires E[||X||^p]<∞ for the p-Wasserstein distance; if the proof of the Max-D-SW bound invokes this moment condition (as is typical), the bound cannot be invoked for the very regime where the numerical advantage is claimed. This makes the tractability statement load-bearing for the central empirical claim.
Authors: We agree that the sample-complexity bounds for Max-D-SW, like those for max-sliced Wasserstein, rely on the standard assumption E[||X||^p] < ∞. Our proof follows the same moment condition as the baseline. The numerical experiments demonstrating advantages on heavy-tailed data were performed on distributions satisfying this condition (e.g., multivariate Student's t with degrees of freedom chosen to ensure finite moments while retaining heavy tails). We will revise the abstract, introduction, and theoretical sections to explicitly state the moment assumptions and to clarify that the claimed numerical gains are shown under these conditions. This removes any ambiguity about the applicability of the bounds to the reported experiments. revision: yes
Circularity Check
No circularity; abstract states claims without equations or derivations
full rationale
The provided abstract and context contain no equations, no fitting procedures, no self-citations, and no derivation chain. Claims of numerical advantage in MDS and sample-complexity bounds are asserted but not derived or shown, so no reduction to inputs by construction is possible. The skeptic note concerns moment conditions for heavy-tailed data (a correctness issue) rather than circularity. This matches the default expectation of no significant circularity when no load-bearing steps are inspectable.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
Sliced and radon wasserstein barycenters of measures, 01 2014
Nicolas Bonneel, Julien Rabin, Gabriel Peyr´ e, and Hanspeter Pfister. Sliced and radon wasserstein barycenters of measures, 01 2014
2014
-
[2]
Ingwer Borg and Patrick J. F. Groenen.Modern multidimensional scaling. Springer Series in Statistics. Springer, New York, second edition, 2005. Theory and applications
2005
-
[3]
Sliced iterative normalizing flows
Biwei Dai and Uros Seljak. Sliced iterative normalizing flows. InProceedings of the 38th International Conference on Machine Learning, PMLR 139:2352-2364, 2021
2021
-
[4]
Ishan Deshpande, Yuan-Ting Hu, Ruoyu Sun, Ayis Pyrros, Nasir Siddiqui, Sanmi Koyejo, Zhizhen Zhao, David Forsyth, and Alexander G. Schwing. Max-sliced wasserstein distance and its use for gans. In2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 10640–10648, 2019
2019
-
[5]
R. M. Dudley. The speed of mean Glivenko-Cantelli convergence.Ann. Math. Statist., 40:40–50, 1968
1968
-
[6]
On the rate of convergence in Wasserstein distance of the empirical measure.Probab
Nicolas Fournier and Arnaud Guillin. On the rate of convergence in Wasserstein distance of the empirical measure.Probab. Theory Related Fields, 162(3-4):707–738, 2015. 21
2015
-
[7]
Generalized sliced wasserstein distances.Advances in neural information processing systems, 32, 2019
Soheil Kolouri, Kimia Nadjahi, Umut Simsekli, Roland Badeau, and Gustavo Rohde. Generalized sliced wasserstein distances.Advances in neural information processing systems, 32, 2019
2019
-
[8]
Projection robust wasser- stein distance and riemannian optimization
Tianyi Lin, Chenyou Fan, Nhat Ho, Marco Cuturi, and Michael I Jordan. Projection robust wasser- stein distance and riemannian optimization. InAdvances in Neural Information Processing Systems (NeurIPS), volume 33, pages 17509–17520, 2020
2020
-
[9]
On projection robust optimal transport: Sample complexity and model misspecification
Tianyi Lin, Zeyu Zheng, Elynn Y Chen, Marco Cuturi, and Michael I Jordan. On projection robust optimal transport: Sample complexity and model misspecification. InAdvances in Neural Information Processing Systems (NeurIPS), volume 35, pages 19038–19051, 2022
2022
-
[10]
Kimia Nadjahi.Sliced-Wasserstein distance for large-scale machine learning : theory, methodology and extensions. Ph.d. thesis, Institut Polytechnique de Paris, 2021
2021
-
[11]
Energy-based sliced wasserstein distance
Khai Nguyen and Nhat Ho. Energy-based sliced wasserstein distance. InThirty-seventh Conference on Neural Information Processing Systems, 2023
2023
-
[12]
Distributional sliced-wasserstein and applications to generative modeling
Khai Nguyen, Nhat Ho, Tung Pham, and Hung Bui. Distributional sliced-wasserstein and applications to generative modeling. InInternational Conference on Learning Representations, 2021
2021
-
[13]
Markovian sliced wasserstein distances: Beyond indepen- dent projections
Khai Nguyen, Tongzheng Ren, and Nhat Ho. Markovian sliced wasserstein distances: Beyond indepen- dent projections. InThirty-seventh Conference on Neural Information Processing Systems, 2023
2023
-
[14]
Hierarchical sliced wasserstein distance.arXiv preprint arXiv:2209.13570, 2022
Khai Nguyen, Tongzheng Ren, Huy Nguyen, Litu Rout, Tan Nguyen, and Nhat Ho. Hierarchical sliced wasserstein distance.arXiv preprint arXiv:2209.13570, 2022
-
[15]
Statistical robustness, consistency, and computation of sliced wasserstein distances
Sloan Nietert, Ritwik Sadhu, Ziv Goldfeld, and Kengo Kato. Statistical robustness, consistency, and computation of sliced wasserstein distances. InAdvances in Neural Information Processing Systems (NeurIPS), 2022
2022
-
[16]
Subspace robust wasserstein distances
Fran¸ cois-Pierre Paty and Marco Cuturi. Subspace robust wasserstein distances. InProceedings of the 36th International Conference on Machine Learning (ICML), volume 97, pages 5072–5081. PMLR, 2019
2019
-
[17]
Wasserstein barycenter and its application to texture mixing
Julien Rabin, Gabriel Peyr´ e, Julie Delon, and Marc Bernot. Wasserstein barycenter and its application to texture mixing. InInternational conference on scale space and variational methods in computer vision, pages 435–446. Springer, 2011
2011
-
[18]
Optimal transport for applied mathematicians.Birk¨ auser, NY, 55(58-63):94, 2015
Filippo Santambrogio. Optimal transport for applied mathematicians.Birk¨ auser, NY, 55(58-63):94, 2015
2015
-
[19]
Sutherland, Liang Xiong, Barnab´ as P´ oczos, and Jeff Schneider
Danica J. Sutherland, Liang Xiong, Barnab´ as P´ oczos, and Jeff Schneider. Kernels on sample sets via nonparametric divergence estimates, 2012
2012
-
[20]
Hershey, and Soheil Kolouri
Huy Tran, Yikun Bai, Ashkan Shahbazi, John R. Hershey, and Soheil Kolouri. Understanding learning with sliced-wasserstein requires rethinking informative slices, 2024
2024
-
[21]
A. W. van der Vaart and Jon A. Wellner.Weak convergence and empirical processes—with applications to statistics. Springer Series in Statistics. Springer, Cham, second edition, [2023]©2023
2023
-
[22]
Springer-Verlag, Berlin, 2009
C´ edric Villani.Optimal transport, volume 338 ofGrundlehren der mathematischen Wissenschaften [Fun- damental Principles of Mathematical Sciences]. Springer-Verlag, Berlin, 2009. Old and new. Flor Martinez-Sermeno: Department of Probability and statistics, Centro de Investi- gaci´on en matem´aticas (CIMAT) Email address:flower10@cimat.mx Arturo Jaramillo:...
2009
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.