REVIEW 4 major objections 6 minor 46 references
Generation of synthetic gait data: application to multiple sclerosis patients' gait patterns
T0 review · 4 major / 6 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read The paper claims that synthetic gait data faithful to quaternion geometry can be generated from a small clinical sample of 27 MS patients.
desk verdict A genuinely novel pipeline for synthetic unit quaternion gait data, but the geometry-preservation claim rests on metrics that are partly built into the construction. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the unit quaternion time series (QTS), which represents hip rotation during a gait cycle; the key identity is the logarithmic/exponential map pair linking the unit-quaternion space $ mathcal{H}_u$ to its tangent space $\mathbb{R}^3$. The machinery combines the log map, cubic B-spline functionalization, multivariate functional PCA that produces eigenfunctions and a score matrix, and the flexible avatar method: synthetic scores are convex combinations of the scores of the $\gamma$ nearest neighbors, with Dirichlet weights whose concentrations are inversely proportional to neighbor distances. Equation (6) recombines synthetic scores with the original principal functions and the mean QTS to produce synthetic QTS.
What would settle it
Compute geodesic distances between reconstructed synthetic QTS and real QTS on the unit-quaternion sphere and compare them with the range seen among real gait cycles, or ask clinicians to label synthetic IGPs as plausible or implausible gait; if the synthetic curves fall far outside the real gait manifold or are flagged as implausible, the geometry-preservation claim fails.
Extended reading notes
Core claim
The central claim is that the SynGait framework produces high-fidelity synthetic unit quaternion time series for small and private datasets. The pipeline centers each QTS at the Fréchet mean, applies the logarithmic map to the tangent space, interpolates cubic B-splines, runs multivariate functional PCA to obtain a score matrix, synthesizes new scores by taking Dirichlet-weighted averages of each observation's nearest neighbors, and reconstructs QTS with the exponential map plus the mean. On the 27-patient MS dataset, the synthetic data achieves a mean RV coefficient of 0.84, Frobenius distances between k-nearest-neighbor graphs that are smaller than the copula and CTGAN baselines, and a hidden rate of 85%, supporting the claim that the generated curves are new, faithful, and geometry-preserving.
Load-bearing premise
The load-bearing premise is that closeness of synthetic scores to the nearest neighbors' real scores in PCA space implies the reconstructed quaternion curves lie on the true gait manifold and are clinically plausible, which the paper does not independently test.
Editorial extensions
If this is right
- Small-sample gait studies can generate many synthetic QTS datasets for bootstrapping and stability analysis of clustering, without collecting more patients.
- Because the framework reduces to tabular score generation, any existing tabular synthesizer can be plugged in, while SynGait's nearest-neighbor weighting offers better geometry preservation.
- The method provides a practical privacy workflow: hyperparameters can be tuned so synthetic points are new and the hidden rate is high, supporting sharing of synthetic gait data.
- The same pipeline applies to any motion describable as unit QTS, not just MS hip rotation, and to additional pathologies.
- Default hyperparameter settings (components covering about 95% of inertia, concentration around 5, and a number of neighbors near one tenth of the sample size) make the method usable on other unit-QTS datasets.
Reading between the lines
- Because synthetic scores are convex combinations of real nearest-neighbor scores, geometric closeness in score space is partly enforced by construction; the paper does not independently verify that the reconstructed QTS are clinically plausible gait curves, so a clinician review or geodesic-distance check would strengthen the claim.
- The approach could serve as a privacy-preserving data-sharing mechanism for multi-site MS cohorts: each site can release synthetic QTS built from its own patients, and the hidden-rate and local-cloaking metrics suggest re-identification is nontrivial.
- Neighboring problems such as synthetic accelerometer or EMG time series could reuse the same tangent-space fPCA plus nearest-neighbor score synthesis, with the same geometry-preservation claim being testable.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes SynGait, a two-part framework for generating synthetic unit quaternion time series (QTS) gait data. The first part transforms QTS into a tabular score matrix via Fréchet centering, logarithm map to the tangent space, B-spline smoothing, and multivariate functional PCA. The second part synthesizes new scores using a flexible avatar method: for each observation, the γ nearest neighbors are found in the first τ principal-component scores, weights are sampled from a Dirichlet distribution whose concentration parameters depend on distances to those neighbors, and the new score is a weighted average of the neighbors' scores (Eq. 8). Synthetic QTS are reconstructed by exponentiating the linear combination of principal functions and adding back the mean QTS (Eq. 6). The method is applied to 27 multiple sclerosis patients' gait data and compared with copula and CTGAN baselines using k-nearest-neighbor graph Frobenius distances, the RV coefficient, SDV fidelity metrics, and local cloaking/hidden rate; all evaluation metrics are computed on the score matrix.
Significance. If the claims are supported, the framework would be a valuable contribution: it adapts manifold-aware functional data analysis to the synthesis of rotation-valued time series, works with very small samples, and could enable privacy-preserving sharing and stability analysis of gait data. The geometric treatment of unit quaternions and the use of fPCA on the tangent space are appropriate and well motivated. The method is simple, does not require large training datasets, and the comparison with standard tabular synthesizers is a useful benchmark. However, the current evaluation is not sufficient to establish the central claims of high-fidelity QTS generation and geometry preservation, because the metrics are computed in the same score space in which the synthetic data are constructed as convex combinations of real neighbors.
major comments (4)
- [§4.2 and §5, Eq. (8)] All fidelity and geometry metrics are computed on the functional score matrix F, as stated at the start of Section 4.2. However, Eq. (8) generates each synthetic score vector as a convex combination of the γ nearest real score vectors. Consequently, the k-NNG Frobenius distances (Section 4.2.1) and the RV coefficient (Section 4.2.2) measure similarity in the very space where the generative process is defined, so high scores are partly entailed by construction and do not independently confirm that the reconstructed QTS (Eq. 6) preserve the geometry of the original gait manifold. Please add quantitative validation directly on the reconstructed QTS space, for example by computing geodesic distances between original and synthetic QTS, or by comparing clinically meaningful gait descriptors derived from the QTS (e.g., range of motion, timing of gait phases).
- [§3.4 and §5] The hyperparameters α0, γ, and τ are selected by the procedure in Section 3.4 using the same 27-patient dataset that is later used to report all fidelity and geometry metrics in Section 5. This selection-on-test-set protocol risks overfitting the reported performance to the particular sample. Please provide a resampling-based evaluation, such as leave-one-out or a train/validation split, to demonstrate that the method's performance generalizes beyond the tuning sample.
- [§5, Figure 5] The paper acknowledges in Section 5 that the synthetic curves 'seem to be living on a smaller space,' which is a direct consequence of the convex averaging in Eq. (8). This shrinkage implies that the synthetic QTS may not cover the full variability of the original gait patterns, but no quantitative QTS-space metric is provided to assess the impact of this shrinkage on fidelity. The claim that SynGait produces 'high-fidelity synthetic QTS data' is therefore supported only by score-space metrics, not by any direct evaluation of the reconstructed unit quaternion time series.
- [§6 and Abstract] The stated motivation for the work includes using synthetic data to study the stability of clustering methods on the IGP data (Abstract and Section 6), but no clustering stability experiment is reported. Adding such an analysis, for example by clustering the synthetic QTS and comparing the resulting groups with those obtained on the original data, would provide a utility-based validation that the synthetic data preserve clinically relevant structure.
minor comments (6)
- [§2.3.2] The text says quaternions were formalized by Sir William Hamilton in 1943; the correct year is 1843.
- [§1] There is a typo in the second paragraph: 'n this article' should read 'In this article'.
- [§3.3] The description of the nearest-neighbor weighting step would be clearer if the Dirichlet sampling were written explicitly, e.g., w_i ∼ Dir(α_i) with α_i defined as in Eq. (7), and if the notation for the weights w_ij were defined consistently with Eq. (8).
- [§5] The abbreviation 'IGP' is used in the results section but is not defined there; it appears earlier in the text, but a reminder at first use in Section 5 would help readability.
- [§5] The statement 'the mean R V coefficient is 0.84' reports a single point estimate; please include the variability across the 100 synthetic datasets, such as a standard deviation or a boxplot.
- [§3.4] The recommended threshold for d_min is set to 10% of the smallest distance between observations in the original dataset, but the rationale for this particular percentage is not explained.
Circularity Check
SynGait's geometry-preservation evidence is computed on the same score matrix in which synthetic rows are convex combinations of real neighbor rows (Eq. 8); the headline fidelity claim is therefore partly entailed by construction.
-
self definitional
[Section 3.3 Eq. (8); Section 4.2 metrics; Section 5 results (RV, k-NNG, Figure 6)]
"We then produce synthetic scores for observation i as a weighed average of the scores of its γ nearest neighbors: f(s)i = Σγ j=1 wij fℓij ∈ R n−1, i ∈ [[1,n]]. [...] In the remainder of the paper, we mainly focus on fidelity measures as well as one privacy metric. All of these metrics are computed on the functional score matrix F (original and synthetic)."
By Eq. (8), every synthetic score row is a convex combination of the γ nearest original score rows in the same score matrix F. Section 4.2 then evaluates all fidelity and privacy metrics on F: k-NNG Frobenius distances, the RV coefficient, SDV column similarities, and local cloaking distances. Thus the reported geometry preservation (e.g., mean RV = 0.84 and low k-NNG Frobenius distances) is largely entailed by the generative construction rather than independently established: the synthetic score cloud is forced into the convex hull of the original score cloud. Section 5 even concedes that the synthetic curves 'seem to be living on a smaller space,' the expected shrinkage from convex averaging. No experiment validates the reconstructed QTS from Eq.
full rationale
The mathematical pipeline itself is not circular: fPCA and the exponential-map reconstruction (Eq. 6) are well-defined, and the Dirichlet-weighted nearest-neighbor scheme is a concrete generative algorithm rather than a restatement of the target. The circularity is in the evaluation. Because SynGait produces synthetic scores as convex combinations of neighboring original scores in the same score space where all geometry/fidelity metrics are computed, the high scores on those metrics are partly guaranteed by the method's definition, not by an independent check of whether the synthetic unit quaternion time series lie on the true gait manifold. The comparison with copula and CTGAN synthesizers inside the same fPCA framework provides some independent benchmarking value, and the paper is transparent about the expected shrinkage; however, none of the reported quantitative metrics test the reconstructed QTS themselves. There is no load-bearing self-citation issue here; the concern is a self-referential validation loop. Score 6 reflects that a central claimed result (respecting the initial geometry) is partially constructed into the metric rather than fully demonstrated.
Assumptions & free parameters
free parameters (4)
- alpha_0 (Dirichlet concentration sum) =
4.52
- gamma (number of nearest neighbors) =
2
- tau (number of principal components used in neighbor search) =
9
- d_min threshold =
0.024
assumptions (4)
- domain assumption Unit quaternions form a Lie group with well-defined log and exp maps, and the tangent space at the Frechet mean captures the gait manifold adequately
- domain assumption The first n-1 multivariate functional principal components capture the essential gait information, so synthesizing scores in this basis yields plausible QTS
- domain assumption Synthetic score rows created as convex combinations of nearest-neighbor rows remain anatomically valid gait patterns
- standard math Functional PCA eigen-decomposition and multivariate functional data theory (MFPCA package) are standard and correct
Cite this review
Pith. "Pith review of Generation of synthetic gait data: application to multiple sclerosis patients' gait patterns." pith.science (2026). https://pith.science/paper/B4V3ZRQK
@misc{pith2026241110377,
author = {Pith},
title = {Pith review of: Generation of synthetic gait data: application to multiple sclerosis patients' gait patterns},
year = {2026},
howpublished = {\url{https://pith.science/paper/B4V3ZRQK}},
note = {Machine review of arXiv:2411.10377}
}
read the original abstract
Multiple sclerosis (MS) is the leading cause of severe non-traumatic disability in young adults and its incidence is increasing worldwide. The variability of gait impairment in MS necessitates the development of a non-invasive, sensitive, and cost-effective tool for quantitative gait evaluation. The eGait movement sensor, designed to characterize human gait through unit quaternion time series (QTS) representing hip rotations, is a promising approach. However, the small sample sizes typical of clinical studies pose challenges for the stability of gait data analysis tools. To address these challenges, this article presents two key scientific contributions. First, a comprehensive framework is proposed for transforming QTS data into a form that preserves the essential geometric properties of gait while enabling the use of any tabular synthetic data generation method. Second, a synthetic data generation method is introduced, based on nearest neighbors weighting, which produces high-fidelity synthetic QTS data suitable for small datasets and private data environments. The effectiveness of the proposed method, is demonstrated through its application to MS gait data, showing very good fidelity and respect of the initial geometry of the data. Thanks to this work, we are able to produce synthetic data sets and work on the stability of clustering methods.
Figures
Figures from the paper (6 more)
Reference graph
Works this paper leans on
-
[1]
Ilya Kister, Tamar E. Bacon, Eric Chamot, Amber R. Salter, Gary R. Cutter, Jen- nifer T. Kalina, and Joseph Herbert. Natural History of Multiple Sclerosis Symp- toms. International Journal of MS Care , 15(3):146–156, 10 2013
work page 2013
-
[2]
Nicholas G. LaRocca. Impact of walking impairment in multiple sclerosis. The Patient: Patient-Centered Outcomes Research , 4(3):189–201, September 2011
work page 2011
-
[3]
L Rocher, J. M. Hendrickx, and Y de Montjoye. Estimating the success of re- identifications in incomplete datasets using generative models. Nature Communica- tions, 10, 2019
work page 2019
- [4]
-
[5]
No silver bullet: De-identification still doesn’t work
Arvind Narayanan and Edward W Felten. No silver bullet: De-identification still doesn’t work. White Paper, 8, 2014
work page 2014
-
[6]
High-fidelity synthetic data applications for data augmentation
Zhenchen Wang, Barbara Draghi, Ylenia Rotalinti, Darren Lunn, and Puja Myles. High-fidelity synthetic data applications for data augmentation. In Manuel Dom ´ ınguez-Morales, Javier Civit-Masot, Luis Mu˜ noz-Saavedra, and Rober- tas Damaˇ seviˇ cius, editors,Deep Learning, chapter 7. IntechOpen, Rijeka, 2024
work page 2024
-
[7]
Donald B. Rubin. Statistical disclosure limitation: discussion. Journal of Official Statistics, 9:2461–468, 1993. 25
work page 1993
-
[8]
Multiple im- putation for statistical disclosure limitation
Trivellore E Raghunathan, Jerome P Reiter, and Donald B Rubin. Multiple im- putation for statistical disclosure limitation. Journal of official statistics , 19(1):1, 2003
work page 2003
Show all 46 references
-
[9]
A large-scale synthetic gait dataset towards in-the-wild sim- ulation and comparison study
Pengyi Zhang, Huanzhang Dou, Wenhu Zhang, Yuhan Zhao, Zequn Qin, Dongping Hu, Yi Fang, and Xi Li. A large-scale synthetic gait dataset towards in-the-wild sim- ulation and comparison study. ACM Trans. Multimedia Comput. Commun. Appl. , 19(1), 1 2023
2023
-
[10]
A vision-based system for stage classification of parkinsonian gait using machine learning and synthetic data
Jorge Marquez Chavez and Wei Tang. A vision-based system for stage classification of parkinsonian gait using machine learning and synthetic data. Sensors, 22(12), 2022
2022
-
[11]
Hargrove
Minjae Kim and Levi J. Hargrove. Generating synthetic gait patterns based on benchmark datasets for controlling prosthetic legs. Journal of NeuroEngineering and Rehabilitation, 20(1), 9 2023
2023
-
[12]
International classification of functioning, disability, and health: Icf 2001, 2001
World Health Organization. International classification of functioning, disability, and health: Icf 2001, 2001
2001
-
[13]
Nandikolla, Robin Bochen, Steven Meza, and Allan Garcia
Vidya K. Nandikolla, Robin Bochen, Steven Meza, and Allan Garcia. Experimental gait analysis to study stress distribution of the human foot. Journal of Medical Engineering, 2017(1):3432074, 2017
2017
-
[14]
Individual recognition using gait energy image
Ju Han and Bir Bhanu. Individual recognition using gait energy image. IEEE Trans Pattern Anal Mach Intell , 28(2):316–22, 2006
2006
-
[15]
Evaluation of calibrated kinect gait kinematics using a vicon motion capture system
H Lamine, S Bennour, M Laribi, L Romdhane, and S Zaghloul. Evaluation of calibrated kinect gait kinematics using a vicon motion capture system. Computer Methods in Biomechanics and Biomedical Engineering , 20(sup1):S111–S112, 2017
2017
-
[16]
Gait analysis using wear- able sensors
Weijun Tao, Tao Liu, Rencheng Zheng, and Hutian Feng. Gait analysis using wear- able sensors. Sensors, 12(2):2255–2283, 2012
2012
-
[17]
Kieseier and Carlo Pozzilli
Bernd C. Kieseier and Carlo Pozzilli. Assessing walking disability in multiple scle- rosis. Multiple Sclerosis Journal , 18(7):914–924, 2012
2012
-
[18]
John F. Kurtzke. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (edss). Neurology, 33(11), 1983
1983
-
[19]
Gait impairment monitoring in multiple sclerosis using a wearable motion sensor
Pierre Drouin, Aymeric Stamm, Laurent Chevreuil, Vincent Graillot, Laetitia Barbin, Philippe Nicolas, et al. Gait impairment monitoring in multiple sclerosis using a wearable motion sensor. Medical Case reports and Reviews , 5:1–5, 2022
2022
-
[20]
Quaternion Algebras
John Voight. Quaternion Algebras. Springer Nature, 2005
2005
-
[21]
Dijkhuizen
Mathijs S. Dijkhuizen. The double covering of the quantum group soq(3). In Proceed- ings of the Winter School ”Geometry and Physics”. Circolo Matematico di Palermo , volume 37, pages 47–57, 1994
1994
-
[22]
Ramsay and Bernard W
James O. Ramsay and Bernard W. Silverman. Principal components analysis for functional data , pages 147–172. Springer New York, 2005. 26
2005
-
[23]
Patient-centric synthetic data generation, no reason to risk re-identification in biomedical data analysis
Morgan Guillaudeux, Olivia Rousseau, Julien Petot, Zineb Bennis, Charles-Axel Dein, Thomas Goronflot, et al. Patient-centric synthetic data generation, no reason to risk re-identification in biomedical data analysis. npj Digital Medicine , 6, 2023
2023
-
[24]
A micro lie theory for state estimation in robotics
Joan Sola, Jeremie Deray, and Dinesh Atchuthan. A micro lie theory for state estimation in robotics. arXiv preprint arXiv:1812.01537 , 2018
2018 arXiv
-
[25]
Ramsay and Bernard W
James O. Ramsay and Bernard W. Silverman. Introduction, pages 1–18. Springer New York, 2005
2005
-
[26]
K. Pearson. Liii. on lines and planes of closest fit to systems of points in space. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science , 2(11):559–572, 1901
1901
-
[27]
Analysis of a complex of statistical variables into principal com- ponents
Harold Hotelling. Analysis of a complex of statistical variables into principal com- ponents. Journal of Educational Psychology , 24:498–520, 1933
1933
-
[28]
Multivariate functional principal component analysis for data observed on different (dimensional) domains
Clara Happ and Sonja Greven. Multivariate functional principal component analysis for data observed on different (dimensional) domains. Journal of the American Statistical Association, 113(522):649–659, 2018
2018
-
[29]
MFPCA: Multivariate Functional Principal Component Analysis for Data Observed on Different Dimensional Domains , 2022
Clara Happ-Kurz. MFPCA: Multivariate Functional Principal Component Analysis for Data Observed on Different Dimensional Domains , 2022. R package version 1.3-10
2022
-
[30]
Dirichlet and Related Distri- butions: Theory, Methods and Applications
Kai Wang Ng, Guo Liang Tian, and Man Lai TANG. Dirichlet and Related Distri- butions: Theory, Methods and Applications . Wiley-Blackwell, 2011
2011
-
[31]
The synthetic data vault
Neha Patki, Roy Wedge, and Kalyan Veeramachaneni. The synthetic data vault. In 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA), pages 399–410, 2016
2016
-
[32]
Sequential models in the synthetic data vault
Kevin Zhang, Neha Patki, and Kalyan Veeramachaneni. Sequential models in the synthetic data vault. arXiv preprint arXiv:2207.14406 , 2022
2022 arXiv
-
[33]
Shih-Chieh Kao, Hoe Kyoung Kim, Cheng Liu, Xiaohui Cui, and Budhendra L. Bhaduri. Dependence-preserving approach to synthesizing household characteristics. Transportation Research Record, 2302(1):192–200, 2012
2012
-
[34]
Learning vine cop- ula models for synthetic data generation
Yi Sun, Alfredo Cuesta-Infante, and Kalyan Veeramachaneni. Learning vine cop- ula models for synthetic data generation. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01):5049–5057, 7 2019
2019
-
[35]
Fonctions de r´ epartition ` a n dimensions et leurs marges
M Sklar. Fonctions de r´ epartition ` a n dimensions et leurs marges. In Annales de l’ISUP, volume 8, pages 229–231, 1959
1959
-
[36]
Copula-based synthetic data generation for machine learning emulators in weather and climate: application to a simple radiation model
David Meyer, Thomas Nagler, and Robin J Hogan. Copula-based synthetic data generation for machine learning emulators in weather and climate: application to a simple radiation model. Geoscientific Model Development Discussions , 2021:1–21, 2021. 27
2021
-
[37]
Generative adversarial networks
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial networks. Communications of the ACM , 63(11):139–144, 2020
2020
-
[38]
Antonia Creswell, Tom White, Vincent Dumoulin, Kai Arulkumaran, Biswa Sen- gupta, and Anil A. Bharath. Generative adversarial networks: An overview. IEEE Signal Processing Magazine, 35(1):53–65, 2018
2018
-
[39]
Modeling tabular data using conditional gan
Lei Xu, Maria Skoularidou, Alfredo Cuesta-Infante, and Kalyan Veeramachaneni. Modeling tabular data using conditional gan. Advances in neural information pro- cessing systems, 32, 2019
2019
-
[40]
Computational geometry: an introduc- tion
Franco P Preparata and Michael I Shamos. Computational geometry: an introduc- tion. Springer Science & Business Media, 2012
2012
-
[41]
Marchette
David J. Marchette. cccd: Class Cover Catch Digraphs , 2022. R package version 1.6
2022
-
[42]
Josse, J
J. Josse, J. Pag` es, and F. Husson. Testing the significance of the rv coefficient. Computational Statistics & Data Analysis , 53(1):82–91, 2008
2008
-
[43]
Robert and Y
P. Robert and Y. Escoufier. A unifying tool for linear multivariate statistical meth- ods: The rv- coefficient. Journal of the Royal Statistical Society. Series C (Applied Statistics), 25(3):257–265, 1976
1976
-
[44]
Demystifying membership inference attacks in machine learning as a service
Stacey Truex, Ling Liu, Mehmet Emre Gursoy, Lei Yu, and Wenqi Wei. Demystifying membership inference attacks in machine learning as a service. IEEE Transactions on Services Computing , 14:2073–2089, 2019
2019
-
[45]
Anonymization techniques for privacy preserving data publishing: A comprehensive survey
Abdul Majeed and Sungchang Lee. Anonymization techniques for privacy preserving data publishing: A comprehensive survey. IEEE Access, 9:8512–8545, 2021
2021
-
[46]
Semi-supervised clustering of quaternion time series: Application to gait analysis in multiple sclerosis using motion sensor data
Pierre Drouin, Aymeric Stamm, Laurent Chevreuil, Vincent Graillot, Laetitia Barbin, Pierre-Antoine Gourraud, et al. Semi-supervised clustering of quaternion time series: Application to gait analysis in multiple sclerosis using motion sensor data. Statistics in Medicine , 42(4)...
2022
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.