REVIEW 4 major objections 5 minor 2 cited by
A Novel Multilevel Taxonomical Approach for Describing High-Dimensional Unlabeled Movement Data
T0 review · 4 major / 5 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read A movement taxonomy and outlier scores can describe unlabeled trajectories
desk verdict A clearly described extension of taxonomy-based EDA to unlabeled movement data, but its effectiveness claim rests on thresholds that sit at chance level; worth refereeing, not yet convincing. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is a two-level taxonomy of movement variables: the root splits into Geometric (trajectory shape) and Kinematic (motion), and each child splits into Curvature/Indentation and Speed/Acceleration, with 72 raw movement variables distributed among the leaves. The mechanism that carries the argument is pairing that taxonomy with distance-based outlier detection: for each node, every trajectory gets an outlier score based on how many other trajectories lie within the average pairwise distance, and a fixed 0.5 boundary converts the pair of scores into four movement-behavior zones. This zone rule is what lets the method label instances in plain behavioral terms and then iteratively refine those labels at the next taxonomic level.
What would settle it
Re-run TUMD on the same four datasets while sweeping the outlier-score cutoff away from 0.5 and, separately, normalizing variables before distance computation; if the reported first-pass majorities or second-pass refinements shrink below 50% outside a narrow parameter window, the claimed effectiveness is an artifact of the chosen threshold rather than of the taxonomical approach.
Extended reading notes
Core claim
The central discovery is a conditional one: using a simple two-level movement taxonomy, distance-based outlier scores computed independently on each node's feature set, and a fixed 0.5 cutoff produce zone labels that meaningfully describe movement behavior in unlabeled high-dimensional datasets. A trajectory is called common (Zone 0) when both scores are below 0.5, purely Geometric or Kinematic when one score exceeds 0.5, and hybrid when both do. Applying the same decision rule again to the pure-Geometric and pure-Kinematic subsets refines them into Curvature/Indentation and Speed/Acceleration, respectively. The paper reports that this scheme described a majority of trajectories in all four test datasets and that the refinement pass succeeded on ships, tropical cyclones, and footballers, supporting the stated hypothesis that taxonomies plus anomaly detection reveal meaningful patterns.
Load-bearing premise
The evaluation assumes that a trajectory is 'uncommon' for a taxonomic node exactly when its distance-based outlier score exceeds 0.5, with the neighborhood radius fixed at the average pairwise distance of the dataset, and that this boundary corresponds to interpretable behavior.
Editorial extensions
If this is right
- With fixed parameters, the first pass labels a majority of trajectories as Kinematic, Geometric, or hybrid in all four test datasets (ships, foxes, cyclones, footballers).
- The second pass narrows pure behaviors into finer categories for three datasets, so the method can move from coarse to specific descriptions without labels.
- Because raw movement variables are preserved rather than transformed, the resulting descriptions remain interpretable for hypothesis generation.
- If the effectiveness criteria are accepted, TUMD offers a parameterized template—taxonomy, outlier scorer, decision boundaries, feedback rule—that can be reused with other movement taxonomies.
Reading between the lines
- If the 0.5 cutoff is replaced by a data-driven threshold or by reporting continuous zone probabilities, the same TUMD pipeline could yield different and possibly more stable descriptions; this sensitivity question is testable on the four datasets.
- The method's success on a majority of instances is a collective measure; a per-instance variant could turn TUMD into an anomaly-mining tool that flags individual trajectories for inspection.
- The same machinery should transfer to any domain where variables can be organized into a taxonomy, since the outlier-scoring step does not depend on movement-specific geometry.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes TUMD, a method for exploratory description of high-dimensional, unlabeled movement data. Movement variables are organized into a two-level taxonomy (Geometric/Kinematic, then Curvature/Indentation and Speed/Acceleration), distance-based outlier scores are computed for the variable groups of selected taxonomy nodes, and each trajectory is assigned to one of four zones based on whether its two outlier scores are above or below 0.5. The authors evaluate TUMD on four datasets (ships, Arctic foxes, tropical cyclones, footballers) with fixed parameters, and they define the first pass as effective when more than 50% of instances fall outside Zone 0 and the second pass as effective when, for either the Geometric or Kinematic branch, more than 50% of that branch is refined into a pure child-node zone. They report first-pass success on all four datasets, second-pass success on three, and conclude that the results support the hypothesis that taxonomy-based outlier scoring uncovers meaningful patterns. The central quantitative evidence for this conclusion is the set of zone-percentage results in Section 5 and the effectiveness criteria in Section 4.3.
Significance. If the central claim were well supported, TUMD would be a useful addition to the descriptive-analysis toolbox for movement data: it preserves the original variables (unlike dimensionality reduction), it is transparent, and it provides a verbal, taxonomically grounded description that could help analysts generate hypotheses. The paper is clearly written about the method itself, the taxonomy and variable list are explicit, and the four datasets span usefully different movement regimes. However, the empirical support is currently too weak to carry the claim. The effectiveness thresholds sit at or near the expected rates under a trivial null model, no baseline or permutation analysis is provided, and the outlier-score computation is not shown to be invariant to variable scales. The contribution is therefore more of a proposed framework with illustrative case studies than a validated method. With a rigorous evaluation design, the paper could become a solid methods contribution.
major comments (4)
- [Section 4.3 and Sections 5.1–5.4] The effectiveness criteria are not calibrated against any null model, and the reported success rates are close to what a trivial uniform-score null would produce. If the two outlier scores were independent Uniform(0,1) variables, the probability of falling outside Zone 0 under the 0.5 threshold would be 75%; the paper reports 72%, 57%, 71%, and 73% for ships, foxes, cyclones, and footballers. For the second pass, the pure-refinement rate (Zone 1 or Zone 2) under the same null is exactly 50%, and the paper declares success whenever the observed rate exceeds 50%. The observed second-pass successes are 67% (ships Geometric), 61% (cyclones Geometric), and 100% (footballers Geometric), none accompanied by a confidence interval, permutation test, or comparison with a baseline method. As written, the results do not distinguish TUMD's behavior from a thresholding artifact, so the claim that the results 'support our hypothesis' is not established.
- [Section 4.2 and Table 2] The paper never states that movement variables are normalized before Euclidean distances are computed, yet the 72 variables in Table 2 include quantities with incompatible units and very different numeric ranges (speed, acceleration, angle statistics, and distance-geometry signatures). The distance-based outlier score is therefore dominated by whichever variables have the largest scales, and the resulting zone assignments are not commensurable across taxonomic nodes. No sensitivity analysis is reported for this choice, and the paper gives no justification for the implicit assumption that raw Euclidean distance in this heterogeneous feature space is meaningful. This is load-bearing because every reported zone percentage depends on these distances.
- [Section 5.5 versus Section 5.1] There is an internal inconsistency in the ships second-pass result. Section 5.1 reports that, among ships with pure Kinematic behavior, 16% exhibit pure Acceleration, 27% exhibit pure Speed, and 57% are hybrid, so the pure refinement rate is 43%, not a majority. Section 5.5 instead states that '6%+4%=10% out of 19%' of Kinematic instances are attributed to Speed or Acceleration, which implies a 52.6% refinement rate. These two sets of numbers cannot both be correct, and the discrepancy directly affects whether the ships dataset is counted as a second-pass success under the paper's own criterion.
- [Section 4.2 and Section 4.3] The 0.5 decision threshold is introduced as a convention ('assuming that outlier score values below 0.5 imply more common movement behaviors'), and the effectiveness criteria are then defined entirely in terms of that same threshold. Since the threshold is not derived from any property of the scoring distribution, the evaluation is self-referential: the method is declared effective when the majority of instances fall on the side of a hand-chosen cutoff. An independent validation, such as a labeled benchmark, an external anomaly ground truth, or a comparison with a baseline scoring method, is needed to establish that the resulting descriptions correspond to meaningful movement behavior rather than to the cutoff itself.
minor comments (5)
- [Throughout] There are numerous typographical and formatting errors, including 'Deparment', 'Vaxjé', 'taronomies', 'Zone $' in the introduction, and 'Cruvature' in Section 4.3; the manuscript needs a careful proofreading pass.
- [Section 4.3] The definition of second-pass success for Geometric data instances is stated twice in the same paragraph, which reads as a redundancy or a copy-and-paste error and should be corrected.
- [Section 5.5 and Figure 13] The summary in Section 5.5 mixes percentages of the full dataset with percentages of a branch subset (for example, '11% out of 17%' and '16% out of 26%'), which is confusing; Figure 13 would be easier to read if the quantitative basis for each ring segment were reported in a table.
- [Section 4.2] The description of distance-based outlier detection does not specify the exact formula used to map the number of neighbors within the fixed radius to the score in [0,1], nor the treatment of ties or duplicates; this information is needed for exact reproducibility.
- [General] No code, data-preprocessing scripts, or supplementary materials are provided, which limits reproducibility; the authors should consider releasing the implementation and the processed datasets.
Circularity Check
Effectiveness is defined by the same 0.5 threshold that creates the zones, so the reported support for the hypothesis is a definitional loop.
-
self definitional
[Section 3, paragraph defining interestingness (Process 2 and outlier score discussion)]
"Therefore, in this paper, when we refer to the degree of interestingness of a movement behavior, we mean how uncommon or atypical it is concerning the normal behavior present in the dataset."
This sentence collapses 'interesting' into 'uncommon'. Process 2 operationalizes 'uncommon' as a high outlier score, and Section 4.2 sets the high/low boundary at 0.5. The later claim that Zones 1, 2, and 3 represent 'the most interesting and important findings' is therefore a restatement of the definition: interesting = uncommon = score above 0.5. The taxonomy adds organization, but the 'meaningful patterns' conclusion is not independently evidenced.
-
self definitional
[Sections 4.2-4.3 and 5.5]
"The second pass of TUMD, on the other hand, is defined as effective in the case of Geometric data instances if cumulatively more than 50% of the data instances determined as Geometric (in the first pass) fall within Zone 1 (Indentation) or Zone 2 (Curvature)."
Zone 0 is defined by both scores below 0.5, and Zones 1-3 by at least one score above 0.5; first-pass 'effectiveness' is then defined as 'majority outside Zone 0', i.e., 'most instances exceed the same 0.5 threshold used to define uncommon behavior'. Second-pass success is likewise defined directly from the zone partition created by that same cutoff. Section 5.5 applies the paper's stipulated definition of overall effectiveness to these zone counts, so 'TUMD is effective' is true by the paper's own criterion rather than by comparison with any independent standard of descriptive quality. The counts are empirical and the fox second pass did fail, but the evidence for the central hypothesis reduces by construction to the self-defined effectiveness measure.
full rationale
The derivation chain of TUMD is mostly self-contained: the taxonomy is a stated organizational structure, the distance-based outlier scores are computed from the data, and the zone categorization is a fixed rule applied to those scores. No parameter is fitted to a subset of data and then renamed as a prediction, and no load-bearing uniqueness theorem is imported from the authors' prior work. Tavakoli et al. (2022) is cited as the labeled-data precursor, but the present claim about unlabeled data is not forced by that citation. The circular component lies in the evaluation logic. Section 3 defines 'interestingness' as 'uncommonness'; Section 4.2 defines 'uncommon' by the 0.5 threshold and builds the four zones from it; Section 4.3 defines effectiveness as the fraction of instances falling outside Zone 0 or into the uncommon sub-zones. Consequently, the reported successes (four-of-four first pass, three-of-four second pass) are counts of instances that exceed the same threshold used to define the behaviors. The concluding sentence 'we conclude that TUMD is effective' applies the paper's own stipulated criterion to its own zone counts. The claim that the results 'support our hypothesis' is thus a definitional restatement of the threshold assumption rather than an empirical test against an independent standard. The null-model issue (the 0.5 cutoff is near the expected success rate under independent uniform scores) is a correctness risk, but the circularity proper is that the evidence and the outcome share the same definition. This is partial, not total, circularity: the method can fail (the fox second pass did fail), the taxonomy and variable grouping are independent content, and no self-citation chain forces the result. A score of 6 reflects that the central claim's empirical support reduces by construction to the self-defined effectiveness measure.
Assumptions & free parameters
free parameters (5)
- Outlier score decision threshold =
0.5
- Neighborhood radius for distance-based outlier detection =
Average pairwise distance of each dataset
- Movement variable set =
72 variables (15 Curvature, 19 Indentation, 19 Speed, 19 Acceleration)
- Taxonomy structure =
Two levels: Kinematic/Geometric, then Speed/Acceleration and Curvature/Indentation
- Effectiveness thresholds =
50% in both passes
assumptions (5)
- domain assumption Outlier score magnitude is a valid measure of behavioral interestingness.
- domain assumption Movement variables can be partitioned into non-overlapping taxonomy nodes that capture coherent movement behaviors.
- ad hoc to paper Distance-based outlier detection with a fixed radius equal to the average pairwise distance is neither too lenient nor too strict.
- ad hoc to paper No variable normalization is needed before computing Euclidean distances.
- domain assumption The four selected datasets are sufficiently representative to support a general conclusion about TUMD's effectiveness.
Cite this review
Pith. "Pith review of A Novel Multilevel Taxonomical Approach for Describing High-Dimensional Unlabeled Movement Data." pith.science (2026). https://pith.science/paper/DHPIFRGV
@misc{pith2026250420174,
author = {Pith},
title = {Pith review of: A Novel Multilevel Taxonomical Approach for Describing High-Dimensional Unlabeled Movement Data},
year = {2026},
howpublished = {\url{https://pith.science/paper/DHPIFRGV}},
note = {Machine review of arXiv:2504.20174}
}
read the original abstract
Movement data is prevalent across various applications and scientific fields, often characterized by its massive scale and complexity. Exploratory Data Analysis (EDA) plays a crucial role in summarizing and describing such data, enabling researchers to generate insights and support scientific hypotheses. Despite its importance, traditional EDA practices face limitations when applied to high-dimensional, unlabeled movement data. The complexity and multi-faceted nature of this type of data require more advanced methods that go beyond the capabilities of current EDA techniques. This study addresses the gap in current EDA practices by proposing a novel approach that leverages movement variable taxonomies and outlier detection. We hypothesize that organizing movement features into a taxonomy, and applying anomaly detection to combinations of taxonomic nodes, can reveal meaningful patterns and lead to more interpretable descriptions of the data. To test this hypothesis, we introduce TUMD, a new method that integrates movement taxonomies with outlier detection to enhance data analysis and interpretation. TUMD was evaluated across four diverse datasets of moving objects using fixed parameter values. Its effectiveness was assessed through two passes: the first pass categorized the majority of movement patterns as Kinematic, Geometric, or Hybrid for all datasets, while the second pass refined these behaviors into more specific categories such as Speed, Acceleration, or Indentation. TUMD met the effectiveness criteria in three datasets, demonstrating its ability to describe and refine movement behaviors. The results confirmed our hypothesis, showing that the combination of movement taxonomies and anomaly detection successfully uncovers meaningful and interpretable patterns within high-dimensional, unlabeled movement data.
Forward citations
Cited by 2 Pith papers
-
A visual analytics tool for taxonomy-based trajectory data exploration
A new visual analytics tool operationalizes a movement taxonomy on Arctic fox and tropical cyclone trajectories, producing exploratory behavioral labels and patterns.
-
Towards Interpretable and Efficient Feature Selection in Trajectory Datasets: A Taxonomic Approach
A taxonomy-based feature selection method that selects whole categories of trajectory features gives comparable or better classification results than forward and backward selection, but the gains are not statistically...
Reference graph
Works this paper leans on
-
[6]
In: 2020 International Conference on Service Science (ICSS)
A cloud-based approach for ship stay behavior classification using massive trajectory data. In: 2020 International Conference on Service Science (ICSS). 82-
work page 2020
-
[9]
Dynamic android malware category classification using semi- supervised deep learning. In: 2020 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CB- DCom/CyberSciTech), August. IEEE. Marradi, A.,
work page 2020
-
[10]
In: 12th Regional Conference on Computer Information and Engineering (2019) At: Vientiane, Laos,
A comparison of svm and k-nn in the classification of jewel damselfish activity. In: 12th Regional Conference on Computer Information and Engineering (2019) At: Vientiane, Laos,
work page 2019
-
[12]
Outlier detec- tion: Techniques and applications. Springer-Verlag GmbH. Available from: https: //waw.ebook .de/de/product/35201144/n_n_r_ranga_suri_narasimha_murty_m_g_ athithan_outlier_detection_techniques_and_applications.htnl. Tavakoli, Y., Pefia-Castillo, L., and Soares, A.,
-
[13]
In: 2018 26th International Conference on Geoinformatics
Detecting transportation modes based on lightgbm classifier from gps trajectory data. In: 2018 26th International Conference on Geoinformatics. 1-7. Wang, H., e¢ al., 2019a. Time series feature learning with labeled and unlabeled data. Pattern Recognition, 89, 55-66. Wang, J.,
work page 2018
-
[14]
Geometric structure of high-dimensional data and dimensionality reduction. 1st ed. Berlin, Heidelberg: Springer-Verlag. Wang, W., et al., 2019b. Classification of ship trajectories by using naive bayesian algorithm. In: 2019 5th International Conference on Transportation Information and Safety (ICTIS). IEEE, 466-470. Wilson, A.T., Rintoul, M.D., and Valic...
work page 2019
-
[1997]
In: Proceedings of the 1997 conference of the Centre for Advanced Studies on Collaborative research
A unified approach for mining outliers. In: Proceedings of the 1997 conference of the Centre for Advanced Studies on Collaborative research
work page 1997
-
[2009]
Statistical inference for exploratory data analysis and model diagnostics. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 367 (1906), 43614383. Burges, C.J.,
work page 1906
Show all 14 references
-
[2012]
In: 2012 Fourth International Conference on Computational Intelligence, Communication Systems and Networks, July
A new diverse measure in ensemble learning using unlabeled data. In: 2012 Fourth International Conference on Computational Intelligence, Communication Systems and Networks, July. IEEE. Colefax, A.P., e¢ al.,
2012
-
[2014]
Journal of spatial information science, 2014 (8), 1-25
Integrating cross-scale analysis in the spatial and temporal domains for classification of behavioral movement. Journal of spatial information science, 2014 (8), 1-25. Staff, P.O.,
2014
-
[2018]
In: 2018 41st International Convention on Information and Communication Technology, 23 Electronics and Microelectronics (MIPRO)
Explainable artificial intelligence: A survey. In: 2018 41st International Convention on Information and Communication Technology, 23 Electronics and Microelectronics (MIPRO). Croatian Society MIPRO, 0210-0215. Duboue, P.,
2018
-
[2019]
International Journal of Offshore and Polar Engineering, 29 (4), 391-399
The preliminary results of iceberg drift studies in the russian arctic throughout 2012-2017. International Journal of Offshore and Polar Engineering, 29 (4), 391-399. Cachat, J., et al.,
2012
-
[2020]
CAM- BRIDGE
The art of feature engineering: Essentials for machine learning. CAM- BRIDGE. Available from: https: //www.ebook.de/de/product/38715856/pablo_duboue_ the_art_of_feature_engineering_essentials_for_machine_learning.html. Etemad, M., Soares Jimior, A., and Matwin, S.,
-
[2022]
In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June
Safe-student for safe deep semi-supervised learning with unseen-class unla- beled data. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June. IEEE. Ho Yu, C.,
2022
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.