REVIEW 3 major objections 5 minor 23 references
TS2TabPFN: Time Series Classification and Extrinsic Regression through Feature Extraction and a Tabular Foundation Model
T0 review · 3 major / 5 minor · reviewed 2026-08-08 · deepseek-v4-flash
Pith's one-line read The paper claims that TS2TabPFN, combining explicit time-series feature extraction with the frozen tabular foundation model TabPFN 2.5, sets a new state of the art in time series extrinsic regression and matches HIVE-COTE 2.0 in…
desk verdict Sensible pipeline paper with a real novelty, but the TSER SOTA claim rests on comparison statistics that the paper never shows are computed on a common dataset subset, and duplicate win/rank numbers need explanation. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the separation of representation from inference. A feature extractor ψ (tsfresh, catch22, or MultiROCKET) maps each time series to a vector; the featurized training set D and test queries X are concatenated into one table and passed in a single forward pass to TabPFN 2.5, a transformer pre-trained on synthetic data that approximates the Bayesian posterior predictive distribution. Because TabPFN's weights stay frozen, the pipeline is training-free and relies on in-context learning.
What would settle it
Run TS2TabPFN and its baselines on the 24 TSC and 8 TSER datasets that were excluded for exceeding 12 GB VRAM, then recompute average ranks; if the excluded datasets favor DrCIF or FreshPRINCE, the claimed state-of-the-art rank on the full archives would not reproduce.
Extended reading notes
Core claim
The central discovery is that a frozen tabular foundation model, TabPFN 2.5, becomes a highly effective time-series predictor once the raw series are reduced to a fixed-dimensional feature table. On the TSER benchmark, tsfresh-TabPFN has average rank 1.4364 and beats DrCIF and FreshPRINCE with p ≤ 1e-4 and a 51/0/4 win-tie-loss record. On TSC, MultiROCKET-TabPFN reaches 0.8627 mean accuracy versus HC2's 0.8674 (p = 0.6690), winning 69 head-to-head comparisons to HC2's 60, and dominating standard ROCKET with p ≤ 1e-4. These results are obtained with no per-dataset training or hyperparameter tuning.
Load-bearing premise
The reported comparisons assume that baseline accuracies and RMSEs published on the full UCR/UEA and TSML archives can be directly compared with TS2TabPFN scores computed only on the subset of datasets that fit in 12 GB of GPU memory; if the excluded datasets differ in difficulty, the claimed ranks and win records may not hold.
Editorial extensions
If this is right
- tsfresh-TabPFN becomes the top-performing TSER model in the comparison, with a statistically significant edge over DrCIF and FreshPRINCE (p ≤ 1e-4, identical 51/0/4 records).
- MultiROCKET-TabPFN matches HC2 accuracy (0.8627 vs 0.8674, p=0.6690) while winning more datasets, and beats ROCKET significantly.
- End-to-end speedups reach 98.39× over HC2 in classification and 101.81× over DrCIF in regression; inference-only speedups reach 769.20×.
- Total energy consumption is lower than the baselines despite higher instantaneous power draw, because runtime drops sharply.
Reading between the lines
- The task-dependent best extractor (MultiROCKET for classification, tsfresh for regression) suggests the framework's performance is governed by how well the feature table matches TabPFN's prior, not by a single universal representation.
- Because TabPFN's quadratic memory limits forced evaluation on 134/55 of the full archives, the headline ranks are conditional; re-running on the excluded datasets could shift them.
- The same pipeline could be probed with other tabular foundation models or with latent features from time-series foundation models to test whether the gains come from the prior or from the feature extraction.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes TS2TabPFN, a two-stage framework for time series classification (TSC) and extrinsic regression (TSER). It first extracts features from raw series using one of three extractors (tsfresh, catch22, MultiROCKET) and then feeds the resulting tabular representation to the TabPFN 2.5 foundation model for in-context inference. The authors evaluate on 134 of 158 UCR/UEA datasets and 55 of 63 TSML regression datasets, constrained by 12 GB VRAM, and compare against literature-reported baselines. They report that MultiROCKET-TabPFN matches HC2 accuracy in TSC while being up to two orders of magnitude faster, and that tsfresh-TabPFN significantly outperforms DrCIF and FreshPRINCE in TSER (p <= 1e-4), with speedups up to 769x at inference.
Significance. The idea of decoupling temporal feature extraction from a tabular foundation model is simple, original in this combination, and potentially very useful. The paper follows accepted benchmarking protocols (fixed resamples/seeds, Wilcoxon with Holm correction), reports energy and runtime measurements, and provides a public repository. If the statistical claims are correct, TS2TabPFN would be a strong and computationally attractive alternative to state-of-the-art ensembles. However, the significance of the TSER result depends entirely on the correctness of the pairwise comparisons, which are currently not verifiable from the manuscript.
major comments (3)
- [Sections 4.1 and 4.3] The central claim of significant TSER outperformance is not verifiable because the manuscript does not state the dataset intersection used for the paired Wilcoxon tests. TS2TabPFN results are reported on 55 of 63 TSML datasets (Section 4.1), while baseline results are taken from the literature (Section 4.3) and likely cover the full archive. If the 8 excluded datasets are included for baselines but missing for TS2TabPFN, the signed-rank tests, average ranks, and win/tie/loss records in Figures 5-7 are invalid. Please state explicitly that all statistics were computed on the common subset (and list the datasets) or recompute them.
- [Section 5.2, Figures 5 and 6] The identical average rank 1.4364 for tsfresh-TabPFN in the internal 3-model comparison (Figure 5) and the external 7-model comparison (Figure 6) is highly implausible and suggests the statistic was not recomputed for Figure 6. Likewise, the identical 51/0/4 win-tie-loss records against DrCIF and FreshPRINCE in Figure 7, despite different mean RMSE differences, require explanation. Please provide per-dataset ranks and pairwise outcomes, and verify these numbers.
- [Sections 4.1 and 6] The unqualified claim of 'state-of-the-art' performance is not supported if the evaluated subset is not representative of the full archives. With 24 TSC and 8 TSER datasets excluded for hardware reasons, the authors should either explicitly limit the claims to the evaluated subset or provide a sensitivity analysis showing that baseline rankings are similar on the excluded datasets.
minor comments (5)
- [Section 5.2] The text mentions ResNet as one of the baselines, but ResNet is not listed in Section 4.3 nor shown in Figure 6; please reconcile.
- [Section 5.2] The text says 'seven established TSER baselines' but only six are listed in Section 4.3; either correct the count or add the missing baseline.
- [Figure 2] The CD diagram for internal TSC validation has no labels on the horizontal axis; please add a caption explaining the axis and the meaning of the rank numbers.
- [Section 7] The conclusion calls the pipeline 'training-free', but tsfresh feature selection and the MultiROCKET fit are per-dataset procedures; please qualify this claim.
- [Figure 4] The win/tie/loss convention (r>c / r=c / r<c) is not defined in the caption; please define how ties are determined.
Circularity Check
No significant circularity: TS2TabPFN's claims are empirical benchmark comparisons against external baselines and standard feature extractors, with no derivation that reduces to its own inputs.
full rationale
The paper contains no mathematical derivation chain in which a claimed prediction is defined in terms of its own output. TS2TabPFN combines externally maintained feature extractors (tsfresh, catch22, MultiROCKET) with the externally pre-trained TabPFN 2.5, and its state-of-the-art claims are evaluated against literature-reported baselines on the UCR/UEA and TSML archives. There is no fitted parameter that is later renamed as a prediction, no uniqueness theorem imported from the authors' prior work, and no ansatz smuggled in via citation. The only self-citation (Guijo-Rubio et al. 2024, which includes co-author Silva) is used for background statements about FreshPRINCE and DrCIF being strong TSER baselines; it is not load-bearing for the reported outcome. The internal validation that selects the best feature extractor using the same benchmark test sets later used for the final comparison is a legitimate experimental-validity concern (model selection on test data), and the identical 51/0/4 records and identical average rank in Figures 5-7 warrant verification, but these are correctness or reporting risks, not circularity by construction. Accordingly, no circular step can be exhibited with a specific reduction, and the appropriate score is 0.
Assumptions & free parameters
assumptions (5)
- domain assumption The UCR/UEA and TSML benchmark archives are representative and their train/test splits are trustworthy.
- ad hoc to paper Literature-reported baseline results are directly comparable to locally computed TS2TabPFN results despite different hardware, software versions, and dataset subsets.
- ad hoc to paper Excluding datasets that exceed 12 GB VRAM does not bias the comparison.
- domain assumption TabPFN 2.5's pretrained prior sufficiently approximates the posterior predictive distribution for featurized time series data.
- standard math Wilcoxon signed-rank tests with Holm correction are appropriate for paired benchmark comparisons.
Cite this review
Pith. "Pith review of TS2TabPFN: Time Series Classification and Extrinsic Regression through Feature Extraction and a Tabular Foundation Model." pith.science (2026). https://pith.science/paper/JWW6VWCN
@misc{pith2026260804174,
author = {Pith},
title = {Pith review of: TS2TabPFN: Time Series Classification and Extrinsic Regression through Feature Extraction and a Tabular Foundation Model},
year = {2026},
howpublished = {\url{https://pith.science/paper/JWW6VWCN}},
note = {Machine review of arXiv:2608.04174}
}
read the original abstract
Time series data are ubiquitous in practical applications, where classification (TSC) and extrinsic regression (TSER) have emerged as essential tasks for obtaining value from temporal sequences. While the literature has seen significant progress through feature-based and deep learning models, existing methods often focus either on the quality of feature extraction or on the intrinsic predictive power of complex architectures applied to raw data. This division creates a gap between the control offered by feature engineering and the automated performance of end-to-end models. This paper proposes TS2TabPFN, a framework that bridges this gap by integrating explicit feature extraction with TabPFN 2.5, a cutting-edge foundation model for tabular data, to leverage its predictive capabilities. Our extensive experimental evaluation demonstrates that TS2TabPFN significantly outperforms state-of-the-art models in TSER tasks with statistical significance, providing a robust and efficient alternative for TSC and surpassing most of the currently best-performing algorithms. These results suggest that combining foundation models with structured features overcomes single-paradigm limitations, establishing a new time series state-of-the-art.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[1]
Bagnall, A., Dau, H.A., Lines, J., Flynn, M., Large, J., Bostrom, A., Southam, P., Keogh, E.: The uea multivariate time series classification archive, 2018 (2018)
work page 2018
-
[2]
Bagnall, A., Flynn, M., Large, J., Line, J., Bostrom, A., Cawley, G.: Is rotation forest the best classifier for problems with continuous features? arXiv preprint arXiv:1809.06705 (2018)
arXiv 2018
-
[3]
Neurocom- puting307, 72–77 (2018)
Christ, M., Braun, N., Neuffer, J., Kempa-Liehr, A.W.: Time series feature extrac- tion on basis of scalable hypothesis tests (tsfresh–a python package). Neurocom- puting307, 72–77 (2018)
work page 2018
-
[4]
IEEE/CAA Jour- nal of Automatica Sinica6(6), 1293–1305 (2019)
Dau, H.A., Bagnall, A., Kamgar, K., Yeh, C.C.M., Zhu, Y., Gharghabi, S., Ratanamahatana, C.A., Keogh, E.: The ucr time series archive. IEEE/CAA Jour- nal of Automatica Sinica6(6), 1293–1305 (2019)
work page 2019
-
[5]
Dau, H.A., Keogh, E., Kamgar, K., Yeh, C.C.M., Zhu, Y., Gharghabi, S., Ratanamahatana, C.A., Yanping, Hu, B., Begum, N., Bagnall, A., Mueen, b., Batista, G., Hexagon-ML: The UCR time series classification archive (October 2018)
work page 2018
-
[6]
Data Mining and Knowledge Discovery34(5), 1454–1495 (2020) 18 G
Dempster, A., Petitjean, F., Webb, G.I.: Rocket: exceptionally fast and accurate time series classification using random convolutional kernels. Data Mining and Knowledge Discovery34(5), 1454–1495 (2020) 18 G. C. Merlin and D. F. Silva
work page 2020
-
[7]
Journal of Machine learning research7(Jan), 1–30 (2006)
Demšar, J.: Statistical comparisons of classifiers over multiple data sets. Journal of Machine learning research7(Jan), 1–30 (2006)
2006
-
[8]
arXiv preprint arXiv:2502.15637 (2025)
Feofanov, V., Wen, S., Alonso, M., Ilbert, R., Guo, H., Tiomoko, M., Pan, L., Zhang, J., Redko, I.: Mantis: Lightweight calibrated foundation model for user- friendly time series classification. arXiv preprint arXiv:2502.15637 (2025)
arXiv 2025
Show all 23 references
-
[9]
arXiv preprint arXiv:2511.08667 (2025)
Grinsztajn, L., Flöge, K., Key, O., Birkel, F., Jund, P., Roof, B., Jäger, B., Safaric, D., Alessi, S., Hayler, A., et al.: Tabpfn-2.5: Advancing the state of the art in tabular foundation models. arXiv preprint arXiv:2511.08667 (2025)
2025 arXiv
-
[10]
Data Mining and Knowledge Discovery38(4), 2141–2185 (2024)
Guijo-Rubio, D., Middlehurst, M., Arcencio, G., Silva, D.F., Bagnall, A.: Unsu- pervised feature based algorithms for time series extrinsic regression. Data Mining and Knowledge Discovery38(4), 2141–2185 (2024)
2024
-
[11]
In: The Eleventh International Conference on Learning Representations (2023)
Hollmann, N., Müller, S., Eggensperger, K., Hutter, F.: Tabpfn: A transformer that solves small tabular classification problems in a second. In: The Eleventh International Conference on Learning Representations (2023)
2023
-
[12]
Data mining and knowledge discovery34(6), 1936–1962 (2020)
Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D.F., Weber, J., Webb, G.I., Idoumghar, L., Muller, P.A., Petitjean, F.: Inceptiontime: Finding alexnet for time series classification. Data mining and knowledge discovery34(6), 1936–1962 (2020)
2020
-
[13]
arXiv preprint arXiv:1910.09700 (2019)
Lacoste, A., Luccioni, A., Schmidt, V., Dandres, T.: Quantifying the carbon emis- sions of machine learning. arXiv preprint arXiv:1910.09700 (2019)
2019 arXiv
-
[14]
Lubba, C.H., Sethi, S.S., Knaute, P., Schultz, S.R., Fulcher, B.D., Jones, N.S.: catch22:Canonicaltime-seriescharacteristics:Selectedthroughhighlycomparative time-seriesanalysis.Dataminingandknowledgediscovery33(6),1821–1852(2019)
2019
-
[15]
In: International Conference on Pattern Recognition and Artificial Intelligence
Middlehurst, M., Bagnall, A.: The freshprince: A simple transformation based pipeline time series classifier. In: International Conference on Pattern Recognition and Artificial Intelligence. pp. 150–161. Springer (2022)
2022
-
[16]
Journal of Machine Learning Research25(289), 1–10 (2024)
Middlehurst, M., Ismail-Fawaz, A., Guillaume, A., Holder, C., Guijo-Rubio, D., Bulatova, G., Tsaprounis, L., Mentel, L., Walter, M., Schäfer, P., Bagnall, A.: aeon: a python toolkit for learning from time series. Journal of Machine Learning Research25(289), 1–10 (2024)
2024
-
[17]
Machine Learning 110(11), 3211–3243 (2021)
Middlehurst, M., Large, J., Flynn, M., Lines, J., Bostrom, A., Bagnall, A.: Hive- cote 2.0: a new meta ensemble for time series classification. Machine Learning 110(11), 3211–3243 (2021)
2021
-
[18]
middlehurst et al
Middlehurst, M., Schäfer, P., Bagnall, A.: Bake off redux: a review and experimen- tal evaluation of recent time series classification algorithms: M. middlehurst et al. Data Mining and Knowledge Discovery38(4), 1958–2031 (2024)
2024
-
[19]
ACM Computing Surveys56(9), 1–45 (2024)
Mohammadi Foumani, N., Miller, L., Tan, C.W., Webb, G.I., Forestier, G., Salehi, M.: Deep learning for time series classification and extrinsic regression: A current survey. ACM Computing Surveys56(9), 1–45 (2024)
2024
-
[20]
Data Mining and Knowledge Discovery35(3), 1032–1060 (2021)
Tan,C.W.,Bergmeir,C.,Petitjean,F.,Webb,G.I.:Timeseriesextrinsicregression: Predicting numeric values from time series data. Data Mining and Knowledge Discovery35(3), 1032–1060 (2021)
2021
-
[21]
Data Mining and Knowledge Discovery36(5), 1623–1646 (2022)
Tan, C.W., Dempster, A., Bergmeir, C., Webb, G.I.: Multirocket: multiple pooling operators and transformations for fast and effective time series classification: Cw tan. Data Mining and Knowledge Discovery36(5), 1623–1646 (2022)
2022
-
[22]
https://doi.org/10.5281/zenodo.11236865
TSML Archive Maintainers: Tsmlƒextended time series extrinsic regression archive 2024 (May 2024). https://doi.org/10.5281/zenodo.11236865
2024 doi
-
[23]
Wang, Z., Yan, W., Oates, T.: Time series classification from scratch with deep neuralnetworks:Astrongbaseline.In:2017Internationaljointconferenceonneural networks (IJCNN). pp. 1578–1585. IEEE (2017)
2017
Reviewed August 8, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.