Pith. sign in

REVIEW 4 major objections 4 minor 19 references

Kolmogorov Arnold Network Autoencoder in Medicine

T0 review · 4 major / 4 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read This paper claims that a kernel-based convolutional autoencoder (KCAE) reconstructs AbnormalHeartbeat signals with lower error and fewer parameters than three competing autoencoders.

desk verdict The paper's own numbers undercut its central claim, and the promised five-task evaluation is missing; as submitted, it should be rejected. read the letter →

arxiv 2507.19524 v1 pith:Q4JESPNU submitted 2025-07-19 cs.LG

classification cs.LG
keywords Kolmogorov-Arnoldnetworksautoencodersconvolutionaltimeseriesbiomedicalsignalsheartbeatclassificationrepresentationlearninganomalydetection
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper aims to show that replacing fixed activations with learnable kernel functions improves unsupervised autoencoders on medical time series. It compares four architectures on the AbnormalHeartbeat stethoscope dataset: a dense autoencoder, its kernel-based variant (KAE), a convolutional autoencoder (CAE), and a kernel-based convolutional autoencoder (KCAE). The reported quantitative evidence centers on reconstruction, where KCAE achieves the lowest test mean squared error (0.15498) with the smallest parameter count. The abstract extends this claim to five autoencoder tasks: reconstruction, generation, denoising, inpainting, and anomaly detection. If the claim holds, kernel-based convolutions would be a useful building block for compact, robust models on biomedical signals.

What carries the argument

The central object is the KCAE, a Kernel-based Convolutional Autoencoder built from KCN1d layers: one-dimensional convolutions in which a fixed activation is replaced by learnable univariate functions, following the Kolmogorov-Arnold network idea. A KAN layer is defined by summing learned edge functions $\psi_{ij}(x_j)$ and then applying a node activation $\phi_i$, and in KCAE this kernelized transformation is paired with ConvTranspose1d layers in the decoder. This mechanism is what carries the paper's efficiency claim: the kernelized convolution is supposed to extract both local patterns and complex nonlinear relationships with fewer parameters than dense or plain convolutional alternatives.

What would settle it

Rerun the four architectures with identical layer widths, kernel sizes, optimizer, epochs, batch size, and random seeds, recording both test MSE and true parameter counts; the central claim fails if KCAE no longer has the lowest test error at the smallest parameter count. A direct implementation check would also verify whether the node activation $\phi_i$ in Equation 2 is actually present in the code, since the paper does not specify it.

Watch

Extended reading notes

Core claim

The central discovery, as the authors state it, is that a Kernel-based Convolutional Autoencoder (KCAE) outperforms the other three autoencoders on the AbnormalHeartbeat dataset: it reaches the optimal reconstruction error of 0.15498 and does so with an even more compact design than the standard convolutional autoencoder, whose test MSE is 0.2423. In the same comparison, the dense autoencoder reaches 0.1376 with over 8 million parameters and the kernel-dense KAE reaches 0.2261 with about 4 million parameters. The authors interpret this as evidence that combining convolutional receptive fields with learnable kernel nonlinearities captures local temporal structure better and generalizes with less loss drift on unseen samples. The abstract extends the claim to all five studied tasks, while the body supplies detailed reconstruction, latent-space, and loss-drift evidence.

Load-bearing premise

The KCAE is implemented as a true kernel-based convolutional network and trained under the same conditions as the comparison models; if its KAN layer is implemented differently or tuned more favorably, the reported advantage could be an artifact of implementation rather than of the architecture.

Editorial extensions

If this is right

  • If KCAE's reported advantage holds, kernel-based convolutions can serve as drop-in replacements for one-dimensional convolutions in compact autoencoders for time series.
  • The parameter-efficiency result implies that KAN-style layers are most useful in convolutional form rather than dense form, since the dense KAE performed worst in the comparison.
  • The reported stability of KCAE's test loss suggests kernel-based nonlinearities may reduce overfitting on small, imbalanced medical datasets.
  • If the five-task claim holds, a single KCAE architecture would cover reconstruction, generation, denoising, inpainting, and anomaly detection for heartbeat signals.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper does not specify hyperparameters or training budgets, so a natural next test is a controlled sweep over kernel sizes, spline basis order, learning rates, and random seeds to see whether KCAE's lead persists under matched conditions.
  • The five-task claim is broader than the detailed evidence shown, so testing generation, denoising, inpainting, and anomaly detection with equal parameter budgets would settle whether the reconstruction gain generalizes.
  • If the kernel-based advantage is real, it likely transfers to other biomedical time series such as ECG and EEG; the testable prediction is that kernel-based convolutional autoencoders will beat plain convolutional autoencoders at equal parameter counts on those domains.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. The paper benchmarks four autoencoder architectures (AE, KAE, CAE, KCAE) on the UCR AbnormalHeartbeat time-series dataset, aiming to show that Kolmogorov-Arnold Network (KAN) variants, especially the kernel-based convolutional autoencoder (KCAE), outperform classical counterparts across five autoencoder tasks: reconstruction, generation, denoising, inpainting, and anomaly detection. The abstract and introduction promise all five tasks, but the body reports only reconstruction, and even that report is internally inconsistent: Section 4.2 states KCAE achieves the optimal reconstruction error of 0.15498, while the same paragraph lists AE at 0.1376, which is strictly lower. The architecture definitions are also incomplete: Section 2.1 gives a nonstandard KAN layer with both edge functions and node activations, and Section 3.1 introduces KCN1d layers without specifying their construction or hyperparameters. The visual analyses in Section 4.1 and 4.2 cover only CAE and KCAE, omitting AE and KAE despite their inclusion in the quantitative comparison. As submitted, the paper does not substantiate its central claim.

Significance. If the central claim were established, the result would be of practical interest: a compact kernel-based convolutional autoencoder that reconstructs medical time series with lower error than larger dense models could motivate further research into KAN-based unsupervised learning for biomedical signals. The paper also chooses a relevant public dataset (UCR AbnormalHeartbeat) and attempts a parameter-complexity comparison among four architectures, which is a reasonable empirical design. However, the significance is currently not realized because the reported numbers contradict the headline claim, four of the five advertised tasks have no results, and the implementation details needed to reproduce or interpret the benchmark are absent. The paper ships no code, no data-release statement, and no machine-checked artifacts; its only quantitative evidence, the MSE values in Section 4.2, undercuts rather than supports the conclusion.

major comments (4)
  1. [Section 4.2] The central claim that KCAE achieves the lowest reconstruction error is contradicted by the paper's own numbers. The same paragraph reports AE test MSE 0.1376, CAE 0.2423, KAE 0.2261, and KCAE 0.15498, making AE the best reconstruction model among the four, not KCAE. The sentence 'KCAE achieves the optimal reconstruction error of 0.15498' is therefore false under the presented evidence, and the conclusion in Section 5 that KCAE has 'the lowest reconstruction error' is unsupported. Additionally, the text states that KCAE test loss 'remains generally low (typically under 0.006)', which is inconsistent with the reported test MSE of 0.15498 by more than an order of magnitude.
  2. [Abstract and Section 3.1] The abstract and introduction promise five tasks--reconstruction, generation, denoising, inpainting, and anomaly detection--and the conclusion claims superiority 'across all tasks'. However, the results section reports no quantitative or qualitative results for generation, denoising, inpainting, or anomaly detection. The only experimental evidence concerns reconstruction, and even that is limited to the MSE comparison and UMAP/loss-drift figures. Therefore the paper does not provide evidence for its central cross-task claim; at most it reports a partial reconstruction benchmark.
  3. [Section 2.1, Eq. (2) and Section 3.1] The KAN layer defined in Eq. (2) includes both edge functions psi_ij and node activations phi_i, which is a nonstandard formulation relative to the usual KAN definition; the paper then introduces KAE and KCAE as using 'KAN layers' and 'KCN1d' layers without specifying how Eq. (2) is instantiated. No kernel sizes, strides, latent dimensionality, learning rates, epochs, batch sizes, weight initializations, or random seeds are reported, and no per-model parameter counts are tabulated. Consequently, the claimed 'same or less number of parameters' comparison cannot be verified, and the entire empirical benchmark is not reproducible from the manuscript as written.
  4. [Sections 4.1 and 4.2] The experimental narrative focuses exclusively on CAE and KCAE: the UMAP latent-space analysis and loss-drift figures cover only these two models, while AE and KAE appear only as points in the efficiency plot and as MSE values in the text. Since the paper's stated aim is a four-model benchmark, the absence of any qualitative or per-sample analysis for AE and KAE leaves the comparison of fully connected versus convolutional architectures largely asserted rather than demonstrated, and the reader cannot assess whether the reported MSE differences are accompanied by meaningful differences in learned representations.
minor comments (4)
  1. [Section 4.2 (Figure 6)] The text refers to 'Figure 6b for KCAE and Figure 6b for CAE', but the caption labels subfigures (a) and (b); presumably the CAE plot is Figure 6a. This should be corrected.
  2. [Section 4.1 (Figure 5)] The text says the CAE model is 'depicted in Figures 5a and 5b', but the caption assigns Figure 5a to CAE and Figure 5b to KCAE. Please clarify which figure corresponds to which model.
  3. [Throughout] There are several typographical and grammatical errors, including 'architecture' for 'architectures', 'datatset', 'such Multi Layer Perceptrons', and 'This was was supported in part'. A careful language edit is needed.
  4. [Section 5] The conclusion states that KCAE achieved 'the lowest reconstruction error with the smallest number of parameters', but no parameter counts are reported for any model in the text or a table; only relative descriptions ('approximately 1.5 million', 'over 8 million') are given. Please provide exact parameter counts.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular derivation: the KCAE-vs-AE benchmark is empirical, and the self-citations are background only; the paper's internal MSE contradiction is a correctness issue, not a circularity.

full rationale

The paper's central comparison is an experimental benchmark between four autoencoder architectures. No quantity used as evidence is defined in terms of the conclusion. Eq. (2) defines a KAN layer from univariate edge functions and a node activation; it does not presuppose KCAE superiority. Reconstruction MSE values (0.1376, 0.2261, 0.2423, 0.15498) are reported as fitted test metrics, not as parameters that force the 'KCAE optimal' statement. The self-citations [4], [7], [8] appear in background passages about biomedical signals and ECG autoencoders; they do not supply the architecture or the benchmark result, so they are not load-bearing. There is no imported uniqueness theorem and no ansatz smuggled via citation; the KCAE design is described as using KCN1d layers, with implementation details omitted, which is a reproducibility or verification concern but not circularity. The main defect in the paper is internal numerical inconsistency: Section 4.2 calls KCAE's 0.15498 'the optimal reconstruction error' while reporting AE at 0.1376, so the stated conclusion is not supported by the paper's own numbers. The abstract also promises five tasks, yet only reconstruction metrics are reported in the body. These are correctness and completeness problems, not circular reduction: no equation presented in the paper is equivalent to its own input by construction. The central benchmark claim is therefore not tautologically entailed by the paper's definitions or citations, and the circularity score is 0.

Assumptions & free parameters 1 free parameters · 3 assumptions · 0 invented entities

The central claim rests on an empirical comparison, so the main ledger entries are the unstated hyperparameters and the nonstandard KAN definition. No new theoretical entities are introduced.

free parameters (1)
  • Model hyperparameters (hidden sizes, latent dimension, kernel sizes, learning rate, epochs, batch size) = not reported
    The results depend on these choices, and the paper gives no explicit values. Without them the comparison cannot be reproduced or assessed for fairness.
assumptions (3)
  • standard math The Kolmogorov-Arnold representation theorem (Eq. 1) justifies approximating multivariate functions by sums of univariate functions.
    Invoked in Section 2.1 as the mathematical foundation of KANs.
  • ad hoc to paper The KAN layer definition in Eq. 2 (with both edge functions psi_ij and node activations phi_i) matches the implemented KAE and KCAE architectures.
    This formulation is not the standard KAN layer definition, and the paper does not reconcile the difference or provide implementation details.
  • domain assumption The AbnormalHeartbeat dataset splits and characteristics (100 training, 1089 test, length 187) are as stated and used without additional preprocessing.
    Section 3.1 gives these statistics but no preprocessing or normalization details.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Kolmogorov Arnold Network Autoencoder in Medicine." pith.science (2026). https://pith.science/paper/Q4JESPNU

@misc{pith2026250719524,
  author       = {Pith},
  title        = {Pith review of: Kolmogorov Arnold Network Autoencoder in Medicine},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/Q4JESPNU}},
  note         = {Machine review of arXiv:2507.19524}
}
read the original abstract

Deep learning neural networks architectures such Multi Layer Perceptrons (MLP) and Convolutional blocks still play a crucial role in nowadays research advancements. From a topological point of view, these architecture may be represented as graphs in which we learn the functions related to the nodes while fixed edges convey the information from the input to the output. A recent work introduced a new architecture called Kolmogorov Arnold Networks (KAN) that reports how putting learnable activation functions on the edges of the neural network leads to better performances in multiple scenarios. Multiple studies are focusing on optimizing the KAN architecture by adding important features such as dropout regularization, Autoencoders (AE), model benchmarking and last, but not least, the KAN Convolutional Network (KCN) that introduced matrix convolution with KANs learning. This study aims to benchmark multiple versions of vanilla AEs (such as Linear, Convolutional and Variational) against their Kolmogorov-Arnold counterparts that have same or less number of parameters. Using cardiological signals as model input, a total of five different classic AE tasks were studied: reconstruction, generation, denoising, inpainting and anomaly detection. The proposed experiments uses a medical dataset \textit{AbnormalHeartbeat} that contains audio signals obtained from the stethoscope.

Figures

Figures reproduced from arXiv: 2507.19524 by the authors.

Figure 1
Figure 1. Topological comparison between a Multilayer Perceptron (MLP) and a Kolmogorov–Arnold Network (KAN). The MLP (left) consists of fully connected layers where learning occurs via scalar weights on edges between nodes, enabling the network to approximate complex functions by tuning edge connections. In contrast, the KAN (right) replaces scalar edge weights with learnable univariate functions at each node, inspired by th… view at source ↗
Figure 2
Figure 2. Example of a learned univariate function [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Diagram illustrating a single layer of a Kolmogorov–Arnold Network (KAN). Each edge from an input node [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: Architectures the absence of supervision (since the reconstruction task is unsupervised). The dispersion of points within each class cluster suggests a greater flexibility in the learned representations, which could potentially enhance robustness to input variability b…
Figure 5
Figure 5. Figure 5: Latent space for the reconstruction task learned by CAE (a) and KCAE (b) models. [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: Loss drift analysis for CAE (A) and KCAE (B) models. [PITH_FULL_IMAGE:figures/full_fig_p009_6.png]
Figure 7
Figure 7. Figure 7: Efficiency (A) evaluation for AE, KAE, CAE and KCAE autoencoders. [PITH_FULL_IMAGE:figures/full_fig_p010_7.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

19 extracted references · 16 canonical work pages

  1. [1]

    Deep learning.Nature, 521(7553):436–444, 2015

    Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. Deep learning.Nature, 521(7553):436–444, 2015

  2. [2]

    Biological network analysis: Trends, approaches, graph theory, and algorithms, 2020

    Pietro Hiram Guzzi and Swarup Roy. Biological network analysis: Trends, approaches, graph theory, and algorithms, 2020

  3. [3]

    Kolmogorov-arnold networks.arXiv preprint arXiv:2401.00001, 2024

    Jane Doe and John Smith. Kolmogorov-arnold networks.arXiv preprint arXiv:2401.00001, 2024

  4. [4]

    Design and use of a denoising convolutional autoencoder for reconstructing electrocardiogram signals at super resolution.Artificial Intelligence in Medicine, 160:103058, 2025

    Ugo Lomoio, Pierangelo Veltri, Pietro Hiram Guzzi, and Pietro Liò. Design and use of a denoising convolutional autoencoder for reconstructing electrocardiogram signals at super resolution.Artificial Intelligence in Medicine, 160:103058, 2025

  5. [5]

    A. N. Kolmogorov. On the representation of continuous functions of many variables by superpositions of continuous functions of one variable and addition.Dokl. Akad. Nauk SSSR, 114:953–956, 1957. 10 Lomoio et al

  6. [6]

    Kolmogorov convolutional networks.Proceedings of the NeurIPS 2024 Conference, 2024

    Alice Roe and Hiroshi Tanaka. Kolmogorov convolutional networks.Proceedings of the NeurIPS 2024 Conference, 2024

  7. [7]

    Disease spreading modeling and analysis: A survey.Briefings in Bioinformatics, 23(4):bbac230, 2022

    Pietro Hiram Guzzi, Francesco Petrizzelli, and Tommaso Mazza. Disease spreading modeling and analysis: A survey.Briefings in Bioinformatics, 23(4):bbac230, 2022

  8. [8]

    A convolutional autoencoder framework for ecg signal analysis

    Ugo Lomoio, Patrizia Vizza, Raffaele Giancotti, Salvatore Petrolo, Sergio Flesca, Fabiola Boccuto, Pietro Hiram Guzzi, Pierangelo Veltri, and Giuseppe Tradigo. A convolutional autoencoder framework for ecg signal analysis. Heliyon, 11(2), 2025

Show all 19 references
  1. [9]

    Current and future directions in network biology, 2024

    Marinka Zitnik, Michelle M Li, Aydin Wells, Kimberly Glass, Deisy Morselli Gysi, Arjun Krishnan, T_M Murali, Predrag Radivojac, Sushmita Roy, Anaïs Baudot, et al. Current and future directions in network biology, 2024

  2. [10]

    Exploiting the molecular basis of age and gender differences in outcomes of sars-cov-2 infections.Computational and Structural Biotechnology Journal, 19:4092–4100, 2021

    Daniele Mercatelli, Elisabetta Pedace, Pierangelo Veltri, Federico M Giorgi, and Pietro Hiram Guzzi. Exploiting the molecular basis of age and gender differences in outcomes of sars-cov-2 infections.Computational and Structural Biotechnology Journal, 19:4092–4100, 2021

  3. [11]

    Reducing the dimensionality of data with neural networks

    Geoffrey E Hinton and Ruslan R Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504–507, 2006

  4. [12]

    Auto-encoding variational bayes.arXiv preprint arXiv:1312.6114, 2013

    Diederik P Kingma and Max Welling. Auto-encoding variational bayes.arXiv preprint arXiv:1312.6114, 2013

  5. [13]

    Automated detection of myocardial infarction using convolutional neural networks with ecg signals.Journal of Medical and Biological Engineering, 37(4):526–534, 2017

    Xiaohong Zhai, Chung-Kuan Tin, and Li Yao. Automated detection of myocardial infarction using convolutional neural networks with ecg signals.Journal of Medical and Biological Engineering, 37(4):526–534, 2017

  6. [14]

    Deep convolutional neural network for the automated diagnosis of congestive heart failure using ecg signals

    U Rajendra Acharya, Hamido Fujita, Oh Shu Lih, Muhammad Adam, Ru San Tan, Choo Min Chua, and Choo Min Lim. Deep convolutional neural network for the automated diagnosis of congestive heart failure using ecg signals. Applied Intelligence, 49(1):16–27, 2017

  7. [15]

    Arrhythmia detection using deep convolutional neural network with long duration ecg signals

    Ozal Yildirim. Arrhythmia detection using deep convolutional neural network with long duration ecg signals. Computers in Biology and Medicine, 102:411–420, 2018

  8. [16]

    Conditional variational autoencoder for data augmentation and prediction of signal quality in wearable ecg.IEEE Transactions on Biomedical Engineering, 68(7):2253–2263, 2021

    Kunkun Li, Yuxuan Wu, Xindong Wu, and Bin Hu. Conditional variational autoencoder for data augmentation and prediction of signal quality in wearable ecg.IEEE Transactions on Biomedical Engineering, 68(7):2253–2263, 2021

  9. [17]

    Variational autoencoder based anomaly detection using reconstruction probability

    Jinwon An and Sungzoon Cho. Variational autoencoder based anomaly detection using reconstruction probability. InSpecial Lecture on IE, volume 2, pages 1–18, 2015

  10. [18]

    V . I. Arnold. On functions of three variables.Dokl. Akad. Nauk SSSR, 114(4):679–681, 1957

  11. [19]

    Ucr time series classification archive, 2019

    Hoang Anh Dau, Eamonn Keogh, Kaveh Kamgar, Chin-Chia Michael Yeh, Yan Zhu, Shaghayegh Gharghabi, Chotirat Ann Ratanamahatana, et al. Ucr time series classification archive, 2019. Accessed: July 2025. 11

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.