REVIEW 9 cited by
Demonstrating the Efficacy of Kolmogorov-Arnold Networks in Vision Tasks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
In the realm of deep learning, the Kolmogorov-Arnold Network (KAN) has emerged as a potential alternative to multilayer projections (MLPs). However, its applicability to vision tasks has not been extensively validated. In our study, we demonstrated the effectiveness of KAN for vision tasks through multiple trials on the MNIST, CIFAR10, and CIFAR100 datasets, using a training batch size of 32. Our results showed that while KAN outperformed the original MLP-Mixer on CIFAR10 and CIFAR100, it performed slightly worse than the state-of-the-art ResNet-18. These findings suggest that KAN holds significant promise for vision tasks, and further modifications could enhance its performance in future evaluations.Our contributions are threefold: first, we showcase the efficiency of KAN-based algorithms for visual tasks; second, we provide extensive empirical assessments across various vision benchmarks, comparing KAN's performance with MLP-Mixer, CNNs, and Vision Transformers (ViT); and third, we pioneer the use of natural KAN layers in visual tasks, addressing a gap in previous research. This paper lays the foundation for future studies on KANs, highlighting their potential as a reliable alternative for image classification tasks.
Forward citations
Cited by 9 Pith papers
-
PRKAN: Parameter-Reduced Kolmogorov-Arnold Networks
PRKAN lowers KAN parameter counts to near-MLP levels via attention, convolution/pooling, dimension summation, and feature-vector projections, reaching MLP-like accuracy on MNIST and Fashion-MNIST.
-
Leveraging KANs for Expedient Training of Multichannel MLPs via Preconditioning and Geometric Refinement
Training in a B-spline KAN basis is equivalent to preconditioned gradient descent on a multichannel ReLU MLP, and geometric refinement plus trainable knots accelerate and improve training.
-
Efficiency Bottlenecks of Convolutional Kolmogorov-Arnold Networks: A Comprehensive Scrutiny with ImageNet, AlexNet, LeNet and Tabular Classification
CKANs are measurably less efficient than standard CNNs, and on ImageNet the accuracy gap is large, but the paper's baseline and timing comparisons are not controlled.
-
SechKAN: Kolmogorov-Arnold Networks with Hyperbolic Secant Functions
SechKAN combines sech basis functions with a 1D linear projection to build a KAN-style model whose parameter count matches MLPs and which is competitive or better than several KAN variants on tested benchmarks.
-
Capsule-ConvKAN: A Hybrid Neural Approach to Medical Image Classification
A hybrid Capsule-ConvKAN model reports 91.21% accuracy on histopathological image classification, outperforming CNN, CapsNet, and ConvKAN baselines on a single dataset.
-
Enhancing Federated Learning with Kolmogorov-Arnold Networks: A Comparative Study Across Diverse Aggregation Strategies
KANs achieve higher or comparable accuracy to MLPs across four tabular datasets in simulated federated learning, using fewer communication rounds.
-
Conformalized-KANs: Uncertainty Quantification with Coverage Guarantees for Kolmogorov-Arnold Networks (KANs) in Scientific Machine Learning
Conformal prediction applied to ensembles of KANs, FBKANs, and MFKANs yields prediction intervals that empirically hit the target 95% coverage on four synthetic problems.
-
Bridging KAN and MLP: MJKAN, a Hybrid Architecture with Both Efficiency and Expressiveness
MJKAN is a FiLM-modulated RBF layer that beats MLPs on some 1D regression tasks with carefully chosen basis counts, but underperforms MLPs on classification benchmarks.
-
KAT to KANs: A Review of Kolmogorov-Arnold Networks and the Neural Leap Forward
A review of Kolmogorov-Arnold Networks that restates existing theory and claims, without new experiments or derived results.
Discussion (0). Continue with ORCID to comment.