REVIEW 8 cited by
Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Spiking Neural Networks (SNNs) have gained great attraction due to their distinctive properties of low power consumption and fast inference on neuromorphic hardware. As the most effective method to get deep SNNs, ANN-SNN conversion has achieved comparable performance as ANNs on large-scale datasets. Despite this, it requires long time-steps to match the firing rates of SNNs to the activation of ANNs. As a result, the converted SNN suffers severe performance degradation problems with short time-steps, which hamper the practical application of SNNs. In this paper, we theoretically analyze ANN-SNN conversion error and derive the estimated activation function of SNNs. Then we propose the quantization clip-floor-shift activation function to replace the ReLU activation function in source ANNs, which can better approximate the activation function of SNNs. We prove that the expected conversion error between SNNs and ANNs is zero, enabling us to achieve high-accuracy and ultra-low-latency SNNs. We evaluate our method on CIFAR-10/100 and ImageNet datasets, and show that it outperforms the state-of-the-art ANN-SNN and directly trained SNNs in both accuracy and time-steps. To the best of our knowledge, this is the first time to explore high-performance ANN-SNN conversion with ultra-low latency (4 time-steps). Code is available at https://github.com/putshua/SNN\_conversion\_QCFS
Forward citations
Cited by 8 Pith papers
-
AS-FedBridge: Pseudo-Spike Bridge Distillation for Heterogeneous ANN-SNN Federated Learning
AS-FedBridge trains a shared pseudo-spike bridge so ANN and SNN clients in federated learning can align representations and improve collaborative accuracy.
-
Error Amplification Limits ANN-to-SNN Conversion in Continuous Control
Temporally correlated action errors, amplified by closed-loop dynamics, explain ANN-to-SNN conversion failures in continuous control, and cross-step residual potential initialization mitigates them.
-
FFGAF-SNN: The Forward-Forward Based Gradient Approximation Free Training Framework for Spiking Neural Networks
A Forward-Forward training framework that freezes spiking layers as black-box encoders and allocates channels by inter-class difficulty achieves 99.58% on MNIST, 92.13% on Fashion-MNIST, and 75.64% on CIFAR-10, the be...
-
SPACT18: Spiking Human Action Recognition Benchmark Dataset with Complementary RGB and Thermal Modalities
SPACT18 is claimed to be the first action recognition dataset captured with a spike camera, paired with synchronized RGB and thermal video.
-
Efficient and Robust Spiking Neural Networks for sEMG-Based Muscle Fatigue Detection
3- and 4-bit quantized SNNs with SDH training match ANN F1 on two sEMG fatigue datasets, stay more stable under seven noise types, and reduce estimated energy up to 201.77×.
-
Latency Coding for Efficient and Low-Latency Deep Spiking Neural Networks
Deep TTFS/latency-coded SNNs can be trained directly with backpropagation, reaching ~93.6% on CIFAR-10 with an average inference latency near one timestep.
-
SDSNN: A Single-Timestep Spiking Neural Network with Self-Dropping Neuron and Bayesian Optimization
A network using decay-triggered Self-Dropping neurons and Bayesian per-layer time-step search reports Fashion-MNIST 93.72%, CIFAR-10 92.20%, and CIFAR-100 69.45% accuracy with 21-56% energy savings versus multi-timestep LIF.
-
STI-SNN: A 0.14 GOPS/W/PE Single-Timestep Inference FPGA-based SNN Accelerator with Algorithm and Hardware Co-Design
A single-timestep SNN inference accelerator on FPGA, co-designed with TET-based temporal pruning, reports competitive accuracy with lower latency and energy than two-timestep implementations.
Discussion (0). Sign in to comment.