A linear-attention transformer decoder achieves bit error rate comparable to a standard transformer and better than one-iteration belief propagation on 5G NR LDPC codes, with O(n) instead of O(n^2) complexity.
Learning to Decode Linear Codes Using Deep Learning
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
A novel deep learning method for improving the belief propagation algorithm is proposed. The method generalizes the standard belief propagation algorithm by assigning weights to the edges of the Tanner graph. These edges are then trained using deep learning techniques. A well-known property of the belief propagation algorithm is the independence of the performance on the transmitted codeword. A crucial property of our new method is that our decoder preserved this property. Furthermore, this property allows us to learn only a single codeword instead of exponential number of code-words. Improvements over the belief propagation algorithm are demonstrated for various high density parity check codes.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
5G LDPC Linear Transformer for Channel Decoding
A linear-attention transformer decoder achieves bit error rate comparable to a standard transformer and better than one-iteration belief propagation on 5G NR LDPC codes, with O(n) instead of O(n^2) complexity.