REVIEW 5 major objections 5 minor 25 references
A Power-Efficient Hardware Implementation of L-Mul
T0 review · 5 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read This paper builds the first FPGA implementation of L-Mul, an approximate FP8 multiplier that replaces multiplication with additions and shifts, fitting in roughly 22 lookup tables with no DSP blocks.
desk verdict A credible first hardware mapping of L-Mul onto FPGA LUT/carry primitives with solid resource reporting; the headline accuracy claim overstates what Table VII actually shows. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the L-Mul identity, which replaces the mantissa product $m_x m_y$ in FP8 multiplication with the small power $2^{-\ell(m)}$, turning $(1+m_x)(1+m_y)$ into the sum $1+m_x+m_y+2^{-\ell(m)}$ while the exponents are added separately. The hardware realizes this with five LUT configurations and CARRY8 chains split into an exponent adder, a mantissa adder, and a post-processing unit; per-format constants fold the FP8 bias and mantissa-carry handling into a single $bias^*$ value, and CLB-level placement constraints keep LUT-to-carry-chain paths short.
What would settle it
A decisive check: simulate the paper's bit-level equations for all 65,536 E4M3 input pairs and compare with exact IEEE-754 FP8 multiplication. Any mismatch on inputs with exponent bits 0000 and nonzero mantissa, or exponent bits 1111, exposes the special-value handling gap; a same-target synthesis of the Verilog would independently confirm the roughly 22-LUT, no-DSP resource count.
Extended reading notes
Core claim
On its own terms, the paper establishes that L-Mul's approximate FP8 multiplication can be built entirely from standard FPGA logic primitives rather than DSP blocks. Five LUT configurations and CARRY8 chains form an exponent adder, a mantissa adder, and a post-processing unit that together compute the L-Mul result for a chosen FP8 exponent/mantissa split. For the widely used E4M3 format the result is a multiplier with about 22 LUTs, 25 flip-flops, four carry-chain units, a 4.85 ns critical path, and 1.34 mW of power. The paper further claims this is the first FPGA-based FP8 approximate multiplier, that it uses on average 10% fewer resources than previous 8-bit approximate FPGA multipliers, and that in CNN and GCN inference it removes all DSP blocks while keeping accuracy loss below 1% and around 3%, respectively.
Load-bearing premise
For the reported accuracy numbers to hold, every weight and activation entering the multiplier must be a normal finite FP8 value or exactly zero, because the hardware does not detect subnormals, infinities, or NaNs and would multiply them as if they were ordinary numbers.
Editorial extensions
If this is right
- With the E4M3 format, the multiplier consumes 22 LUTs, 25 flip-flops, and four carry-chain units per product, with no DSP block and a 4.85 ns critical path at 617 MHz.
- Across the six FP8 formats, resource use stays between 21 and 23 LUTs, so the same architecture covers E1M6, E2M5, E3M4, E4M3, E5M2, and E6M1 with near-identical cost.
- In CNN inference, replacing exact INT8 multipliers with the FP8 L-Mul design removes 1,156 DSPs and cuts power from 9.46 W to 8.08 W at 250 MHz, with 0.96% accuracy loss.
- In GCN inference, the design removes 512 DSPs and lowers power from 8.61 W to 8.23 W, with 3.01% accuracy loss.
- Against prior 8-bit approximate FPGA multipliers, the design uses on average 10% fewer LUTs and sits on the area-latency Pareto frontier, with the second-lowest power-delay product.
Reading between the lines
- Editorial inference: the reported accuracy numbers implicitly assume flush-to-zero-like behavior, because the hardware's zero flag only detects an all-zero payload; feeding FP8 subnormals, infinities, or NaNs would produce silently wrong products.
- Editorial inference: the 10% resource saving is measured against INT8 approximate multipliers of the same bit width, so a future subnormal-aware or exactly-specified FP8 baseline could change the comparison.
- Editorial inference: since the FPGA circuit computes the same L-Mul arithmetic already validated on GPUs for large language models, LLM accuracy should carry over, but the subnormal blind spot may matter more for low-precision transformer activations.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents a primitive-level FPGA implementation of the L-Mul approximate FP8 multiplier for AMD UltraScale/UltraScale+ devices, mapping the computation onto LUTs, carry chains, and CLB-level placement constraints. It reports resource, frequency, and power results for six FP8 formats, compares the E4M3 deployment with prior 8-bit approximate multipliers and an exact IP core, and evaluates DNN inference accuracy loss and accelerator-level power. The stated contributions are that this is the first FPGA-based FP8 approximate multiplier, that it reduces resource consumption by about 10% relative to previous 8-bit designs, and that it achieves the highest accuracy, energy efficiency, and lowest latency among 8-bit designs.
Significance. The underlying hardware idea is relevant and plausible: reducing FP8 multiplication to add/shift operations via L-Mul and implementing it with LUT/carry primitives yields a compact DSP-free operator (about 22 LUTs), and the error evaluation against exact FP8 is an independent, non-circular benchmark. The paper gives enough architectural detail to be reproducible, and the synthesis-based resource counts across formats are a useful data point. However, the headline comparison claims are internally inconsistent with the reported tables, and several specification gaps (subnormal handling, consistency of Eq. (5), and normalization of power comparisons) must be resolved before the significance of the hardware claims can be assessed.
major comments (5)
- [Section I, second contribution bullet; Section IV-D, Table VII] The claim that "among 8-bit designs, ours achieves the highest accuracy" is contradicted by Table VII: L-Mul E4M3 has average accuracy losses of -0.96% (CNN) and -3.01% (GCN), while exact INT8 has -0.10% and -2.77%, and exact FP8 E4M3 has -0.04% and -1.96%. Section IV-D itself states, "Although L-Mul exhibits the highest accuracy loss..." Please restrict the accuracy claim to approximate multipliers or remove it from the abstract and contribution list.
- [Section IV-C, Table VI] The latency and energy-efficiency claims are not supported by the reported data. The proposed design has a delay of 4.85 ns, whereas the AMD-Xilinx exact design reports 3.54 ns and Van Toan reports 4.65 ns. The power comparison is also not normalized: 1.34 mW at 617 MHz cannot be directly compared with 0.432 mW at 100 MHz, and the designs are on different device families (7-series versus UltraScale+). Please report energy per operation (e.g., power/frequency) under matched conditions, and include an exact FP8 multiplier baseline on the same device and at the same frequency to substantiate the FP8-specific efficiency claim.
- [Section III-B, zero-flag logic] The zero detection only checks whether fp8_x[6:0] == 7'b0 or fp8_y[6:0] == 7'b0. Subnormal FP8 numbers (exponent field 0000 with nonzero mantissa) and reserved exponent patterns (infinity/NaN) are therefore not detected; they are treated as normal numbers and produce incorrect outputs. Since the paper claims an FP8 implementation under IEEE-754 conventions, please either implement IEEE-754 special-case handling or explicitly state and justify a flush-to-zero/no-special-values assumption, and verify that the DNN workloads used in Section IV-D satisfy that assumption.
- [Section II-A, Eq. (5)] Eq. (5) does not follow from Eq. (4). The L-Mul correction term 2^{-l(m)} should appear as 2^{m-l(m)}/2^m in a numerator of the form (2^m + x + y + 2^{m-l(m)})/2^m, whereas the printed numerator "1 + x + y + 2^{l(m)}" gives a correction of 2^{l(m)-m}. The two coincide only when m = 3, so the bit-level representation as written is wrong for the other FP8 formats implemented in Table V. Please correct Eq. (5) and re-verify the synthesized arithmetic for m != 3.
- [Section I, first contribution bullet; Table VI] The claimed "average 10%" resource reduction is not reproducible from Table VI. Averaging the listed LUT counts for the previous 8-bit designs gives approximately 48-52 LUTs, compared with 22 for the proposed design, which is a reduction of roughly 55%, not 10%. Please specify the exact comparator set and the calculation used for the 10% figure.
minor comments (5)
- [Section III-B, adder description] The bit-width descriptions of the Exponent-Adder and Mantissa-Adder appear swapped: for a format with e exponent bits and m mantissa bits, the exponent adder should be e/e+1 bits and the mantissa adder should be m/m+1 bits, not the reverse as written.
- [Section II-A, Eq. (4)] The piecewise definition of l(m) is contradictory at m = 4: it says both "3 if m = 4" and "4 if m >= 4". The last case should presumably be "m > 4".
- [Section IV-A, Eq. (12)] The definition of NED as an average of ED_i/max(ED) is not the standard normalized error distance; please clarify the definition or rename the metric to avoid confusion.
- [Section IV-D, Table VIII] The accelerator comparison would be stronger if it reported measured inference accuracy and throughput for the deployed accelerators, not only resource and power, since Table VII reports software-evaluated accuracy rather than end-to-end hardware accuracy.
- [Section II-A] Minor language issues include "a real numbers is encoded" and "implicit" in place of "implicit"; please copyedit the manuscript.
Circularity Check
No significant circularity: the L-Mul approximation is imported from external prior work, hardware metrics come from synthesis, and accuracy is benchmarked against exact FP8/FP32 baselines.
full rationale
The paper's derivation chain is self-contained with respect to circularity. The L-Mul approximation in Eq. (4), including the piecewise term l(m), is taken directly from the external prior work [2] (Luo and Sun), not derived from the paper's own hardware results. The hardware design in Section III-B implements Eq. (5), which is a bit-level transcription of Eq. (4) combined with the IEEE-754 FP8 encoding formulas Eqs. (1)-(2); the output is therefore not fed back into the design as an input. The error evaluation in Table IV is computed against exact FP8 multiplication using the standard metrics defined in Eqs. (8)-(12), which are independent of the presented synthesis results. The hardware resource, frequency, delay, and power numbers in Tables V, VI, and VIII are obtained from AMD Vivado synthesis, placement, and power analysis, and from previously published external designs; no free parameter is fitted to force the comparisons. The DNN accuracy results in Table VII are measured against FP32, FP8, and INT8 baselines on standard CNN and GCN datasets using external accelerators. There is an internal inconsistency between the abstract's claim of 'highest accuracy' and Table VII, where L-Mul has the largest accuracy loss, but this is a correctness and consistency concern, not a circular-reasoning step. No load-bearing self-citation is present, and no prediction reduces by construction to a fit or to an author-imported ansatz.
Assumptions & free parameters
assumptions (5)
- domain assumption L-Mul's piecewise constant l(m)=m if m<=3, 3 if m=4, 4 if m>=4 approximates the mantissa product adequately for neural network workloads.
- domain assumption Inputs to the multiplier are normal FP8 numbers or exact zero; subnormals, infinities, and NaNs do not occur in the evaluated workloads.
- standard math FP8 follows IEEE-754 with hidden bit 1 for nonzero exponent and bias=2^(e-1)-1.
- domain assumption AMD UltraScale/UltraScale+ CLB primitives (LUT6_2, CARRY8) behave as documented by the CLB user guide.
- domain assumption Vivado synthesis and power analysis provide accurate estimates of resource utilization, frequency, and dynamic power.
Cite this review
Pith. "Pith review of A Power-Efficient Hardware Implementation of L-Mul." pith.science (2026). https://pith.science/paper/MPZJ3GHS
@misc{pith2026241218948,
author = {Pith},
title = {Pith review of: A Power-Efficient Hardware Implementation of L-Mul},
year = {2026},
howpublished = {\url{https://pith.science/paper/MPZJ3GHS}},
note = {Machine review of arXiv:2412.18948}
}
read the original abstract
Multiplication is a core operation in modern neural network (NN) computations, contributing significantly to energy consumption. The linear-complexity multiplication (L-Mul) algorithm is specifically proposed as an approximate multiplication method for emerging NN models, such as large language model (LLM), to reduce the energy consumption and computational complexity of multiplications. However, hardware implementation designs for L-Mul have not yet been reported. Additionally, 8-bit floating-point (FP8), as an emerging data format, offers a better dynamic range compared to traditional 8-bit integer (INT8), making it increasingly popular and widely adopted in NN computations. This paper thus presents a power-efficient FPGAbased hardware implementation (approximate FP8 multiplier) for L-Mul. The core computation is implemented using the dynamic reconfigurable lookup tables and carry chains primitives available in AMD Xilinx UltraScale/UltraScale+ technology. The accuracy and resource utilization of the approximate multiplier are evaluated and analyzed. Furthermore, the FP8 approximate multiplier is deployed in the inference phase of representative NN models to validate its effectiveness.
Figures
Reference graph
Works this paper leans on
-
[24]
Fpga-based multi-level approximate mul- tipliers for high-performance error-resilient applications,
N. Van Toan and J.-G. Lee, “Fpga-based multi-level approximate mul- tipliers for high-performance error-resilient applications,” IEEE Access, vol. 8, pp. 25 481–25 497, 2020
work page 2020
-
[1]
Backpropagation-based learning techniques for deep spiking neural networks: A survey,
M. Dampfhoffer, T. Mesquida, A. Valentian, and L. Anghel, “Backpropagation-based learning techniques for deep spiking neural networks: A survey,” IEEE Transactions on Neural Networks and Learning Systems, vol. 35, no. 9, pp. 11 906–11 921, 2024
work page 2024
-
[2]
Addition is all you need for energy-efficient language models,
H. Luo and W. Sun, “Addition is all you need for energy-efficient language models,” arXiv preprint arXiv:2410.00907 , 2024
arXiv 2024
-
[3]
Q. Han, Y . Hu, F. Yu, H. Yang, B. Liu, P. Hu, R. Gong, Y . Wang, R. Wang, Z. Luan, and D. Qian, “Extremely low-bit convolution optimization for quantized neural network on modern computer architec- tures,” in Proceedings of the 49th International Conference on Parallel Processing, ser. ICPP ’20. New York, NY , ACM, 2020
work page 2020
-
[4]
Zeroquant: Efficient and affordable post-training quantization for large- scale transformers,
Z. Yao, R. Yazdani Aminabadi, M. Zhang, X. Wu, C. Li, and Y . He, “Zeroquant: Efficient and affordable post-training quantization for large- scale transformers,” in Advances in Neural Information Processing Systems, vol. 35. Curran Associates, Inc., 2022, pp. 27 168–27 183
work page 2022
-
[5]
Efficient post-training quantization with fp8 formats,
H. Shen, N. Mellempudi, X. He, Q. Gao, C. Wang, and M. Wang, “Efficient post-training quantization with fp8 formats,” in Proceedings of Machine Learning and Systems , P. Gibbons, G. Pekhimenko, and C. D. Sa, Eds., vol. 6, 2024, pp. 483–498
work page 2024
-
[6]
Fused fp8 4-way dot product with scaling and fp32 accumulation,
D. R. Lutz, A. Saini, M. Kroes, T. Elmer, and H. Valsaraju, “Fused fp8 4-way dot product with scaling and fp32 accumulation,” in 2024 IEEE 31st Symposium on Computer Arithmetic (ARITH) . IEEE, 2024, pp. 40–47
work page 2024
-
[7]
S. K. Lee, A. Agrawal, J. Silberman, M. Ziegler, M. Kang, S. Venkatara- mani, N. Cao, B. Fleischer, M. Guillorn, M. Cohen et al. , “A 7-nm four-core mixed-precision ai chip with 26.2-tflops hybrid-fp8 training, 104.9-tops int4 inference, and workload-aware throttling,” IEEE Journal of Solid-State Circuits , vol. 57, no. 1, pp. 182–197, 2021
work page 2021
Show all 25 references
-
[8]
A 28-nm 8-bit floating- point tensor core-based programmable cnn training processor with dy- namic structured sparsity,
S. K. Venkataramanaiah, J. Meng, H.-S. Suh, I. Yeo, J. Saikia, S. K. Cherupally, Y . Zhang, Z. Zhang, and J.-S. Seo, “A 28-nm 8-bit floating- point tensor core-based programmable cnn training processor with dy- namic structured sparsity,” IEEE Journal of Solid-State Circuits, ...
2023
-
[9]
Nvidia hopper gpu and grace cpu highlights,
A. C. Elster and T. A. Haugdahl, “Nvidia hopper gpu and grace cpu highlights,” Computing in Science & Engineering , vol. 24, no. 2, pp. 95–100, 2022
2022
-
[10]
Ultrascale architecture configurable logic block user guide
AMD Xilinx. Ultrascale architecture configurable logic block user guide. Accessed: 2024-11-11. [Online]. Available: https://docs.amd. com/v/u/en-US/ug574-ultrascale-clb
2024
-
[11]
Fp8 formats for deep learning,
P. Micikevicius, D. Stosic, N. Burgess, M. Cornea, P. Dubey, R. Grisen- thwaite, S. Ha, A. Heinecke, P. Judd, J. Kamalu et al., “Fp8 formats for deep learning,” arXiv preprint arXiv:2209.05433 , 2022
2022 arXiv
-
[12]
Fp8 versus int8 for efficient deep learning inference,
M. van Baalen, A. Kuzmin, S. S. Nair, Y . Ren, E. Mahurin, C. Patel, S. Subramanian, S. Lee, M. Nagel, J. Soriaga et al. , “Fp8 versus int8 for efficient deep learning inference,” arXiv preprint arXiv:2303.17951, 2023
2023 arXiv
-
[13]
An improved logarithmic multiplier for energy-efficient neural computing,
M. S. Ansari, B. F. Cockburn, and J. Han, “An improved logarithmic multiplier for energy-efficient neural computing,” IEEE Transactions on Computers, vol. 70, no. 4, pp. 614–625, 2020
2020
-
[14]
Heam: High-efficiency approximate multiplier optimization for deep neural networks,
S. Zheng, Z. Li, Y . Lu, J. Gao, J. Zhang, and L. Wang, “Heam: High-efficiency approximate multiplier optimization for deep neural networks,” in 2022 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 2022, pp. 3359–3363
2022
-
[15]
Opti- mally approximated and unbiased floating-point multiplier with runtime configurability,
C. Chen, S. Yang, W. Qian, M. Imani, X. Yin, and C. Zhuo, “Opti- mally approximated and unbiased floating-point multiplier with runtime configurability,” in Proceedings of the 39th international conference on computer-aided design (ICCAD) , 2020, pp. 1–9
2020
-
[16]
Smapproxlib: Library of fpga- based approximate multipliers,
S. Ullah, S. S. Murthy, and A. Kumar, “Smapproxlib: Library of fpga- based approximate multipliers,” in Proceedings of the 55th Annual Design Automation Conference (DAC) . New York, NY , ACM, 2018, pp. 1–6
2018
-
[17]
Area- optimized accurate and approximate softcore signed multiplier architec- tures,
S. Ullah, H. Schmidl, S. S. Sahoo, S. Rehman, and A. Kumar, “Area- optimized accurate and approximate softcore signed multiplier architec- tures,” IEEE Transactions on Computers , vol. 70, no. 3, pp. 384–392, 2020
2020
-
[18]
High-performance accurate and approximate multipliers for fpga-based hardware accel- erators,
S. Ullah, S. Rehman, M. Shafique, and A. Kumar, “High-performance accurate and approximate multipliers for fpga-based hardware accel- erators,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems , vol. 41, no. 2, pp. 211–224, 2021
2021
-
[19]
Bitsys: Bitwise systolic array architec- ture for multi-precision quantized hardware accelerators,
Y . Liu, S. Ullah, and A. Kumar, “Bitsys: Bitwise systolic array architec- ture for multi-precision quantized hardware accelerators,” in 2024 IEEE 32nd Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) . IEEE, 2024, pp. 220–220
2024
-
[20]
Axospike: Spiking neural networks-driven approximate operator design,
S. Ullah, S. S. Sahoo, and A. Kumar, “Axospike: Spiking neural networks-driven approximate operator design,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems , vol. 43, no. 11, pp. 3324–3335, 2024
2024
-
[21]
Dyrecmul: Fast and low-cost approximate multiplier for fpgas using dynamic reconfigura- tion,
S. Vakili, M. Vaziri, A. Zarei, and J. P. Langlois, “Dyrecmul: Fast and low-cost approximate multiplier for fpgas using dynamic reconfigura- tion,” ACM Transactions on Reconfigurable Technology and Systems , 2024
2024
-
[22]
Improving power of dsp and cnn hardware accelerators using ap- proximate floating-point multipliers,
V . Leon, T. Paparouni, E. Petrongonas, D. Soudris, and K. Pekmestzi, “Improving power of dsp and cnn hardware accelerators using ap- proximate floating-point multipliers,” ACM Transactions on Embedded Computing Systems (TECS) , vol. 20, no. 5, pp. 1–21, 2021
2021
-
[23]
Area-optimized low-latency approximate multipliers for fpga-based hardware accelerators,
S. Ullah, S. Rehman, B. S. Prabakaran, F. Kriebel, M. A. Hanif, M. Shafique, and A. Kumar, “Area-optimized low-latency approximate multipliers for fpga-based hardware accelerators,” in Proceedings of the 55th Annual Design Automation Conference , ser. DAC ’18, 2018
2018
-
[25]
Lw-gcn: A lightweight fpga-based graph convolutional network accelerator,
Z. Tao, C. Wu, Y . Liang, K. Wang, and L. He, “Lw-gcn: A lightweight fpga-based graph convolutional network accelerator,” ACM Transactions on Reconfigurable Technology and Systems , vol. 16, no. 1, pp. 1–19, 2022
2022
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.