A complete discussion on fully reconfigurable, digital, scalable, graph and sparsity-aware near-memory accelerator for graph neural networks
Pith reviewed 2026-06-30 17:53 UTC · model grok-4.3
The pith
NEM-GNN uses a DAC/ADC-less near-memory design to accelerate graph neural networks with early termination and sparsity-aware aggregation.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
NEM-GNN is a scalable processing-in-memory architecture that eliminates DACs and ADCs, applies early compute termination and reconfigurable system-on-chip pre-computation, and uses a compute-as-soon-as-ready broadcast model for graph- and sparsity-aware near-memory aggregation, yielding 80-230x higher performance, 80-300x higher throughput, 850-1134x better energy efficiency, and 7-8x higher compute density than prior state-of-the-art approaches.
What carries the argument
The compute-as-soon-as-ready (CAR) and broadcast-based execution model for graph- and sparsity-aware near-memory aggregation.
If this is right
- GNN workloads can execute with orders-of-magnitude lower energy than on CPUs, GPUs, or prior accelerators.
- The absence of DAC/ADC circuits allows higher compute density and better scaling to larger graphs.
- Early termination and CAR execution reduce wasted work on irregular sparse data.
- Reconfigurable pre-computation supports both dense convolution and sparse aggregation in one fabric.
Where Pith is reading between the lines
- The reconfigurable elements may support adaptation to new GNN variants without full hardware respins.
- The near-memory approach could extend to other sparse workloads such as recommendation systems or scientific simulations.
- Integration of the CAR model with existing memory hierarchies might reduce the need for custom silicon in future chips.
Load-bearing premise
The reported performance and energy numbers reflect complete comparisons that include all reconfiguration, control, and data-movement overheads.
What would settle it
A side-by-side measurement of NEM-GNN against a prior accelerator on the same platform that accounts for every overhead and yields speedups below 10x would disprove the performance claims.
Figures
read the original abstract
Graph neural networks (GNNs) have gained significant interest for applications such as citation network analysis and drug discovery due to their ability to apply machine learning techniques on graph-structured data. GNNs typically employ a two-stage execution pipeline consisting of combination and aggregation kernels. The combination stage performs data-intensive convolution operations with relatively regular memory access patterns, whereas the aggregation stage operates on sparse graph data with highly irregular accesses. These heterogeneous memory behaviors make conventional CPU- and GPU-based execution energy inefficient due to substantial data movement overheads. Existing accelerators attempt to mitigate these challenges using specialized architectures and processing-in-memory (PIM) techniques. However, prior approaches often suffer from scalability limitations, area overheads, restricted parallelism, and energy inefficiencies associated with analog compute and dedicated accelerator structures. This paper presents NEM-GNN, a scalable DAC/ADC-less processing-in-memory architecture for graph neural network acceleration. The proposed design introduces early compute termination mechanisms, pre-computation using reconfigurable system-on-chip components, and graph- and sparsity-aware near-memory aggregation using a compute-as-soon-as-ready (CAR) and broadcast-based execution model. Experimental results demonstrate that NEM-GNN achieves approximately 80--230x higher performance, 80--300x higher throughput, 850--1134x better energy efficiency, and 7--8x higher compute density compared to prior state-of-the-art approaches.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes NEM-GNN, a fully reconfigurable, digital, scalable, graph- and sparsity-aware near-memory accelerator for GNNs. It introduces early compute termination mechanisms, pre-computation using reconfigurable SoC components, and graph/sparsity-aware near-memory aggregation via a compute-as-soon-as-ready (CAR) and broadcast-based execution model in a DAC/ADC-less PIM fabric. The central claim, supported by experimental results, is that NEM-GNN delivers approximately 80--230x higher performance, 80--300x higher throughput, 850--1134x better energy efficiency, and 7--8x higher compute density versus prior state-of-the-art approaches.
Significance. If the reported speedups and efficiency gains are shown to incorporate the full costs of the proposed mechanisms, the work would constitute a meaningful contribution to digital PIM architectures for irregular workloads, offering a scalable alternative to analog and fixed-structure accelerators while addressing data-movement bottlenecks in GNN combination and aggregation stages.
major comments (2)
- [Experimental Results] Experimental Results section: the headline quantitative claims (80--230x performance, 850--1134x energy efficiency) rest on the assumption that all reconfiguration, control, and data-movement overheads of the CAR execution model, reconfigurable SoC pre-computation, and broadcast mechanisms are included in the cycle-accurate or analytical models; the section provides no explicit validation or breakdown demonstrating this, which directly undermines the apples-to-apples comparison with baselines.
- [§4] §4 (or equivalent evaluation subsection): no description is given of the benchmark selection, input graph characteristics, error bars, or the precise modeling of PIM fabric control logic costs; without these, the 7--8x compute-density claim cannot be assessed as load-bearing evidence.
minor comments (2)
- [Abstract] Abstract: the performance numbers are stated without any reference to methodology, benchmarks, or validation approach, reducing immediate clarity.
- [Introduction / Architecture] Notation for CAR and broadcast model: the description in the introduction and architecture sections would benefit from a small diagram or pseudocode to clarify the timing of 'as-soon-as-ready' decisions relative to sparsity patterns.
Simulated Author's Rebuttal
We appreciate the referee's detailed review and constructive feedback on our manuscript. We address the major comments below and will revise the paper to incorporate additional details and clarifications as requested.
read point-by-point responses
-
Referee: [Experimental Results] Experimental Results section: the headline quantitative claims (80--230x performance, 850--1134x energy efficiency) rest on the assumption that all reconfiguration, control, and data-movement overheads of the CAR execution model, reconfigurable SoC pre-computation, and broadcast mechanisms are included in the cycle-accurate or analytical models; the section provides no explicit validation or breakdown demonstrating this, which directly undermines the apples-to-apples comparison with baselines.
Authors: We thank the referee for highlighting this important point. Our cycle-accurate simulator and analytical models do account for the reconfiguration, control, and data-movement overheads associated with the CAR execution model, reconfigurable SoC pre-computation, and broadcast mechanisms. These costs are modeled based on the hardware implementation details provided in Sections 3 and 4. However, to make this explicit and strengthen the comparison, we will add a dedicated subsection in the Experimental Results section that provides a breakdown of these overheads and validation against the baseline models. This will ensure transparency in the apples-to-apples comparison. revision: yes
-
Referee: [§4] §4 (or equivalent evaluation subsection): no description is given of the benchmark selection, input graph characteristics, error bars, or the precise modeling of PIM fabric control logic costs; without these, the 7--8x compute-density claim cannot be assessed as load-bearing evidence.
Authors: We agree that additional details on the evaluation methodology are necessary for full assessment of the results. In the revised manuscript, we will expand Section 4 (or the evaluation subsection) to include: (1) a detailed description of the benchmark selection criteria and the characteristics of the input graphs used (e.g., number of nodes, edges, sparsity levels), (2) error bars or statistical measures from multiple runs where applicable, and (3) a precise description of how the PIM fabric control logic costs are modeled in our simulations, including area and energy estimates. This will provide the necessary context to evaluate the 7--8x compute-density claim. revision: yes
Circularity Check
No circularity: architecture paper with experimental claims, no derivation chain or fitted parameters
full rationale
The paper describes a hardware architecture (NEM-GNN) and reports empirical speedups/energy numbers from experiments against prior SOTA. No equations, fitted parameters, self-definitional steps, or load-bearing self-citations appear in the abstract or description. Claims rest on external benchmark comparisons rather than reducing to inputs by construction. This matches the default expectation of no significant circularity for non-mathematical papers.
Axiom & Free-Parameter Ledger
Forward citations
Cited by 4 Pith papers
-
A comprehensive study on ILP acceleration accounting for sparsity, area, energy, data movement using near-memory architecture
SPARK is a sparsity-aware near-cache ILP accelerator achieving up to 15x performance and 152x energy reduction over CPUs for sparse ILPs on MIPLIB 2017 workloads.
-
A comprehensive study on ILP acceleration accounting for sparsity, area, energy, data movement using near-memory architecture
SPARK is a sparsity-aware near-cache ILP accelerator that reuses L1 cache structures to deliver up to 15x speedup and 152x energy reduction versus CPUs on sparse MIPLIB workloads with 1.4% area overhead.
-
A detailed algorithmic study on a reuse-aware, near memory, all-digital Ising machine
SACHI reuses CPU L1 cache for all-digital Ising acceleration and reports 300x performance and 80x energy gains over BRIM on asset allocation, molecular dynamics, image segmentation, and TSP.
-
Emerging memory technologies at room/cryogenic temperature
Overview chapter surveying volatile and non-volatile memories including SRAM, DRAM, RRAM, MRAM, FeFET and cryogenic JJFET devices, with focus on principles, tradeoffs, and challenges.
Reference graph
Works this paper leans on
-
[1]
Pavan Kumar Reddy Boppidi, S. Siddhartha Raman, H. Renuka, and Souvik Kundu. 2020. Pt/Cu:ZnO/Nb:STO memristive dual port for cache memory applications.AIP Conference Proceedings2265, 1 (11 2020), 030212. https://doi.org/10. 1063/5.0016597 arXiv:https://pubs.aip.org/aip/acp/article-pdf/doi/10.1063/5.0016597/14105127/030212_1_online.pdf
work page doi:10.1063/5.0016597/14105127/030212_1_online.pdf 2020
-
[2]
Michael M Bronstein, Joan Bruna, Yann LeCun, Arthur Szlam, and Pierre Vandergheynst. 2017. Geometric deep learning: going beyond euclidean data.IEEE Signal Processing Magazine34, 4 (2017), 18–42
2017
-
[3]
Nagadastagiri Challapalle, Karthik Swaminathan, Nandhini Chandramoorthy, and Vijaykrishnan Narayanan. 2021. Crossbar based Processing in Memory Accelerator Architecture for Graph Convolutional Networks. In2021 IEEE/ACM International Conference On Computer Aided Design (ICCAD). 1–9. https://doi.org/10.1109/ICCAD51958.2021.9643465
-
[4]
Jiaxian Chen, Yiquan Lin, Kaoyi Sun, Jiexin Chen, Chenlin Ma, Rui Mao, and Yi Wang. 2022. GCIM: Toward Efficient Processing of Graph Convolutional Networks in 3D-Stacked Memory.IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems41, 11 (2022), 3579–3590. https://doi.org/10.1109/TCAD.2022.3198320
-
[5]
Yuhan Chen, Alireza Khadem, Xin He, Nishil Talati, Tanvir Ahmed Khan, and Trevor Mudge. 2023. PEDAL: A Power Efficient GCN Accelerator with Multiple DAtafLows. In2023 Design, Automation & Test in Europe Conference Exhibition (DATE). 1–6. https://doi.org/10.23919/DATE56975.2023.10137240
-
[6]
Matthias Fey and Jan Eric Lenssen. 2019. Fast graph representation learning with PyTorch Geometric.arXiv preprint arXiv:1903.02428(2019)
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[7]
Tong Geng, Ang Li, Runbin Shi, Chunshu Wu, Tianqi Wang, Yanfei Li, Pouya Haghi, Antonino Tumeo, Shuai Che, Steve Reinhardt, et al. 2020. AWB-GCN: A graph convolutional network accelerator with runtime workload rebalancing. In 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO). IEEE, 922–936
2020
-
[8]
Yu Huang, Long Zheng, Pengcheng Yao, Qinggang Wang, Xiaofei Liao, Hai Jin, and Jingling Xue. 2022. Accelerating Graph Convolutional Networks Using Crossbar-based Processing-In-Memory Architectures. In2022 IEEE International Symposium on High-Performance Computer Architecture (HPCA). IEEE, 1029–1042
2022
-
[9]
Chanwoo Jeong, Sion Jang, Eunjeong Park, and Sungchul Choi. 2020. A context-aware citation recommendation model with BERT and graph convolutional networks.Scientometrics124, 3 (2020), 1907–1922
2020
-
[10]
Kulkarni, Siddhartha Raman Sundara Raman, Shanshan Xie, and Chieh-Pu Lo
Jaydeep P. Kulkarni, Siddhartha Raman Sundara Raman, Shanshan Xie, and Chieh-Pu Lo. 2025. Unconventional Computing Using Ising Accelerators.Computer58, 6 (2025), 83–86. https://doi.org/10.1109/MC.2025.3544798
-
[11]
Sukhan Lee, Shin-haeng Kang, Jaehoon Lee, Hyeonsu Kim, Eojin Lee, Seungwoo Seo, Hosang Yoon, Seungwon Lee, Kyounghwan Lim, Hyunsung Shin, Jinhyun Kim, O Seongil, Anand Iyer, David Wang, Kyomin Sohn, and Nam Sung Kim. 2021. Hardware Architecture and Software Stack for PIM Based on Commercial DRAM Technology : Industrial Product. In2021 ACM/IEEE 48th Annual...
- [12]
- [13]
-
[14]
S. S. Teja Nibhanupudi, Siddhartha Raman Sundara Raman, Mikaël Cassé, Louis Hutin, and Jaydeep P. Kulkarni. 2021. Ultra-Low-Voltage UTBB-SOI-Based, Pseudo-Static Storage Circuits for Cryogenic CMOS Applications.IEEE Journal on Exploratory Solid-State Computational Devices and Circuits7, 2 (2021), 201–208. https://doi.org/10.1109/JXCDC. 2021.3130839
- [15]
-
[16]
Yikan Qiu, Yufei Ma, Wentao Zhao, Meng Wu, Le Ye, and Ru Huang. 2022. DCIM-GCN: Digital Computing-in-Memory to Efficiently Accelerate Graph Convolutional Networks. In2022 IEEE/ACM International Conference On Computer Aided Design (ICCAD). 1–9
2022
-
[17]
Siddhartha Raman Sundara Raman. 2024. A Review on Non-Volatile and Volatile Emerging Memory Technologies. InComputer Memory and Data Storage, Azam Seyedi (Ed.). IntechOpen, Rijeka, Chapter 3. https://doi.org/10.5772/ intechopen.110617
2024
-
[18]
2026.Compute in eDRAM using indium gallium zinc oxide transistors
Siddhartha Raman Sundara Raman. 2026.Compute in eDRAM using indium gallium zinc oxide transistors. Ph.D. dissertation. The University of Texas at Austin. https://repositories.lib.utexas.edu/items/4dbc7f92-c062-4cb8-b07b- ed29761b9704 Available: https://repositories.lib.utexas.edu/items/4dbc7f92-c062-4cb8-b07b-ed29761b9704
2026
-
[19]
Siddhartha Raman Sundara Raman. 2026. Emerging memory technologies at room/cryogenic temperature. arXiv:2605.21912 [cs.AR] https://arxiv.org/abs/2605.21912
work page internal anchor Pith review Pith/arXiv arXiv 2026
-
[20]
Revisiting reliability in large-scale machine learning research clusters
Siddhartha Raman Sundara Raman, Lizy John, and Jaydeep P. Kulkarni. 2025. SPARK: Sparsity Aware, Low Area, Energy-Efficient, Near-memory Architecture for Accelerating Linear Programming Problems. In2025 IEEE International Symposium on High Performance Computer Architecture (HPCA). 99–112. https://doi.org/10.1109/HPCA61900.2025.00019
-
[21]
Siddhartha Raman Sundara Raman, Lizy K John, and Jaydeep P. Kulkarni. 2026. A comprehensive study on ILP acceler- ation accounting for sparsity, area, energy, data movement using near-memory architecture. arXiv:2605.17158 [cs.AR] https://arxiv.org/abs/2605.17158
work page internal anchor Pith review Pith/arXiv arXiv 2026
-
[22]
A detailed algorithmic study on a reuse-aware, near memory, all-digital Ising machine
Siddhartha Raman Sundara Raman, Lizy K. John, and Jaydeep P. Kulkarni. 2026. A detailed algorithmic study on a reuse-aware, near memory, all-digital Ising machine. arXiv:2605.12959 [cs.AR] https://arxiv.org/abs/2605.12959
work page internal anchor Pith review Pith/arXiv arXiv 2026
-
[23]
Siddhartha Raman Sundara Raman and Jaydeep P. Kulkarni. 2026. ABI: A tightly integrated, unified, sparsity-aware, reconfigurable, compute near-register file/cache GPU architecture with light-weight softmax for deep learning, linear algebra, and Ising compute. arXiv:2602.14262 [cs.AR] https://arxiv.org/abs/2602.14262
work page internal anchor Pith review Pith/arXiv arXiv 2026
-
[24]
Siddhartha Raman Sundara Raman, Siyuan Ma, and Lizy Kurian John. 2026. A comparative study on power delivery aspects of compute-in/near-memory approaches using DRAM. arXiv:2604.04773 [cs.AR] https://arxiv.org/abs/2604. 04773
work page internal anchor Pith review Pith/arXiv arXiv 2026
-
[25]
Siddhartha Raman Sundara Raman, S. S. Teja Nibhanupudi, Atanu K. Saha, Sumeet Gupta, and Jaydeep P. Kulkarni. 2021. Threshold Selector and Capacitive Coupled Assist Techniques for Write Voltage Reduction in Metal–Ferroelectric–Metal Field-Effect Transistor.IEEE Transactions on Electron Devices68, 12 (2021), 6132–6138. https://doi.org/10.1109/TED. 2021.3121348
work page doi:10.1109/ted 2021
-
[26]
Siddhartha Raman Sundara Raman, Feng Wen, Ravi Pillarisetty, Vivek De, and Jaydeep P. Kulkarni. 2021. High Noise Margin, Digital Logic Design Using Josephson Junction Field-Effect Transistors for Cryogenic Computing.IEEE Transactions on Applied Superconductivity31, 5 (2021), 1–5. https://doi.org/10.1109/TASC.2021.3054347
-
[27]
Siddhartha Raman Sundara Raman, Shanshan Xie, and Jaydeep P Kulkarni. 2022. IGZO CIM: Enabling In-Memory Computations Using Multilevel Capacitorless Indium–Gallium–Zinc–Oxide-Based Embedded DRAM Technology. IEEE Journal on Exploratory Solid-State Computational Devices and Circuits8, 1 (2022), 35–43
2022
-
[28]
Siddhartha Raman Sundara Raman, Shanshan Xie, and Jaydeep P.Kulkarni. 2021. Compute-in-eDRAM with Backend Integrated Indium Gallium Zinc Oxide Transistors. In2021 IEEE International Symposium on Circuits and Systems (ISCAS). 1–5. https://doi.org/10.1109/ISCAS51556.2021.9401798
-
[29]
Rishov Sarkar, Stefan Abi-Karam, Yuqi He, Lakshmi Sathidevi, and Cong Hao. 2023. FlowGNN: A Dataflow Architecture for Real-Time Workload-Agnostic Graph Neural Network Inference. In2023 IEEE International Symposium on High- Performance Computer Architecture (HPCA). 1099–1112. https://doi.org/10.1109/HPCA56546.2023.10071015
-
[30]
James E Stine, Ivan Castellanos, Michael Wood, Jeff Henson, Fred Love, W Rhett Davis, Paul D Franzon, Michael Bucher, Sunil Basavarajaiah, Julie Oh, et al. 2007. FreePDK: An open-source variation-aware design kit. In2007 IEEE international conference on Microelectronic Systems Education (MSE’07). IEEE, 173–174
2007
-
[31]
Siddhartha Raman Sundara Raman, Lizy John, and Jaydeep P. Kulkarni. 2024. NEM-GNN: DAC/ADC-less, Scalable, Reconfigurable, Graph and Sparsity-Aware Near-Memory Accelerator for Graph Neural Networks.ACM Trans. Archit. Code Optim.21, 2, Article 39 (May 2024), 26 pages. https://doi.org/10.1145/3652607
-
[32]
InProceedings of the IEEE International Symposium on High-Performance Computer Architecture (HPCA)
Siddhartha Raman Sundara Raman, Lizy K. John, and Jaydeep P. Kulkarni. 2024. SACHI: A Stationarity-Aware, All-Digital, Near-Memory, Ising Architecture. In2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA). 719–731. https://doi.org/10.1109/HPCA57654.2024.00061
-
[33]
Siddhartha Raman Sundara Raman, S. S. Teja Nibhanupudi, and Jaydeep P. Kulkarni. 2022. Enabling In-Memory Computations in Non-Volatile SRAM Designs.IEEE Journal on Emerging and Selected Topics in Circuits and Systems12, 2 (2022), 557–568. https://doi.org/10.1109/JETCAS.2022.3174148
-
[34]
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks.arXiv preprint arXiv:1710.10903(2017)
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[35]
Hongwei Wang, Jialin Wang, Jia Wang, Miao Zhao, Weinan Zhang, Fuzheng Zhang, Wenjie Li, Xing Xie, and Minyi Guo. 2019. Learning graph representation with generative adversarial nets.IEEE Transactions on Knowledge and Data Engineering33, 8 (2019), 3090–3103
2019
-
[36]
Shanshan Xie, Siddhartha Raman Sundara Raman, Can Ni, Meizhi Wang, Mengtian Yang, and Jaydeep P. Kulkarni. 2022. Ising-CIM: A Reconfigurable and Scalable Compute Within Memory Analog Ising Accelerator for Solving Combinatorial Optimization Problems.IEEE Journal of Solid-State Circuits(2022), 1–13. https://doi.org/10.1109/JSSC.2022.3176610
-
[37]
Xinfeng Xie, Zheng Liang, Peng Gu, Abanti Basak, Lei Deng, Ling Liang, Xing Hu, and Yuan Xie. 2021. Spacea: Sparse matrix vector multiplication on processing-in-memory accelerator. In2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA). IEEE, 570–583
2021
-
[38]
Mingyu Yan, Lei Deng, Xing Hu, Ling Liang, Yujing Feng, Xiaochun Ye, Zhimin Zhang, Dongrui Fan, and Yuan Xie
-
[39]
In2020 IEEE International Symposium on High Performance Computer Architecture (HPCA)
Hygcn: A gcn accelerator with hybrid architecture. In2020 IEEE International Symposium on High Performance Computer Architecture (HPCA). IEEE, 15–29
-
[40]
Tao Yang, Dongyue Li, Yibo Han, Yilong Zhao, Fangxin Liu, Xiaoyao Liang, Zhezhi He, and Li Jiang. 2021. PIMGCN: A ReRAM-Based PIM Design for Graph Convolutional Network Acceleration. In2021 58th ACM/IEEE Design Automation Conference (DAC). 583–588. https://doi.org/10.1109/DAC18074.2021.9586231
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.