REVIEW 2 cited by
GNNBENCH: Fair and Productive Benchmarking for Single-GPU GNN System
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We hypothesize that the absence of a standardized benchmark has allowed several fundamental pitfalls in GNN System design and evaluation that the community has overlooked. In this work, we propose GNNBench, a plug-and-play benchmarking platform focused on system innovation. GNNBench presents a new protocol to exchange their captive tensor data, supports custom classes in System APIs, and allows automatic integration of the same system module to many deep learning frameworks, such as PyTorch and TensorFlow. To demonstrate the importance of such a benchmark framework, we integrated several GNN systems. Our results show that integration with GNNBench helped us identify several measurement issues that deserve attention from the community.
Forward citations
Cited by 2 Pith papers
-
Graph Neural Networks Are More Than Filters: Revisiting and Benchmarking from A Spectral Perspective
GNNs can produce frequency components absent from their input, so their spectral behavior is not dominated by the aggregation filter, and a new benchmark quantifies this across 14 models.
-
GNN-Suite: a Graph Neural Network Benchmarking Framework for Biomedical Informatics
A new benchmarking framework built on Nextflow shows graph neural networks outperform feature-only logistic regression across four cancer-gene network configurations.
Discussion (0). Continue with ORCID to comment.