Training a GNN by querying a graph database for neighbor samples and features reduces memory use enough to train on small machines, but is much slower than in-memory training.
G-Tran: Making Distributed Graph Transactions Fast
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Graph transaction processing raises many unique challenges such as random data access due to the irregularity of graph structures, low throughput and high abort rate due to the relatively large read/write sets in graph transactions. To address these challenges, we present G-Tran -- an RDMA-enabled distributed in-memory graph database with serializable and snapshot isolation support. First, we propose a graph-native data store to achieve good data locality and fast data access for transactional updates and queries. Second, G-Tran adopts a fully decentralized architecture that leverages RDMA to process distributed transactions with the MPP model, which can achieve high performance by utilizing all computing resources. In addition, we propose a new MV-OCC implementation with two optimizations to address the issue of large read/write sets in graph transactions. Extensive experiments show that G-Tran achieves competitive performance compared with other popular graph databases on benchmark workloads.
fields
cs.LG 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Graph Neural Networks on Graph Databases
Training a GNN by querying a graph database for neighbor samples and features reduces memory use enough to train on small machines, but is much slower than in-memory training.