REVIEW 19 cited by
GraphLLM: Boosting Graph Reasoning Ability of Large Language Model
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to images and audio. Despite this progress, a critical gap remains in empowering LLMs to proficiently understand and reason on graph data. Recent studies underscore LLMs' underwhelming performance on fundamental graph reasoning tasks. In this paper, we endeavor to unearth the obstacles that impede LLMs in graph reasoning, pinpointing the common practice of converting graphs into natural language descriptions (Graph2Text) as a fundamental bottleneck. To overcome this impediment, we introduce GraphLLM, a pioneering end-to-end approach that synergistically integrates graph learning models with LLMs. This synergy equips LLMs with the ability to proficiently interpret and reason on graph data, harnessing the superior expressive power of graph learning models. Our empirical evaluations across four fundamental graph reasoning tasks validate the effectiveness of GraphLLM. The results exhibit a substantial average accuracy enhancement of 54.44%, alongside a noteworthy context reduction of 96.45% across various graph reasoning tasks.
Forward citations
Cited by 19 Pith papers
-
Harnessing Adaptive Topology Representations for Zero-Shot Graph Question Answering
DynamicTRF learns question-level preferences over eight graph representations and routes each query to the best one, improving zero-shot graph QA accuracy and output brevity on seven algorithmic and two downstream tasks.
-
GraphRunner: A Multi-Stage Framework for Efficient and Accurate Graph-Based Retrieval
GraphRunner improves graph-based retrieval by generating and validating a complete traversal plan before executing high-level multi-hop actions, outperforming Graph-CoT on GRBENCH with 10 to 50 percent higher accuracy...
-
Toward a Graph Foundation Model: Pre-Training Transformers With Random Walks
A random-walk-based Transformer pre-trained on multiple graph datasets transfers to unseen node, link, and graph tasks, though its expressivity proofs are incomplete.
-
Efficient Text-Attributed Graph Learning through Selective Annotation and Graph Alignment
GAGA matches or exceeds state-of-the-art accuracy on several text-attributed graph benchmarks while requiring large language model annotations for only 1% of nodes or edges.
-
Graph Drawing for LLMs: An Empirical Evaluation
Graph layout and drawing quality measurably affect how well vision-capable LLMs answer graph queries, with orthogonal drawings helping path tasks and straight-line drawings helping global tasks.
-
When Do LLMs Help With Node Classification? A Comprehensive Analysis
LLM-based node classification methods give the largest gains in semi-supervised settings with few labels; their advantage over classic methods shrinks when supervision is abundant.
-
Bridging Visualization and Optimization: Multimodal Large Language Models on Graph-Structured Combinatorial Optimization
Feeding graph images to GPT-4o and refining its node choices with local search outperforms centrality and GNN baselines on influence maximization and network dismantling.
-
Monte Carlo Tree Search for Table-to-Multimodal Report Generation
MCTS-Report applies Monte Carlo Tree Search to multimodal table-to-report generation, reaching a 77.9 overall score on the new MMRBench benchmark, but its evaluation relies on a single, unvalidated LLM judge.
-
The Graph Language: How Knowledge Graphs Speak to Large Language Models
GRALAN uses question-focused subgraphs, a graph encoder, and a learned mediator to let a frozen LLM answer KG questions by classifying entities, reporting state-of-the-art or near-SOTA accuracy on several QA benchmarks.
-
A Comprehensive Data-centric Overview of Federated Graph Learning
A data-centric taxonomy for Federated Graph Learning that classifies 79 studies by data characteristics and data utilization, plus a discussion of integration with pre-trained large models.
-
Masked Language Models are Good Heterogeneous Graph Generalizers
A masked language model fine-tuned on metapath-derived text and cloze-style task templates transfers across heterogeneous graph datasets better than HGNN and LLM baselines, though link prediction results are compromis...
-
Graph Counselor: Adaptive Graph Exploration via Multi-Agent Synergy to Enhance LLM Reasoning
A multi-agent GraphRAG framework with self-reflection improves LLM accuracy on knowledge graph question answering.
-
Walk&Retrieve: Simple Yet Effective Zero-shot Retrieval-Augmented Generation via Knowledge Graph Walks
Offline walks over a knowledge graph, verbalized into text and retrieved by embedding similarity, let a single LLM call answer multi-hop questions competitively without any fine-tuning.
-
Scalability Matters: Overcoming Challenges in InstructGLM with Similarity-Degree-Based Sampling
SDM-InstructGLM uses a similarity-degree biased random walk to sample graph neighborhoods for LLM prompts, reporting gains over InstructGLM on CORA and PUBMED that are confounded by a change in node features and train...
-
Efficient Document Retrieval with G-Retriever
Attention-based subgraph selection plus joint node-edge encoding reaches 74.20 percent test accuracy on WebQSP, a 0.41-point gain over the G-Retriever baseline.
-
Trustworthy GNNs with LLMs: A Systematic Review and Taxonomy
A review that groups LLM-GNN trustworthiness research under four dimensions, reliability, robustness, privacy, and reasoning, with no new experiments.
-
Graph2text or Graph2token: A Perspective of Large Language Models for Graph Learning
LLM-for-graph methods are divided into Graph2text and Graph2token paradigms, with four conversion challenges and a model-selection guideline.
-
Thinking with Knowledge Graphs: Enhancing LLM Reasoning Through Structured Data
Representing knowledge graph triples as Python code improved LLM multi-hop reasoning accuracy over text and JSON in this study, though the effect is modest and possibly due to explicit inference steps in the code.
-
A Survey of Research in Large Language Models for Electronic Design Automation
A survey of LLM applications in electronic design automation, organized by design stage and adaptation technique.
Discussion (0). Continue with ORCID to comment.