Pith. sign in

REVIEW 15 cited by

A Survey of Graph Meets Large Language Model: Progress and Future Directions

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2311.12399 v4 pith:XHVYJVWT submitted 2023-11-21 cs.LG cs.CLcs.SI

A Survey of Graph Meets Large Language Model: Progress and Future Directions

classification cs.LG cs.CLcs.SI
keywords methodsexistinggraphllmsnetworkssurveycategoriesfirst
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Graph plays a significant role in representing and analyzing complex relationships in real-world applications such as citation networks, social networks, and biological data. Recently, Large Language Models (LLMs), which have achieved tremendous success in various domains, have also been leveraged in graph-related tasks to surpass traditional Graph Neural Networks (GNNs) based methods and yield state-of-the-art performance. In this survey, we first present a comprehensive review and analysis of existing methods that integrate LLMs with graphs. First of all, we propose a new taxonomy, which organizes existing methods into three categories based on the role (i.e., enhancer, predictor, and alignment component) played by LLMs in graph-related tasks. Then we systematically survey the representative methods along the three categories of the taxonomy. Finally, we discuss the remaining limitations of existing studies and highlight promising avenues for future research. The relevant papers are summarized and will be consistently updated at: https://github.com/yhLeeee/Awesome-LLMs-in-Graph-tasks.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 15 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. When Graph Tokens Sink: A Mechanistic Analysis of Graph Language Models

    cs.LG 2026-06 unverdicted novelty 7.0

    Mechanistic analysis of GLMs shows graph sink tokens have high activation but low importance for predictions, indicating decoupling between saliency and graph-semantic utility.

  2. Learning Posterior Predictive Distributions for Node Classification from Synthetic Graph Priors

    cs.LG 2026-04 unverdicted novelty 7.0

    NodePFN pre-trains on synthetic graphs with controllable homophily and causal feature-label models to achieve 71.27 average accuracy on 23 node classification benchmarks without graph-specific training.

  3. Same Graph Cross-Task Transfer in GNNs: Protocols and Predictors

    cs.LG 2026-07 conditional novelty 6.0

    Under a fixed leakage-free protocol, NC→LP transfer reliably helps on homophilic graphs while LP→NC helps mainly when LP is easy and NC is unsaturated; homophily and CoTask Score guide mechanism choice.

  4. GraspLLM: Towards Zero-Shot Generalization on Text-Attributed Graphs with LLMs

    cs.CL 2026-06 unverdicted novelty 6.0

    GraspLLM extracts dataset-agnostic structural patterns via motif contrastive learning and aligns contextual subgraphs to LLM tokens, outperforming prior LLM-based methods on TAGs especially in zero-shot settings.

  5. Hypergraph as Language

    cs.CL 2026-05 unverdicted novelty 6.0

    Hyper-Align is a hypergraph-native framework that serializes high-order relations into LLM-compatible tokens via HIDT-O templates and a HIP projector, outperforming graph-centric methods on HyperAlign-Bench.

  6. SAGE: A Self-Evolving Agentic Graph-Memory Engine for Structure-Aware Associative Memory

    cs.AI 2026-05 unverdicted novelty 6.0

    SAGE is a self-evolving agentic graph-memory engine that dynamically constructs and refines structured memory graphs via writer-reader feedback, yielding performance gains on multi-hop QA, open-domain retrieval, and l...

  7. GRAFT: Graph-Tokenized LLMs for Tool Planning

    cs.LG 2026-05 unverdicted novelty 6.0

    GRAFT internalizes tool dependency graphs via dedicated special tokens in LLMs and applies on-policy context distillation to achieve higher exact sequence matching and dependency legality than prior external-graph methods.

  8. MMP-Refer: Multimodal Path Retrieval-augmented LLMs For Explainable Recommendation

    cs.IR 2026-04 conditional novelty 6.0

    MMP-Refer augments LLMs with multimodal retrieval paths and a trainable collaborative adapter to produce more accurate and explainable recommendations.

  9. A Hierarchical Quantized Tokenization Framework for Task-Adaptive Graph Representation Learning

    cs.IR 2025-10 unverdicted novelty 6.0

    A hierarchical quantized tokenization framework with task-adaptive routing and dual-view streams for improved graph representation learning on node classification and link prediction.

  10. GLIP: Graph and LLM Joint Pretraining for Graph-Level Tasks

    cs.LG 2026-06 unverdicted novelty 5.0

    GLIP is a joint GNN-LLM pretraining framework that uses augmentation, multi-token selection, a diffusion projector, and combined contrastive plus semantic losses to boost graph classification and reasoning after fine-...

  11. TCAR-Gen: Temporal Graph Retrieval with Evidence Fusion for Knowledge-Grounded Generation

    cs.CL 2026-04 conditional novelty 5.0

    A query-conditioned temporal graph RAG with chain-of-trees fusion reaches 0.3738 Recall@5 on a Victorian crime diaries QA set, beating standard and graph RAG baselines.

  12. Are Large Language Models Suitable for Graph Computation? Progress and Prospects

    cs.CL 2026-06 unverdicted novelty 4.0

    A survey of LLMs for graph computation introduces a role-based taxonomy of executors versus planners and concludes that current models suit simple small-scale tasks but remain unreliable for large-scale exact computation.

  13. A Hierarchical Quantized Tokenization Framework for Task-Adaptive Graph Representation Learning

    cs.IR 2025-10 conditional novelty 4.0

    QUIET is a hierarchical RVQ-based graph tokenizer with a learned level-weighting gate; it improves several benchmarks but not consistently against the strongest baselines.

  14. Fusing Knowledge and Language: A Comparative Study of Knowledge Graph-Based Question Answering with LLMs

    cs.AI 2025-09 reject novelty 4.0

    In a small comparative study, GraphRAG outscored spaCy and CoreNLP-based KG-QA pipelines on reasoning-heavy questions, but the evaluation design conflates method choice with pipeline architecture.

  15. Position: How can Graphs Help Large Language Models?

    cs.AI 2026-05 unverdicted novelty 3.0

    Graphs can help LLMs reduce hallucinations, boost reasoning via prompting techniques, and better process structured data.