REVIEW 22 cited by
CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Leveraging Large Language Models as Recommenders (LLMRec) has gained significant attention and introduced fresh perspectives in user preference modeling. Existing LLMRec approaches prioritize text semantics, usually neglecting the valuable collaborative information from user-item interactions in recommendations. While these text-emphasizing approaches excel in cold-start scenarios, they may yield sub-optimal performance in warm-start situations. In pursuit of superior recommendations for both cold and warm start scenarios, we introduce CoLLM, an innovative LLMRec methodology that seamlessly incorporates collaborative information into LLMs for recommendation. CoLLM captures collaborative information through an external traditional model and maps it to the input token embedding space of LLM, forming collaborative embeddings for LLM usage. Through this external integration of collaborative information, CoLLM ensures effective modeling of collaborative information without modifying the LLM itself, providing the flexibility to employ various collaborative information modeling techniques. Extensive experiments validate that CoLLM adeptly integrates collaborative information into LLMs, resulting in enhanced recommendation performance. We release the code and data at https://github.com/zyang1580/CoLLM.
Forward citations
Cited by 22 Pith papers
-
Large Language Model as Universal Retriever in Industrial-Scale Recommender System
One LLM-based generative retrieval model, URM, with multi-query representation and matrix decomposition, outperforms task-specific retrieval models on several objectives and raised online advertising revenue by 3%.
-
GrocLM: Grocery Category Recommendation in E-Commerce with Large Language Models
A LoRA-tuned LLM with trie-constrained decoding improves grocery category recommendation and yields a 7.5% cart-add lift in production.
-
LLM4MEA: Data-free Model Extraction Attacks on Sequential Recommenders via Large Language Models
An LLM-driven agent generates synthetic interaction sequences that, when queried against a target sequential recommender, produce surrogate models with higher agreement to the target than random or autoregressive data...
-
Heterogeneous User Modeling for LLM-based Recommendation
HUM uses a compression prompt, a dedicated user token, input masking, and domain-reweighted training to improve LLM-based multi-domain recommendation.
-
GORACS: Group-level Optimal Transport-guided Coreset Selection for LLM-based Recommender Systems
GORACS selects small groups of fine-tuning examples via an optimal-transport and gradient-norm proxy objective, outperforming prior coreset methods for LLM-based recommendation.
-
GRAM: Generative Recommendation via Semantic-aware Multi-granular Late Fusion
GRAM improves LLM-based generative recommendation by translating item relationships into hierarchical textual IDs and fusing multi-granular prompts at the decoder, outperforming prior generative recommenders on four b...
-
Hierarchical Tree Search-based User Lifelong Behavior Modeling on Large Language Model
HiT-LBM chunks lifelong user behavior, uses process-rating-guided tree search to select interest summaries, and fuses them temporally to improve recommendation performance.
-
LLMs as Better Recommenders with Natural Language Collaborative Signals: A Self-Assessing Retrieval Approach
SCORE retrieves similar users' behaviors, uses an LLM self-assessment to rerank them, and injects the top ones in natural language into an LLM prompt, improving recommendation accuracy on two datasets.
-
Geography-Aware Large Language Models for Next POI Recommendation
GA-LLM augments a fine-tuned LLM with quadkey-Fourier geographic encoding and a projection of precomputed POI embeddings, beating baselines on next-POI Acc@1 on NYC, Tokyo, and California datasets.
-
Full-Stack Optimized Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation
ReLLaX combines semantic behavior retrieval, collaborative soft prompts, and a new fully interactive LoRA variant to improve LLM-based CTR prediction on long user histories.
-
Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendation
K-RagRec improves LLM-based recommendation by retrieving and encoding knowledge graph subgraphs as soft prompts, outperforming existing retrieval-augmented LLM recommenders on three datasets.
-
Preliminary Evaluation of the Test-Time Training Layers in Recommendation System (Student Abstract)
TTT4Rec, a sequential recommender using TTT-Linear as its feature extractor, performs comparably to or better than DIN, GRU4Rec, SASRec, and ComiRec on Beauty, Electronics, and MovieLens-1M.
-
TrackRec: Iterative Alternating Feedback with Chain-of-Thought via Preference Alignment for Recommendation
TrackRec trains a small LLM to generate user-preference summaries and a validator to score them, alternating the training so each improves the other, and reports gains on public and industrial recommendation benchmarks.
-
Reason4Rec: Deliberative User Preference Alignment of Large Language Models for Recommendation
An LLM recommender that decomposes preference reasoning into summarization, matching, and prediction steps, trained on review text, improves rating accuracy and explanation quality on Amazon and Yelp benchmarks.
-
Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendation
Molar combines multimodal LLM item embeddings with a contrastive post-alignment to an ID-based sequential recommender, reporting improved NDCG and Recall on three datasets.
-
ULMRec: User-centric Large Language Model for Sequential Recommendation
ULMRec reports improved next-item ranking on Amazon Beauty and Video Games by adding vector-quantized user indices and preference alignment tasks to an LLM, but possible leakage of held-out target reviews into the ind...
-
Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models
PAD, a pre-train, align, and disentangle framework, improves sequential recommenders, especially for cold items, by aligning frozen LLM embeddings with collaborative embeddings and fusing three experts with frequency-...
-
Cold-Start Recommendation towards the Era of Large Language Models (LLMs): A Comprehensive Survey and Roadmap
A comprehensive survey and roadmap that groups cold-start recommendation methods into four knowledge scopes and defines nine cold-start problem types.
-
Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenization
A recommender system that converts item IDs into shared code tokens and fine-tunes Llama with alignment tasks plus negative sampling beats LC-Rec on three Amazon datasets by a few percent.
-
Breaking Information Cocoons: A Hyperbolic Framework for Balancing Exploration and Exploitation in Recommender Systems
HERec aligns LLM-generated user and item profiles with collaborative signals in hyperbolic space and builds a hierarchy tree for user-controlled exploration and exploitation.
-
When Transformers Meet Recommenders: Integrating Self-Attentive Sequential Recommendation with Fine-Tuned LLMs
SASRecLLM, a hybrid of SASRec and a LoRA-fine-tuned LLM, reports modest gains over TALLRec on MovieLens but shows inconsistent and contradictory results on Amazon and in warm-start settings.
-
A Survey on LLM-powered Agents for Recommender Systems
The paper categorizes LLM-powered agents for recommender systems into recommender-oriented, interaction-oriented, and simulation-oriented paradigms and describes a common four-module agent architecture.
Discussion (0). Continue with ORCID to comment.