REVIEW 13 cited by
Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Cross-Domain Sequential Recommendation (CDSR) aims to mine and transfer users' sequential preferences across different domains to alleviate the long-standing cold-start issue. Traditional CDSR models capture collaborative information through user and item modeling while overlooking valuable semantic information. Recently, Large Language Model (LLM) has demonstrated powerful semantic reasoning capabilities, motivating us to introduce them to better capture semantic information. However, introducing LLMs to CDSR is non-trivial due to two crucial issues: seamless information integration and domain-specific generation. To this end, we propose a novel framework named URLLM, which aims to improve the CDSR performance by exploring the User Retrieval approach and domain grounding on LLM simultaneously. Specifically, we first present a novel dual-graph sequential model to capture the diverse information, along with an alignment and contrastive learning method to facilitate domain knowledge transfer. Subsequently, a user retrieve-generation model is adopted to seamlessly integrate the structural information into LLM, fully harnessing its emergent inferencing ability. Furthermore, we propose a domain-specific strategy and a refinement module to prevent out-of-domain generation. Extensive experiments on Amazon demonstrated the information integration and domain-specific generation ability of URLLM in comparison to state-of-the-art baselines. Our code is available at https://github.com/TingJShen/URLLM
Forward citations
Cited by 13 Pith papers
-
CoRCi: Cross-Reconstruction of Coherent Interests Modeling in Cross-Domain Sequential Recommendation
CoRCi reconstructs a mixed-domain user sequence from separate domain sequences via cross-attention and a domain-agnostic FocalNCE loss, outperforming prior cross-domain sequential recommenders.
-
Conv4Rec: A 1-by-1 Convolutional AutoEncoder for User Profiling through Joint Analysis of Implicit and Explicit Feedbacks
A 1-by-1 convolutional autoencoder with six-way softmax outputs jointly predicts interaction likelihood and conditional rating, supported by generalization bounds and mixed but mostly competitive RMSE and Recall resul...
-
Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation
LLM4CDSR, a tri-thread framework using frozen LLM item embeddings and hierarchical LLM user profiling, beats prior CDSR baselines on Cloth-Sport, Electronic-Phone, and Book-Movie.
-
SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment
Adding a KL penalty between fine-tuned and original model logits on input tokens during RAG fine-tuning reduces catastrophic forgetting while preserving downstream performance.
-
DLF: Enhancing Explicit-Implicit Interaction via Dynamic Low-Order-Aware Fusion for CTR Prediction
DLF is a CTR prediction architecture that combines low-rank, high-rank, and implicit interaction blocks with layer-wise attention fusion, reporting state-of-the-art results on Criteo, Avazu, Movielens, and Frappe.
-
FuXi-$\alpha$: Scaling Recommendation Model with Feature Interaction Enhanced Transformer
FuXi-alpha, a sequential recommender with decoupled temporal, positional, and semantic attention channels plus a two-stage FFN, reports gains over HSTU and positive online engagement results.
-
Multi-granularity Interest Retrieval and Refinement Network for Long-Term User Behavior Modeling in CTR Prediction
MIRRN improves CTR prediction by retrieving interests at target, local, and global granularities and refining them with a target-aware position encoding and a multi-head Fourier transformer, achieving up to 1.35% rela...
-
Sharpness-aware Model Merging with Salience Recovery for LLM-based Cross-Domain Sequential Recommendation
SharpRec combines sharpness-aware fine-tuning with a nonlinear parameter reshape to merge LoRA adapters for cross-domain recommendation, but the reshape's claimed heavy-tail effect is mathematically backward.
-
Graph Foundation Models for Recommendation: A Comprehensive Survey
A comprehensive survey that categorizes graph foundation model approaches to recommendation into graph-augmented LLM, LLM-augmented graph, and LLM-graph harmonization.
-
Cold-Start Recommendation towards the Era of Large Language Models (LLMs): A Comprehensive Survey and Roadmap
A comprehensive survey and roadmap that groups cold-start recommendation methods into four knowledge scopes and defines nine cold-start problem types.
-
Scaling New Frontiers: Insights into Large Recommendation Models
Deep HSTU models tend to improve recall, ranking, multi-behavior, and multi-domain performance on public data, while GPT and SASRec fail to scale, though the evidence lacks error bars.
-
Optimizing Sequential Recommendation Models with Scaling Laws and Approximate Entropy
The authors propose a 'Performance Law' for sequential recommendation models that predicts HR and NDCG from model layers, embedding dimension, and number of tokens divided by Approximate Entropy, then uses the fitted ...
-
A Survey on Sequential Recommendation
A review that taxonomizes sequential recommendation research by item property construction and surveys recent LLM, multimodal, generative, and ultra-long-sequence methods.
Discussion (0). Continue with ORCID to comment.