REAM merges slow- and fast-thinking recommender models at the per-attention-head level, cutting reasoning length by up to 24.3% while preserving rating accuracy.
Fisher-Weighted Merge of Contrastive Learning Models in Sequential Recommendation
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Along with the exponential growth of online platforms and services, recommendation systems have become essential for identifying relevant items based on user preferences. The domain of sequential recommendation aims to capture evolving user preferences over time. To address dynamic preference, various contrastive learning methods have been proposed to target data sparsity, a challenge in recommendation systems due to the limited user-item interactions. In this paper, we are the first to apply the Fisher-Merging method to Sequential Recommendation, addressing and resolving practical challenges associated with it. This approach ensures robust fine-tuning by merging the parameters of multiple models, resulting in improved overall performance. Through extensive experiments, we demonstrate the effectiveness of our proposed methods, highlighting their potential to advance the state-of-the-art in sequential learning and recommendation systems.
citation-role summary
citation-polarity summary
fields
cs.IR 1years
2026 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Towards Efficient Reasoning in LLM-Based Recommender Systems via Model Merging
REAM merges slow- and fast-thinking recommender models at the per-attention-head level, cutting reasoning length by up to 24.3% while preserving rating accuracy.