REVIEW 10 cited by
BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Modeling users' dynamic and evolving preferences from their historical behaviors is challenging and crucial for recommendation systems. Previous methods employ sequential neural networks (e.g., Recurrent Neural Network) to encode users' historical interactions from left to right into hidden representations for making recommendations. Although these methods achieve satisfactory results, they often assume a rigidly ordered sequence which is not always practical. We argue that such left-to-right unidirectional architectures restrict the power of the historical sequence representations. For this purpose, we introduce a Bidirectional Encoder Representations from Transformers for sequential Recommendation (BERT4Rec). However, jointly conditioning on both left and right context in deep bidirectional model would make the training become trivial since each item can indirectly "see the target item". To address this problem, we train the bidirectional model using the Cloze task, predicting the masked items in the sequence by jointly conditioning on their left and right context. Comparing with predicting the next item at each position in a sequence, the Cloze task can produce more samples to train a more powerful bidirectional model. Extensive experiments on four benchmark datasets show that our model outperforms various state-of-the-art sequential models consistently.
Forward citations
Cited by 10 Pith papers
-
GARDRec: Decision-Level Graph Grounding for Large Language Model Recommendation
GARDRec improves LLM-based next-item ranking by grounding decisions in knowledge-graph embeddings, personalized graph contexts, and late-stage scoring rather than prompt text.
-
LLM-Based User Personas for Recommendations at Scale
A framework for real-time LLM-based user interest personas in large-scale video recommendations, using distillation, async inference, and video clustering to balance interests with novel topics and improve viewer valu...
-
Divergence Meets Consensus: A Multi-Source Negative Sampling Framework for Sequential Recommendation
MDCNS is a multi-source negative sampling framework for sequential recommendation that uses peer and teacher models plus divergence and consensus mechanisms to improve diversity and avoid local optima.
-
Scaling Generative Recommendations with Context Parallelism on Hierarchical Sequential Transducers
Context parallelism with AllToAll and load-balanced mini-chunks lets HSTU recommendation models support 5.3x longer interaction sequences at 1.55x throughput scaling.
-
LLM-Based User Personas for Recommendations at Scale
A distilled LLM generates real-time, natural-language user interest personas—combining summarized interests with novel exploration topics—and this system produced small but significant viewer-value gains in a billion-...
-
MARS: Modality-Aligned Retrieval for Sequence Augmented CTR Prediction
MARS aligns text and image features of items, then augments sparse user sequences with retrieved sequences from similar heavy users, improving CTR prediction offline and online.
-
An Industrial-Scale Sequential Recommender for LinkedIn Feed Ranking
A transformer-based sequential recommender, Feed SR, improved LinkedIn Feed time spent by 2.10% in an online A/B test and now serves the majority of Feed traffic.
-
Coarse-to-Fine Long-term Interest Modeling for Generative Recommendation
GLASS extends generative retrieval with a tiered long-term interest vector and a first-SID-keyed search of long histories, reporting consistent gains over Tiger and DualGR on two public datasets.
-
Agentic Web: Weaving the Next Web with AI Agents
A position paper defines the Agentic Web as the next web era and proposes a three-dimensional conceptual framework for understanding and building it.
-
When Transformers Meet Recommenders: Integrating Self-Attentive Sequential Recommendation with Fine-Tuned LLMs
SASRecLLM, a hybrid of SASRec and a LoRA-fine-tuned LLM, reports modest gains over TALLRec on MovieLens but shows inconsistent and contradictory results on Amazon and in warm-start settings.
Discussion (0). Sign in to comment.