REVIEW 7 cited by
Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
For a long time, different recommendation tasks typically require designing task-specific architectures and training objectives. As a result, it is hard to transfer the learned knowledge and representations from one task to another, thus restricting the generalization ability of existing recommendation approaches, e.g., a sequential recommendation model can hardly be applied or transferred to a review generation method. To deal with such issues, considering that language can describe almost anything and language grounding is a powerful medium to represent various problems or tasks, we present a flexible and unified text-to-text paradigm called "Pretrain, Personalized Prompt, and Predict Paradigm" (P5) for recommendation, which unifies various recommendation tasks in a shared framework. In P5, all data such as user-item interactions, user descriptions, item metadata, and user reviews are converted to a common format -- natural language sequences. The rich information from natural language assists P5 to capture deeper semantics for personalization and recommendation. Specifically, P5 learns different tasks with the same language modeling objective during pretraining. Thus, it serves as the foundation model for various downstream recommendation tasks, allows easy integration with other modalities, and enables instruction-based recommendation based on prompts. P5 advances recommender systems from shallow model to deep model to big model, and will revolutionize the technical form of recommender systems towards universal recommendation engine. With adaptive personalized prompt for different users, P5 is able to make predictions in a zero-shot or few-shot manner and largely reduces the necessity for extensive fine-tuning. On several recommendation benchmarks, we conduct experiments to show the effectiveness of P5. We release the source code at https://github.com/jeykigung/P5.
Forward citations
Cited by 7 Pith papers
-
Bridging the Information Gap: Semantic Densification and Hindsight Distillation for Cold-Start Prediction
SemRaD improves cold-start LTV and CVR prediction by encoding LLM-written semantic profiles with a learned gate and distilling a hindsight-reconciled future target through per-user distillation experts, confirmed by a...
-
An LLM-powered Agentic Recommendation System for Connected TV Content Discovery
A hybrid system where an LLM agent generates CTV topic channels and traditional ML ranks the media inside them is engineered to run at production latency via async caching, but only its retrieval component is quality-...
-
LLM-Based User Personas for Recommendations at Scale
A framework for real-time LLM-based user interest personas in large-scale video recommendations, using distillation, async inference, and video clustering to balance interests with novel topics and improve viewer valu...
-
Efficient Item ID Generation for Large-Scale LLM-based Recommendation
LLM-based recommenders can treat item IDs as single direct embeddings and decode in one step, with a two-level softmax for efficiency and quality matching or beating multi-token models.
-
LLM4MEA: Data-free Model Extraction Attacks on Sequential Recommenders via Large Language Models
An LLM-driven agent generates synthetic interaction sequences that, when queried against a target sequential recommender, produce surrogate models with higher agreement to the target than random or autoregressive data...
-
Benchmark Leakage Trap: Can We Trust LLM-based Recommendation?
Fine-tuning an LLM recommender on a slice of the benchmark inflates AUC/UAUC for in-domain leakage and degrades it for out-of-domain leakage, showing benchmark contamination can distort LLM-based recommendation evaluation.
-
RecCoT: Enhancing Recommendation via Chain-of-Thought
A slow-large, fast-small framework that generates chain-of-thought explanations from reviews and caches the resulting semantic embeddings improves Amazon rating prediction over several baselines.
Discussion (0). Sign in to comment.