SIREN-RoPE learns the rotation space in RoPE from timestamps, cyclical patterns, and categorical signals using SIREN, improving calibration and ranking in a production news recommender with negligible overhead.
Title resolution pending
2 Pith papers cite this work. Polarity classification is still indexing.
years
2026 2verdicts
UNVERDICTED 2representative citing papers
HDET lets data-parallel replicas explore a spread of learning rates independently before averaging parameters, with an auto-LR controller driven by inter-replica loss differences to produce a self-adapting schedule without extra sweeps.
citing papers explorer
-
Learning to Rotate: Temporal and Semantic Rotary Encoding for Sequential Modeling
SIREN-RoPE learns the rotation space in RoPE from timestamps, cyclical patterns, and categorical signals using SIREN, improving calibration and ranking in a production news recommender with negligible overhead.
-
Scalable Hyperparameter-Divergent Ensemble Training with Automatic Learning Rate Exploration for Large Models
HDET lets data-parallel replicas explore a spread of learning rates independently before averaging parameters, with an auto-LR controller driven by inter-replica loss differences to produce a self-adapting schedule without extra sweeps.