Offline-trained world-model agents in DreamerV3 underperform online agents due to out-of-distribution states at test time; adding about 10% self-generated data or exploratory data largely recovers performance.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Offline vs. Online Learning in Model-based RL: Lessons for Data Collection Strategies
Offline-trained world-model agents in DreamerV3 underperform online agents due to out-of-distribution states at test time; adding about 10% self-generated data or exploratory data largely recovers performance.