Derives a drift-aware sensing clock from certified world models that controls certificate violations on held-out data and outperforms expected-belief scheduling in a synthetic benchmark at matched sensing budget.
EA-WM: Event-Aware World Models with Task-Specification Grounding for Long-Horizon Manipulation
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Pretrained-feature world models provide a useful substrate for robot imagination, but visual or latent prediction alone does not determine whether an imagined future satisfies task-relevant events. Long-horizon manipulation requires progress signals that are relational, predicate-level, and physically grounded: whether an object has moved, whether a drawer or contact state has changed, whether a placement predicate is satisfied, and whether a candidate future is reliable enough for execution. We introduce EA-WM, an event-aware world-model framework that augments frozen visual-feature dynamics with task-specification-grounded event prediction and verification. EA-WM rolls out candidate futures in pretrained visual-feature space, decodes them into structured event states, and scores them using task-progress, semantic-consistency, physical-feasibility, and uncertainty terms. The verifier guides sampling-based planning, gates candidate actions, and, in the contact-sensitive LIBERO wine-rack setting, selects among PPOgenerated proposals. Across navigation, deformable-object, wall-constrained, and languagedescribed manipulation studies, EA-WM shows that event-aware verification can make featurespace world models more interpretable and better aligned with task progress.
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Certified World Models as Sensing Clocks: Drift-Aware Deadlines for Active Perception
Derives a drift-aware sensing clock from certified world models that controls certificate violations on held-out data and outperforms expected-belief scheduling in a synthetic benchmark at matched sensing budget.