{"arxiv_id":"2610.12407","title":"Diffusion-Steering-Based MPC with a JEPA World Action Model","abstract":"World action models (WAMs) predict actions and future observations, typically from a reconstruction-based representation that carries noisy, redundant information which can complicate downstream predictions. We introduce LeWAM, a bidirectional transformer for forward, backward, inverse dynamics and policy prediction, on a decoder-free JEPA latent trained end-to-end through all four modes. We see the following benefits: 1) Alignment: linear probes read robot and object state from LeWAM's latent better than from a regular Le World Model (a forward-only JEPA world model), while the latent ignores visual distractors as well as LeWM does and far better than a reconstruction-based WAM. 2) Acting: Closed-loop evaluations of LeWAM match a regular flow-matching policy trained on the same encoder at matched size, while also providing a world model. 3) Planning: Sampling raw actions when planning with WAMs lets MPC exploit dynamics-model inaccuracies; planning in the noise space of the policy head instead improves the closed-loop performance of these WAMs.","primary_cat":"cs.RO","cross_cats":["cs.AI","cs.CV"],"submitted_at":"2026-10-08T17:46:03+00:00","latest_version":2,"source":"arxiv","source_label":"arXiv","source_url":null,"has_pdf":true,"has_source":false,"verdict":null,"confidence":null,"one_line_summary":null,"novelty_score":null,"correctness_risk":null,"formal_verification":null,"upvotes":0,"downvotes":0,"pith_score":0,"inbound_count":1,"_links":{"html":"https://pith.science/paper/2610.12407","verdict":"/api/v1/verdicts/2610.12407"}}