Computer Vision and Pattern Recognition · arXiv:2609.26458 v1 · submitted 22 Sep 2026 · 44 references
Code Plans, Diffusion Renders: Open-Ended Generative World Modeling
The paper says
“We introduce \textbfCoDeR, a new paradigm for world modeling. Unlike existing video world models that implicitly represent world dynamics through visual observations, our system explicitly constructs an executable world with code and employs video generation models for visual realization.”
more of the abstract
Specifically, we coordinate five complementary roles to translate high-level concepts into structured world rules, executable dynamics, and perceptual observations. This design enables long-term memory, open-ended interactions, autonomous world evolution, and multi-agent scenarios, where multiple entities can act, interact, and evolve persistently beyond the current observation. Extensive experiments demonstrate that our framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings. Code and model weights will be made publicly available. Project Page: \hrefhttps://becauseimbatman0.github.io/CoDeRCoDeR.
from the abstract
Pith says
Machine review · deepseek-v4-flash · 24 Sep 2026 · what was read was not recorded · not checked by a person
It can be wrong. Challenge this review or reply to it.
Holds up, with conditions. A genuinely useful architecture and a transferable registration idea, undermined by a self-built evaluation that does not support the all-metrics SOTA claim. This line is wrong
3 major objections · 8 minor
How often objections from reviews like this one are right: not yet measured
Not checked: figures, code, what the 44 references say.
The paper says, at §4.4; Appendix EVALUATION DETAILS
The review did not quote this passage.
A classifier read this sentence of the paper as acknowledging the concern (probability 0.62):
“Note that the reconstructed whitebox world is not required to be perfectly aligned with the first frame.”
Pith says: Objection 1 of 3 · major
The headline claim that CoDeR is state-of-the-art across all metrics (Table 1; b157) is not supported by the evaluation as described. Because the method cannot consume benchmark inputs directly, the authors reconstruct each test world from a single first frame using SAM 3, Depth Anything V2, and GPT-6 Astra — the same LLM that implements CoDeR's Creator and Executors, in the same whitebox domain on which the Artist was fine-tuned (Sec. 4.2; Appendix EVALUATION DETAILS).
more of objection 1
The appendix concedes that the reconstruction is not required to be aligned with the first frame and that object geometry, shape, and fine-grained structure may be wrong (b423-b424), then relies on first-frame anchoring of CoDeR's own outputs (b425). The protocol is therefore asymmetric in three compounding ways: CoDeR receives oracle depth D, camera parameters, and entity identities "directly retrieved from the whitebox world" (Sec. 3.2) and is visually anchored to the true first frame, while the three baselines are scored against a scaffold they never observed; the reference worlds are built by the same LLM that constructs CoDeR's worlds; and the paper does not specify what inputs the baselines received or what reference each WorldScore metric was computed against. This must be fixed by using an externally specified protocol, by clearly disclosing the reference population and inputs, and by reporting per-world, per-seed results.
The paper says, at Table 1; Table 2; Fig. 7
The review did not quote this passage.
Pith says: Objection 2 of 3 · major
No variance or replication information is reported for any quantitative result: Table 1 and Table 2 give single numbers with no standard deviation, number of worlds, or rollouts, and the user study (Fig. 7, 30 questionnaires) reports 0-100 scores without error bars or a statistical test despite the claim that CoDeR "consistently outperforms" across all dimensions (b412).
more of objection 2
The margin pattern itself suggests reference mismatch rather than capability: Motion Mag is 84.92 for CoDeR versus 24.75-27.93 for all baselines and Content Align is 98.44 versus 75.29-83.12, which is implausible for a modeling-quality comparison and is exactly the pattern expected when the baselines are penalized by a reference scaffold they never saw while CoDeR is anchored to it. At minimum, the authors should provide (i) variance across reconstructed worlds and seeds, (ii) a control in which CoDeR is scored without the first-frame anchor, and (iii) a control in which the baselines are conditioned on exactly the same input as CoDeR.
The paper says, at §3.2, Eq. (6); §4.3
The review did not quote this passage.
Pith says: Objection 3 of 3 · major
The qualitative comparisons in Section 4.3 (Figs. 3-6) are persuasive as proof-of-concept demonstrations of the mechanism, and I do not contest that CoDeR exhibits the described behaviors. However, the paper's framing that existing observation-only world models "fail" in these settings (e.g., b116, b143-b145) conflates model capability with privileged information: camera parameters, ground-truth depth, and object identities are taken directly from the whitebox state (Sec. 3.2), which is information a pixel-only baseline cannot possess.
more of objection 3
The long-term memory claim (b131) is also only qualitative at present; since the Artist uses a fixed 124-frame window and the LIMITATIONS section states that chunk-based rollout leads to inevitable quality degradation (b429), the memory claim should be quantified with a state-based metric, such as anchor-texture or entity-identity consistency as a function of rollout length, using the executable world state as ground truth.
8 minor objections
The paper says, at §3.2
Pith says: minor objection 1 of 8
Notation collides between Eq. (5), where W denotes the assembled executable world, and Sec. 3.2/Eq. (6), where W denotes the whitebox observation video; consider renaming one of the two, since both uses appear within the same section.
The paper says, at Figure 1
Pith says: minor objection 2 of 8
Figure 1's rendered labels are duplicated ("Executors Executors", "Creator Creator", "Artists Artists"), which appears to be a layout artifact; the figure should be regenerated so that the five roles are legible.
show 6 more
The paper says, at Abstract and Introduction
Pith says: minor objection 3 of 8
The abstract and the second-to-last paragraph of the introduction assert nearly the same contribution list and the same SOTA claim twice (b5 appears in both); condense one occurrence.
The paper says, at Fig. 7 caption
Pith says: minor objection 4 of 8
The caption of Fig. 7 embeds the plotted numeric values; move those numbers into the figure, a table, or the methods text instead.
The paper says, at LIMITATIONS (Appendix)
Pith says: minor objection 5 of 8
The limitations passage (b427-b437) is candid: the authors acknowledge accumulated degradation in extremely long rollouts and geometric failure cases in hand-object interaction and collision handling. I count this as a strength, but the "long-term memory" claim (b131) should be worded consistently with the regime in which degradation is acceptable.
The paper says, at Table 1 caption
Pith says: minor objection 6 of 8
The nine WorldScore metric names (Camera Ctrl, Content Align, Motion Mag, etc.) are used without stating how each was instantiated for this protocol; at a minimum, point to the exact WorldScore routines and specify the reference video or scaffold used for each metric.
The paper says, at References
Pith says: minor objection 7 of 8
Several load-bearing components are cited only to 2026 preprints or blog posts (GPT-6 Astra, MiniMax H3, SAM 3); please add version or checkpoint identifiers and confirm that the cited artifacts exist as cited.
The paper says, at Conclusion
Pith says: minor objection 8 of 8
The closing sentence ("every Traveler is, in essence, the God of Concepts") is rhetorical and out of register for a technical paper; consider removing it.
What would settle it
Re-run the WorldScore comparison with a shared reference that does not pass through the CoDeR reconstruction stack: score all four methods against the original WorldScore benchmark reference videos/first-frame inputs using the official metric implementations (no SAM 3 / Depth Anything V2 / GPT-6 Astra reconstruction), and add a protocol-control arm where each baseline is scored on its own native environment. Repeat every method over at least 5 independent rollout seeds and, for CoDeR, 5 independent world reconstructions, reporting mean plus or minus standard deviation. Accept the SOTA claim only if CoDeR retains a substantial (greater than 10-point) Content Align and Motion Mag margin over Matrix-Game 3.0 under this common reference; if the 21- and 57-point gaps largely collapse, the reconstruction scaffold, not superior modeling, drove Table 1.
from the skeptic's reading
How the review went
4 readings by deepseek-v4-flash · 24 Sep 2026
- Reader holds up, with conditions
- Skeptic agrees
- Editor wrote the verdict above
- Referee major revision: 3 major objections, 8 minor
Not run on this paper: the simulated authors' defence.
Pith did not check this review's objections against the paper.
The review in full
The review in brief, machine-written
Two things to know. The core design is a real departure: CoDeR doesn't ask a video model to be the world. It keeps persistent state and rules in executable code (LLM coding agents build a whitebox Three.js world), and a fine-tuned video generator only renders observations on demand. The most transferable piece is Observation as World Registration—previously generated pixels are depth-back-projected into the whitebox and fed back as partial observations, so appearance accumulates across viewpoints while the executable world stays canonical. That idea is clean and worth borrowing.
The second thing is that the paper's headline quantitative claim does not withstand reading the Evaluation Details appendix. The benchmark worlds are reconstructed from a single first frame using SAM 3, Depth Anything V2, and GPT-6 Astra—the same LLM line that serves as Creator and Executors—and the authors admit the reconstruction need not match the first frame and that geometry, shape, and fine-grained structure can be wrong (b423, b424). CoDeR then rolls out inside that whitebox with oracle depth, camera parameters, and entity identities, and its output is anchored to the true first frame, while ABot-World, Matrix-Game 3.0, and LingBot-World are scored against a scaffold they never saw. The 21-point Content Align gap and 57-point Motion Mag gap look more like reference mismatch than modeling superiority. No variance or seed counts appear anywhere in Table 1. That specific SOTA claim does not follow.
The qualitative evidence is stronger and should not be dismissed. The logo persisting under rotation, the water level updating off-screen, and the multi-agent shared-observation demos directly support the persistent-state mechanism. The limitations section is also honest: they acknowledge degradation at around 5,000 frames, plus hand-object distortion and interpenetration in the whitebox. The user study is small (30 questionnaires) and, as is typical, unconvincing on its own.
I side with the conditional verdict. The architecture is plausible, the direction is timely, and the registration mechanism is reusable. What is missing is a fair quantitative protocol: a pre-registered common evaluation, variance, and a demonstration that the baselines are not being penalized by reconstruction artifacts. Quantifying rollout-length degradation would also strengthen it.
This paper deserves a serious referee. I would send it to review, with an explicit request that the SOTA claim be re-tested or softened.
The strongest objection
The stated SOTA claim (b5, b157; Table 1) is supported only by an evaluation whose reference is constructed by CoDeR's own component stack. Per Appendix EVALUATION DETAILS, the method cannot consume benchmark inputs, so the authors build each test world from a single first frame using SAM 3 + Depth Anything V2 + GPT-6 Astra — the same LLM (GPT-6 Astra) that drives CoDeR's Creator/Executors and the same whitebox domain on which the Artist was fine-tuned via Visual Cue Hacking. The authors concede the reconstruction is not required to match the first frame and that geometry, shape, and fine-grained structure may be wrong (b423, b424). The protocol is asymmetric in three compounding ways: (1) CoDeR's output is anchored to the true first frame ('conditioning the generation model on the original first frame effectively anchors the visual content', b425), while baselines such as ABot-World and Matrix-Game 3.0 are scored against a scaffold that is admitted to be misaligned and that they never saw; (2) during its own rollouts CoDeR receives oracle state — ground-truth depth D, known camera parameters, and known entity identities are 'directly retrieved from the whitebox world' (Sec. 3.2) — privileged information a video world model must infer from pixels; (3) the margin sizes are implausible for a modeling-quality measure: Content Align 98.44 vs 76.94 (+21.5) and Motion Mag 84.92 vs 26.89-27.93 (+~57), which suggests the comparators are penalized by reconstruction/reference mismatch rather than by inferior world modeling. No variance, seed count, or protocol control is reported for any Table 1 number. This is not an internal inconsistency; the architecture and the qualitative demos (logo persistence, water level, multi-agent sharing) are plausible and independently support the persistent-state mechanism. But the specific 'state-of-the-art across all metrics' claim (b157) does not follow from the present evidence.
The paper's central claim is that separating executable world state from visual realization produces genuinely better, longer, more consistent interactive rollouts, evidenced by the all-metrics win in Table 1 (b157) and by qualitative demonstrations. For that claim to hold, the quantitative comparison must be capable of finding against CoDeR; here it cannot, because the reference is built by CoDeR's own pipeline and the comparison is asymmetric (oracle depth/camera/identity for CoDeR; admitted misalignment for baselines at b424). This makes the Table 1 result a measure of fit to CoDeR's reconstruction rather than of world-modeling competence. The reader's weakest_assumption identifies the same node (the self-constructed evaluation); I agree, and add two sharpenings the reader did not emphasize: (i) CoDeR receives oracle ground-truth depth and known camera/entity state from its whitebox world (Sec. 3.2) that video baselines must infer from pixels, and (ii) the specific margin magnitudes (Motion Mag 84.92 vs roughly 27; Content Align plus 21.5) are so large that reference/reconstruction mismatch is the most plausible explanation. I weighed the factors in the authors' favor: they explicitly acknowledge the reconstruction misalignment (b423, b424) and long-horizon degradation (b429), and the qualitative evidence (logo persistence under 360-degree rotation, off-screen water-level update, multi-agent shared observation) independently supports the persistent-state mechanism as a real design contribution. The remaining gap is purely that the evaluation protocol cannot support the SOTA sentence as reported. Because this is an addressable evaluation defect rather than a refutation, a shared-reference protocol with variance would settle it; the verdict stays CONDITIONAL.
The referee's report
The persistent-state design is a genuinely promising direction: explicitly tracking hidden state (rules, resource ownership, out-of-sight processes) addresses a real limitation of observation-only video world models, and the qualitative demonstrations — logo persistence under a 360-degree rotation, a cup filling while out of view, and two travelers observing the same event from different viewpoints — are internally consistent with the proposed mechanism. The paper is unusually candid: the LIMITATIONS section states upfront that long rollouts degrade from chunk-based accumulation and that hand-object interaction and 3D interpenetration remain unsolved. The training recipe (Visual Cue Hacking with Canny/depth ControlNet conditioning and partial registration) is concrete and should be reproducible from the description. That said, the headline claim that CoDeR "achieves state-of-the-art performance across multiple evaluation settings" (abstract, b5; b157; b165) rests on a self-constructed benchmark whose reference worlds are built by the authors' own component stack; as comparative evidence the quantitative evaluation is not currently convincing.
Pith's reading of the paper (a machine's summary, not the authors')
CoDeR claims that a world model should separate the underlying state of a world from how that world looks. Instead of letting a video generation model implicitly encode dynamics in pixels, the framework builds an executable 'whitebox' world in code — rules, entities, physics, and hidden states such as health or ownership — and uses a video model only to render that world into rich visuals. This separation is claimed to deliver long-term memory, open-ended and extensible actions, world evolution that continues even when things are off-camera, and persistent multi-agent interaction, capacities the paper argues observation-only video world models cannot support. The paper reports that CoDeR beats three baselines on all ten WorldScore metrics, with an 87.88 average against a best-baseline 74.79.
What carries the argument. Observation as World Registration is the central mechanism: a generated video $V$ and its ground-truth depth $D$ are back-projected onto the whitebox world to form a partial registration $R = M\odot \Pi(V,D) + (1-M)\odot W$, which is fed to the Artist as context, so prior appearance persists in the world state and guides every later render. Logical Spaces decomposes the global construction into a graph of modules, each with an interface contract $K_i$, that Executors build concurrently and join through explicit bindings. Visual Cue Hacking extracts Canny edges and depth from the whitebox and uses them to train the Artist model (LoRA fine-tuning of the backbone, full fine-tuning of the ControlNet branch) so the model treats the whitebox as a structural cue rather than a pixel-level rendering target.
Core claim. The paper's central claim is that the limiting factor in today's world models is their decision to encode everything in visual observation. CoDeR instead constructs the world explicitly: the Creator, an LLM, lays down rules and theme; Executors, coding agents, compile those rules into a modular code world whose geometry, depth, and hidden state are known; Artists, video generation models, turn whitebox segments into photorealistic video; and Travelers explore, act, and trigger rendering. The two load-bearing mechanisms are Logical Spaces, which decomposes the world into concurrent, contract-bound modules, and Observation as World Registration, which back-projects each generated video, using its known depth, into the whitebox world so that what was seen becomes part of the state any later agent perceives. Because state lives in code rather than pixels, the world keeps evolving when unobserved — the paper's out-of-sight water cup keeps filling — and one agent's action becomes visible to another. On this basis the authors claim state-of-the-art performance across long-memory rotation tests, open-ended interaction, autonomous evolution, and multi-agent sharing.
The premise it rests on. The load-bearing premise is that a whitebox world rebuilt from a single first frame by CoDeR's own components — SAM 3 segmentation, Depth Anything V2 depth, and an LLM builder — represents the benchmark scenes fairly enough for all methods to be compared inside it; the paper concedes the reconstruction need not align with the true frame, and if that rebuilt world silently favors CoDeR, the all-metrics win does not follow.
If the paper is right (Pith's inferences, not the authors')
Long rollouts no longer depend on the video model's context window: because memory lives in the executable code state rather than in visual history, the paper demonstrates 360-degree rotation consistency and strong long-horizon behavior with an Artist trained on only 124 frames.
The action space becomes open-ended: the Creator can define new actions and the Executors implement them in code, so a world can grow from opening a door to piloting a spaceship without retraining the renderer.
Off-screen dynamics stop being a fundamental limitation: an entity's state keeps updating while unobserved, as shown by the water cup that continues to fill while out of view and is correctly fuller when the camera returns.
Multiple agents share one authoritative world state, so one agent's action, such as taking down a target, is immediately reflected in another agent's observation of the same world.
Because world state is code over known geometry, the same whitebox could plausibly be re-rendered in different visual styles by swapping the Artist alone — re-theming a world from photoreal to anime to low-fi without recomputing dynamics is implicit in the design but is not isolated as a separate result.
Depth-based registration is a generic pattern: any observation with known camera and geometry can be folded back into state. That suggests the paradigm could extend to real captured footage if geometry is estimated, a step beyond this paper's synthetic whitebox setting.
A testable consequence: CoDeR's advantage over context-window-limited video models should grow as rollouts get longer, since its memory is not bounded by the model's frame window — though the paper itself concedes in its limitations that visual quality still degrades around 5,000 frames.
Check this review
Pith stored no record of this review's passes and took no fingerprint of it. Reviews made by code from 13 Nov 2026 on carry both.
How often reviews like this one are right
Reviews like this one: written by deepseek-v4-flash, where what was read was not recorded.
How often objections from reviews like this one are right: not yet measured
Reviews by people
This review was written by a machine. No person has reviewed this paper on Pith yet. A scientist listed on Pith can review it for a fee, and their review is published here whatever it concludes.
The paper
Abstract
We introduce \textbfCoDeR, a new paradigm for world modeling. Unlike existing video world models that implicitly represent world dynamics through visual observations, our system explicitly constructs an executable world with code and employs video generation models for visual realization. Specifically, we coordinate five complementary roles to translate high-level concepts into structured world rules, executable dynamics, and perceptual observations. This design enables long-term memory, open-ended interactions, autonomous world evolution, and multi-agent scenarios, where multiple entities can act, interact, and evolve persistently beyond the current observation. Extensive experiments demonstrate that our framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings. Code and model weights will be made publicly available. Project Page: \hrefhttps://becauseimbatman0.github.io/CoDeRCoDeR.
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. No sentence in this record was written by a model.
abstract compiled · 2026-09-24
The authors' main claim, as the classifier picked it out 1.00
“Extensive experiments demonstrate that our framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings.”
How the main claim is stated: asserted 1.00
What the abstract itself states, as probabilities: claims first 0.13 · states limitation 0.05 · human participants 0.07 · controlled comparison 0.24 · randomized assignment 0.01 · states quantitative result 0.05 · compares with prior results 0.78 · mentions code or data availability 0.96
The abstract, sentence by sentence
This table labels the abstract only (arXiv listing abstract v1). The number is the probability the classifier gave the label.
| Sentence | Role | The authors' own work | States the main conclusion | Strength |
|---|---|---|---|---|
| We introduce \textbf{CoDeR}, a new paradigm for world modeling. | contribution 1.00 | 0.89 | 0.07 | asserted 1.00 |
| Unlike existing video world models that implicitly represent world dynamics through visual observations, our system explicitly constructs an executable world with code and employs video generation models for visual realization. | contribution 0.63 | 0.54 | 0.09 | asserted 1.00 |
| Specifically, we coordinate five complementary roles to translate high-level concepts into structured world rules, executable dynamics, and perceptual observations. | method 0.99 | 0.79 | 0.05 | asserted 0.99 |
| This design enables \textit{long-term memory}, \textit{open-ended interactions}, \textit{autonomous world evolution}, and \textit{multi-agent scenarios}, where multiple entities can act, interact, and evolve persistently beyond the current observation. | contribution 0.69 | 0.59 | 0.18 | asserted 0.96 |
| Extensive experiments demonstrate that our framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings. | result 0.98 | 0.95 | 0.79 | asserted 1.00 |
| Code and model weights will be made publicly available. | future work 0.81 | 0.24 | 0.02 | asserted 0.98 |
| Project Page: \href{https://becauseimbatman0.github.io/CoDeR}{CoDeR}. | future work 0.40 | 0.15 | 0.01 | unclear 0.66 |
What kind of paper the classifier reports this is: method or tool 1.00 · evidence from observation or experiment 0.98
What was examined, and what was not
Sources read
- arXiv listing abstract v1
Not examined
- full text
- figures and tables
- references and citing sentences
- relations to other papers
Levels run
- P abstract
Not run
- S sections
- T body sentences
- C citations
- R cross-paper relations
How the labels were made
Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-09-24: 1 request, 5,597 input tokens.
Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. This record as JSON
Figures (12)
Figures are the authors', reproduced from the paper.
References (44)
- [1] AlayaWorld Team, Kaipeng Zhang, Chuanhao Li, Yifan Zhan, Yongtao Ge, Yuanyang Yin, Jiaming Tan, Kang He, Liaoyuan Fan, Mingliang Zhai, Ruicong Liu, Xiaojie Xu, Xuangeng Chu, Zhen Li, Zhengyuan Lin, Zhixiang Wang, Zian Meng, and Zihui Gao. AlayaWorld: Interactive Long- Horizon ... on PithPith's reviewarXiv
- [3] Ziqi Cai, Siqi Yang, Yimu Wang, Zixian Gao, Yunheng Liu, Shuchen Weng, Erwin Wu, Kaipeng Zhang, and Boxin Shi. MASS: Multiplayer World Models with Authoritative Shared State.arXiv preprint arXiv:2608.06257, on PithPith's reviewarXiv
- [5] Nicolas Carion, Laura Gustafson, Yuan-Ting Hu, Shoubhik Debnath, Ronghang Hu, Didac Suris Coll-Vinent, Chaitanya Ryali, Kalyan Vasudev Alwala, Haitham Khedr, Andrew Huang, et al. Sam 3: Segment anything with concepts. InInternational conference on learning representations, vol... on Pith
- [6] Haoxuan Che, Xuanhua He, Quande Liu, Cheng Jin, and Hao Chen. GameGen-X: Interactive Open-world Game Video Generation. InInternational Conference on Learning Representations, volume 2025, pp. 37546–37593, on Pith
- [8] Zicheng Duan, Jiatong Xia, Zeyu Zhang, Wenbo Zhang, Gengze Zhou, Chenhui Gou, Yefei He, Feng Chen, Xinyu Zhang, and Lingqiao Liu. LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models. InComputer Vision – ECCV 2026, on Pith
- [10] Junliang Guo, Yang Ye, Tianyu He, Haoyu Wu, Yushu Jiang, Tim Pearce, and Jiang Bian. MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft.arXiv preprint arXiv:2504.08388, on PithPith's reviewarXiv
- [11] Jinkun Hao, Mingda Jia, Xudong Xu, Ruiyan Wang, Xihui Liu, Ran Yi, Lizhuang Ma, and Jiang- miao Pang. EgoSim: Egocentric World Simulator for Embodiment Interaction Generation. In Computer Vision – ECCV 2026, on Pith
- [12] Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein, Bo Dai, Hongsheng Li, and Ceyuan Yang. CameraCtrl: Enabling Camera Control for Video Diffusion Models. In Y . Yue, A. Garg, N. Peng, F. Sha, and R. Yu (eds.),International Conference on Learning Representations, volume 2025, pp.... on PithPith's reviewarXiv
- [13] Anthony Hu, V´aclav V olhejn, Adrien Ramanana Rahary, Chris Mulder, Aditya Makkar, Alyx Liao, Am´elie Royer, Manu Orsini, Adam Jelley, Eloi Alonso, Florian Laurent, Fredrik Nor ´en, James Swingos, Jan H ¨unermann, Kent Rollins, Lucas Hosseini, Matthieu Le Cauchois, Maxim Peter... on PithPith's reviewarXiv
- [15] Fan Jiang, Zhaoxu Sun, Mengchao Wang, Ziyu Zhu, Chiyu Wang, Yunpeng Zhang, Wenlin Liu, Yun Wang, Xue Zheng, Rui Sun, Junfeng Ni, Hongyu Pan, Zhongxu Sun, Fei Yu, Zengye Ge, Mengmeng Du, Nianfei Fan, Mingchao Sun, Yu Liu, Yongchang, Yanqing Zhu, Jiahang Wang, Ning Ying, Yuze Xu... on PithPith's reviewarXiv
- [16] 12 Dacheng Li, Yunhao Fang, Yukang Chen, Shuo Yang, Shiyi Cao, Justin Wong, Michael Luo, Xi- aolong Wang, Hongxu Yin, Joseph Gonzalez, Ion Stoica, Song Han, and Yao Lu. WorldMod- elBench: Judging Video Generation Models As World Models. In D. Belgrave, C. Zhang, H. Lin, R. Pas... on PithPith's reviewarXiv
- [17] Fangfu Liu, Kai He, Tianchang Shen, Tianshi Cao, Sanja Fidler, Yueqi Duan, Jun Gao, Igor Gilitschenski, Zian Wang, and Xuanchi Ren. Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players.arXiv preprint arXiv:2605.28816, on PithPith's reviewarXiv
- [19] URLhttps://www.minimax.io/blog/ minimax-h3. Sicheng Mo, Yuheng Li, Ziyang Leng, Krishna Kumar Singh, and Bolei Zhou. Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers.arXiv preprint arXiv:2607.21594, on PithPith's reviewarXiv
- [20] 13 NVIDIA, Niket Agarwal, Arslan Ali, Maciej Bala, Yogesh Balaji, Erik Barker, Tiffany Cai, Prithvi- jit Chattopadhyay, Yongxin Chen, Yin Cui, Yifan Ding, Daniel Dworakowski, Jiaojiao Fan, Michele Fenzi, Francesco Ferroni, Sanja Fidler, Dieter Fox, Songwei Ge, Yunhao Ge, Jinwe... on PithPith's reviewarXiv
- [21] doi: 10.1145/3586183.3606763. William Peebles and Saining Xie. Scalable Diffusion Models with Transformers. InProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 4195–4205, on PitharXiv
- [22] doi: 10.52202/085713-0896. Runjia Qian, Zile Wang, Jihai Zhang, Kai Zou, Wei Yu, Jiaxing Li, Zexiang Liu, Yaokun Li, Fei Kang, Kaichen Huang, Mengyin An, Haobo Zhang, Biao Jiang, Jiahua Wang, Haofeng Sun, Yang Liu, and Yangguang Li. Matrix-Game 3.5: Enhancing Real-Time Streami... on PithPith's reviewarXiv
- [23] Robbyant Team, Zelin Gao, Qiuyu Wang, Yanhong Zeng, Jiapeng Zhu, Ka Leong Cheng, Yixuan Li, Hanlin Wang, Yinghao Xu, Shuailei Ma, Yihang Chen, Jie Liu, Yansong Cheng, Yao Yao, Jiayi Zhu, Yihao Meng, Kecheng Zheng, Qingyan Bai, Jingye Chen, Zehong Shen, Yue Yu, Xing Zhu, Yujun ... on PithPith's reviewarXiv
- [25] Huiqiang Sun, Zhan Peng, Size Wu, Kun Wang, Kang Liao, Dianyi Wang, Xingyu Zeng, Sheng Jin, Yangguang Li, Zhiguo Cao, Ziwei Liu, and Wei Li. Prisma-World: Camera-Controllable Multi-Agent Video World Model.arXiv preprint arXiv:2606.09507, 2026a. Wenqiang Sun, Fangyun Wei, Jinji... on PithPith's reviewarXiv
- [26] doi: 10.52202/ 079017-2243. Junshu Tang, Jiacheng Liu, Jiaqi Li, Longhuang Wu, Haoyu Yang, Penghao Zhao, Siruis Gong, Xiang Yuan, Shuai Shao, Linfeng Zhang, and Qinglin Lu. Hunyuan-GameCraft-2: Instruction- following Interactive Game World Model.arXiv preprint arXiv:2511.23429, on PitharXiv
- [27] Rongze Tang, Jianjie Fang, Zhaolu Wang, Ziyou Wang, Xvyuan Liu, Haisheng Su, Xin Zhang, Wei Wu, Chen Gao, Yong Li, and Zhibo Chen. IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training.arXiv preprint arXiv:2609.00161, on PithPith's reviewarXiv
show 24 more
- [28] Zizhao Tong, Yeying Jin, Hongfeng Lai, Zeqing Wang, Zhaohu Xing, Kexu Cheng, Haoran Xu, Zhao Pu, Shangwen Zhu, Ruili Feng, Jian Zhao, Yan Zhang, Hao Tang, and Ling Shao. SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Models.arXiv preprint arXiv:... on PithPith's reviewarXiv
- [29] doi: 10.52202/085713-4861. Dani Valevski, Yaniv Leviathan, Moab Arar, and Shlomi Fruchter. Diffusion Models Are Real-Time Game Engines. In Y . Yue, A. Garg, N. Peng, F. Sha, and R. Yu (eds.),International Conference on Learning Representations, volume 2025, pp. 73754–73776, on Pithdoi:10.52202/085713-4861
- [30] Hongyu Wang, Jingquan Wang, Ashvin Anilkumar, Bocheng Zou, Radu Serban, and Dan Negrut. ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simula- tion Construction.arXiv preprint arXiv:2605.14398, 2026a. Weijie Wang, Haoyu Zhao, Yifan Yang, Feng C... on PithPith's reviewarXiv
- [31] doi: 10.52202/075280-0334. Yuxi Wang, Wenqi Ouyang, Tianyi Wei, Yi Dong, Zhiqi Shen, and Xingang Pan. Hand2World: Autoregressive Egocentric Interaction Generation via Free-Space Hand Gestures.arXiv preprint arXiv:2602.09600, 2026c. Zhaoyang Wang, Canwen Xu, Boyi Liu, Yite Wang... on PitharXiv
- [32] Haoyu Wu, Jiwen Yu, Yingtian Zou, and Xihui Liu. MultiWorld: Scalable Multi-Agent Multi-View Video World Models. CVPR 2026 Workshop on Multi-Agent Robotic Systems: Scaling with Compositional Intelligence (MARS-EAI), on Pith
- [33] doi: 10.52202/085713-1651. Zeqi Xiao, Yushi Lan, Yifan Zhou, Wenqi Ouyang, Shuai Yang, Yanhong Zeng, and Xingang Pan. WorldMem: Long-term Consistent World Simulation with Memory. In D. Belgrave, C. Zhang, H. Lin, R. Pascanu, P. Koniusz, M. Ghassemi, and N. Chen (eds.),Advances... on Pithdoi:10.52202/085713-1651
- [34] doi: 10.52202/085713-1659. Linxi Xie, Lisong C. Sun, Ashley Neall, Tong Wu, Shengqu Cai, and Gordon Wetzstein. Generated Reality: Human-centric World Simulation using Interactive Video Generation with Hand and Camera Control. InProceedings of the IEEE/CVF Conference on Compute... on Pithdoi:10.52202/085713-1659
- [35] Zhexiao Xiong, Yizhi Song, Hao Kang, Qing Yan, Liming Jiang, Jenson Yang, Zhoujie Fu, Stathi Fotiadis, Angtian Wang, Zichuan Liu, Bo Liu, Yiding Yang, Xin Lu, and Nathan Jacobs. Act- World: From Explorable to Interactive World Model via Action-Aware Memory.arXiv preprint arXiv... on PithPith's reviewarXiv
- [36] Jiacong Xu, Hanwen Jiang, Zhixin Shu, Kalyan Sunkavalli, Vishal M. Patel, and Yiqun Mei. Won- der: Video World Model Done Better.arXiv preprint arXiv:2607.26037, 2026a. Tianshuo Xu, Yichen Xie, Depu Meng, Chensheng Peng, Quentin Herau, Bo Jiang, Yihan Hu, and Wei Zhan. Teachin... on PithPith's reviewarXiv
- [37] Hong-Xing Yu, Haoyi Duan, Charles Herrmann, William T. Freeman, and Jiajun Wu. Wonder- World: Interactive 3D Scene Generation from a Single Image. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5916–5926, June 2025a. Jiwen Yu, J... on PitharXiv
- [38] Wangbo Yu, Jinbo Xing, Li Yuan, Wenbo Hu, Xiaoyu Li, Zhipeng Huang, Xiangjun Gao, Tien-Tsin Wong, Ying Shan, and Yonghong Tian. ViewCrafter: Taming Video Diffusion Models for High- fidelity Novel View Synthesis.IEEE Transactions on Pattern Analysis and Machine Intelligence, pp... on PitharXiv
- [39] Xiaoyu Zhan, Xinyu Wang, Xiaohong Zhang, Huanjie Zhu, Tengjiao Sun, Pengcheng Fang, Jiaxing Yu, Yanwen Guo, and Dongjie Fu. Magpie: Real-Time World Renderer for Interactive Games. arXiv preprint arXiv:2608.27168, on PithPith's reviewarXiv
- [40] Yifan Zhang, Chunli Peng, Boyang Wang, Puyi Wang, Qingcheng Zhu, Fei Kang, Biao Jiang, Ze- dong Gao, Eric Li, Yang Liu, and Yahui Zhou. Matrix-Game: Interactive World Foundation Model.arXiv preprint arXiv:2506.18701, on PithPith's reviewarXiv
- [41] Jinjing Zhao, Fangyun Wei, Zhening Liu, Hongyang Zhang, Chang Xu, and Yan Lu. Spatia: Video Generation with Updatable Spatial Memory. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4245–4257, June 2026a. 18 Renjie Zhao, Yuxiang ... on PithPith's reviewarXiv
- [42] Shangwen Zhu, Qianyu Peng, Zhao Pu, Zhilei Shu, Xiangrui Ke, Zhaohu Xing, Zizhao Tong, Zeqing Wang, Xinyu Cui, Zian Zheng, Huangji Wang, Jian Zhao, Yeying Jin, Fan Cheng, and Ruili Feng. Incantation: Natural Language as the Action Interface for Multi-Entity Video World Models.... on PithPith's reviewarXiv
- [43] 19 APPENDIX In this appendix, we first clarify how AI is used in this paper, followed by details of the user study, Visual Cue Hacking and evaluation. We then discuss the limitations of our method and outline directions for future work. AI USESTATEMENT We use GPT-6 Astra as th... on Pith
- [44] These lim- itations suggest that more accurate geometry reconstruction, articulated object modeling, and phys- ically grounded interaction simulation could further improve the fidelity of the underlying world representation. Complex Hand-Object Interaction 3D Interpenetration ... on Pith
- [2017] doi: 10.1145/3130800.3130883. Georgy Savva, Oscar Michel, Daohan Lu, Suppakit Waiwitlikhit, Timothy Meehan, Dhairya Mishra, Srivats Poddar, Jack Lu, and Saining Xie. Solaris: Building a Multiplayer Video World Model in Minecraft.arXiv preprint arXiv:2602.22208, on PitharXiv
- [2019] Wenchao Ma, Changran Liu, Sharon X. Huang, and Haomiao Jiang. Closing the Loop: Training-Free Revisit Consistency for Autoregressive Generative Rendering.arXiv preprint arXiv:2607.21848, 2026a. Ziqi Ma, Mengzhan Liufu, and Georgia Gkioxari. Out of Sight, Out of Mind? Evaluatin... on PithPith's reviewarXiv
- [2022] Teng Hu, Mingchun Lu, Yating Wang, Jiangning Zhang, Jinkun Hao, Ye Pan, Ran Yi, Lizhuang Ma, and Dacheng Tao. MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data.arXiv preprint arXiv:2606.02753, 2026b. Junchao Huang, Xinting Hu, Boyao Han, Shaoshuai Sh... on PithPith's reviewarXiv
- [2023] doi: 10.52202/075280-1734. Quankai Gao, Jiawei Yang, Qiangeng Xu, Le Chen, and Yue Wang. LOME: Learning Human-Object Manipulation with Action-Conditioned Egocentric World Model.arXiv preprint arXiv:2603.27449, 2026a. Zelin Gao, Qiuyu Wang, Jiapeng Zhu, Jingye Chen, Zichen Liu,... on PitharXiv
- [2024] doi: 10.52202/079017-1873. Sherwin Bahmani, Tianchang Shen, Jiawei Ren, Jiahui Huang, Yifeng Jiang, Haithem Turki, An- drea Tagliasacchi, David Lindell, Zan Gojcic, Sanja Fidler, Huan Ling, Jun Gao, and Xuanchi Ren. Lyra: Generative 3D Scene Reconstruction via Video Diffusion ... on Pithdoi:10.52202/079017-1873
- [2025] Junhao Chen, Mingjin Chen, Henghaofan Zhang, Minglin Chen, Liaoyuan Fan, Boran Zhang, Sain- ing Zhang, Mingze Sun, Hao Zhao, Ruqi Huang, Zhihao Li, and Yufei Wang. Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh.arXiv preprint arXiv:2608.000... on PithPith's reviewarXiv
- [2026] Jin Cao, Zian Meng, and Kaipeng Zhang. ShadowDancer: Teaching Video World Models Any Action by Learning Unified Dynamics Representations from a Video and Its Shadow.arXiv preprint arXiv:2607.28362, on PithPith's reviewarXiv
Cited by 5 Pith papers
Reviewed papers on Pith that cite this one. The full citation record
- VibePrevisBench: Evaluating Agentic Coding for 4D Scene Generation in Blender cs.CV · Nov 2026
- PlayGen2: Learning Real-Time Playable Worlds with Explicit 3D State cs.CV · Nov 2026
- Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds cs.CV · Oct 2026
- Mallea: Building, Steering, and Memorizing Worlds with Coding Agent cs.AI · Oct 2026
- The Past Frames the Future: Memory for Autoregressive Video Generation cs.CV · Sep 2026
Challenges and discussion
Disagree with the review, or know something it missed? Leave a comment, or challenge this review formally: a challenge becomes a permanent entry in this paper's record, and its decision is published here.
Come back by email
A short list of the week's newly reviewed papers. Nothing is sent until you confirm from your inbox, and every email has a link that stops it. No account.
No comments yet.
Sign in to comment