Pith. sign in

REVIEW 3 major objections 5 minor 68 references

EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance

T0 review · 3 major / 5 minor · reviewed 2026-08-16 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read EchoWorld claims that pretraining an echocardiography model as a motion-aware world model—reconstructing masked anatomy and predicting visual change from probe motion—reduces probe-guidance error below existing visual backbones and…

desk verdict A sensible two-stage pretraining-plus-attention system for echo probe guidance, with fair ablations and comparisons, but the small reported gains come with no error bars or significance tests, so the headline advantage is promising rather than proven. read the letter →

arxiv 2504.13065 v1 pith:CSD2EXBJ submitted 2025-04-17 cs.CV

Yang Yue , Yulin Wang , Haojun Jiang , Pan Liu , Shiji Song , Gao Huang This is my paper · ORCID
classification cs.CV
keywords echocardiographyprobeguidanceworldmodelsmotion-awareattentionself-supervisedpretrainingultrasoundrepresentationlearning6-DOFposestandardplanes
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

EchoWorld claims that an echocardiography probe-guidance model performs better when it is first pretrained as a world model on the imaging modality itself. The pretraining solves two tasks jointly: reconstructing masked anatomical regions of heart ultrasound frames, and predicting how image features change when the probe undergoes a known relative six-degree-of-freedom movement. A downstream fine-tuning stage adds a motion-aware attention head that injects pairwise probe-pose differences into the keys and values, so historical visual-motion pairs are aggregated by their 3D spatial relation rather than as an interleaved action sequence. On the paper's dataset of roughly one million frames from over 200 routine scans, this combination reduces mean probe-movement prediction error for acquiring ten standard planes below general, medical, and ultrasound-specific backbones and below prior guidance frameworks, in both single-frame and sequential evaluation.

What carries the argument

The load-bearing object is a joint-embedding predictive architecture (JEPA) consisting of a ViT-S context encoder, an exponential-moving-average target encoder, and a six-layer transformer predictor. In the spatial task, contiguous rectangular blocks of patches are masked and the predictor reconstructs target-encoder features at those locations. In the motion task, the relative probe pose $p_{a\to b}=p_b\cdot p_a^{-1}$ is encoded by a two-layer MLP into a token, and the predictor uses it to anticipate the average-pooled target features, trained with an InfoNCE contrastive loss. At fine-tuning, a motion-aware attention module replaces position embeddings with pairwise pose-conditioned keys and values, $K_j^{(i)}=\mathrm{MLP}(h_j,z_{i\to j})$ and $V_j^{(i)}=\mathrm{MLP}(h_j,z_{i\to j})$, so each query attends to history through the lens of the probe movement linking the frames. This machinery is what carries the argument: it forces the representation to encode anatomy and motion dynamics before the guidance head is ever trained.

What would settle it

Train the motion task and the motion-aware attention head with the relative poses randomly shuffled between matched image pairs while keeping the images in their original order; if single-frame and sequential guidance error stay close to the unshuffled model, the motion signal is not what carries the gain. Alternatively, evaluate the final model on a held-out cohort of female, pediatric, or diseased hearts; a large error increase would show the 'world model' is tied to the healthy adult male anatomy it was trained on.

Watch

Extended reading notes

Core claim

The central discovery is that predicting the visual consequence of probe motion, together with reconstructing masked anatomy, produces a cardiac ultrasound representation that transfers to probe guidance better than existing pretraining objectives, and that making attention itself motion-aware harvests additional gains from history. In the single-frame protocol, EchoWorld reaches an average translation error of 8.15 mm and rotation error of 8.36 degrees, against 8.37 mm and 8.74 degrees for the best prior backbone, EchoCLIP. In the sequential protocol, where the model sees past visual-motion pairs and must reach planes not yet visited, EchoWorld reaches 7.05 mm and 7.42 degrees, against 7.42 mm and 7.72 degrees for the best prior sequence-based framework. The ablations attribute these gains to both world-modeling tasks: spatial modeling alone, motion modeling alone, and the combination each improve over no pretraining, and the motion-aware attention head outperforms the same backbone without pose-conditioned attention.

Load-bearing premise

The load-bearing premise is that the relative six-degree-of-freedom probe pose, encoded by a two-layer MLP, is a faithful and complete description of how the ultrasound image changes, so that training the model to predict target features from that pose actually teaches real cardiac dynamics rather than fitting label noise.

Editorial extensions

If this is right

  • A model pretrained this way needs no task-specific labels during pretraining, so the same recipe transfers to new scanning protocols or probe types as long as synchronized video and pose streams can be recorded.
  • Replacing interleaved image-action sequence encoders with pose-conditioned attention lowers sequential guidance error, so historical motion is better exploited when the probe approaches a target plane.
  • The world-model predictor, when paired with a diffusion decoder, can synthesize plausible ultrasound frames under probe motion, pointing toward a learnable cardiac ultrasound simulator for training or rehearsal.
  • Because combined spatial and motion pretraining beats either task alone, the two objectives encode complementary knowledge: static anatomy and motion-induced visual dynamics.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same two-stage recipe could be applied to freehand ultrasound if the pose stream came from an external tracker rather than a robot arm; the paper's data collection method is not a necessary part of the method itself.
  • A control experiment that corrupts the pose stream (for example, randomly permuting relative poses between matched frames) would isolate how much of the gain comes from genuine dynamics learning versus simply having an extra conditioning input.
  • Because motion-aware attention is defined for any set of tokens with pairwise rigid transformations, it could transfer to other 6-DOF embodied guidance tasks such as robotic bronchoscopy, vascular ultrasound, or freehand 3D reconstruction.
  • The dataset's restriction to healthy adult males leaves open whether the learned anatomical world model retains its guidance advantage across female patients, pediatric anatomy, or hearts with structural disease; a cross-cohort evaluation would settle this.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes EchoWorld, a two-stage framework for echocardiography probe guidance. In the first stage, a ViT-based encoder is pre-trained with two JEPA-style world-modeling tasks: spatial modeling (masked-feature reconstruction) and motion modeling (predicting average-pooled target features conditioned on a learned embedding of relative 6-DOF probe pose, with an InfoNCE objective). In the second stage, the pre-trained encoder is fine-tuned with a motion-aware attention module that injects pairwise relative pose differences into attention keys and values, enabling aggregation of historical visual-motion pairs. The method is trained on a private dataset of about one million ultrasound frames from 356 routine scans and evaluated under single-frame and sequential protocols against general, medical, and ultrasound-specific baselines. Reported results show consistent but modest reductions in translation/rotation MAE; for example, single-frame average error is 8.15 mm/8.36 degrees for EchoWorld versus 8.37 mm/8.74 degrees for EchoCLIP, and sequential average error is 7.05 mm/7.42 degrees versus 7.42 mm/7.72 degrees for Sequence-aware. Ablations attribute gains to the spatial and motion pretraining tasks and to motion-aware attention.

Significance. If the reported gains are statistically reliable, the paper makes a useful contribution: it proposes an ultrasound-specific pretraining scheme that encodes both anatomy and motion dynamics, and an attention mechanism that meaningfully uses relative pose information. The sequential protocol fairly holds the visual backbone fixed across baselines, isolating the contribution of the guidance module, and the ablations are well designed. The release of code and the detailed appendix (including pseudocode and hyperparameters) support reproducibility. The significance is tempered, however, by the reliance on a private dataset, the all-male healthy-subject composition, the offline simulation nature of the evaluation, and the absence of any uncertainty quantification in the headline results.

major comments (3)
  1. [§5.2, Table 1; §5.3, Tables 2–3] The central quantitative claim rests on a single set of MAE values with no uncertainty quantification. The reported margins over the best baselines are small (e.g., single-frame average 8.15 vs. 8.37 mm and 8.36 vs. 8.74 degrees; sequential average 7.05 vs. 7.42 mm), the sequential metric is averaged over only 30 test scans, and the errors are aggregated over frames rather than per scan. Because all methods are fully fine-tuned on the same data, the observed differences could plausibly arise from initialization or optimizer variance rather than from the proposed components. Please report per-scan error distributions, confidence intervals or paired significance tests (e.g., bootstrap or Wilcoxon), and results from at least three seeds for the main comparisons and for the ablations in Tables 2 and 3.
  2. [§5.2, Eq. (13)–(15); Appendix B.2] The sequential protocol evaluates only the 30 of 72 test scans in which all ten planes are visited, but no analysis shows that this subset is representative of the full test set or that the selection does not favor the proposed method. The paper should either report results on the full test set or justify the restriction with per-scan statistics. It should also clearly state that the protocol is an offline simulation rather than a robotic deployment; a closed-loop robotic evaluation would be needed to support deployment-oriented claims.
  3. [§4.1, Eq. (6)–(7); §4.2, Eq. (9)–(11); Appendix C.1] The method is motion-conditioned in a fundamental way: the relative 6-DOF pose pa→b drives both the motion pretraining task and the motion-aware attention keys/values, and the guidance labels are also computed from probe poses. Yet the paper provides no independent verification of the robot-arm pose accuracy or of the synchronization between the ultrasound video stream and the pose stream. A systematic offset or latency in the pose signal would corrupt both the pretraining signal and the guidance targets. Please report calibration and synchronization checks (e.g., known-motion residual tests or temporal-alignment validation), or explicitly characterize the uncertainty of the pose labels.
minor comments (5)
  1. [Appendix B.2, Eq. (13)–(14)] The main text states that the latest timestep t_N = t is included in the input history, while Eq. (13) defines H_t with t' < t; the sampling formula in Eq. (14) then includes t_N = t by construction. Please reconcile this inconsistency and specify whether the current frame is part of the model input.
  2. [Appendix A] The appendix states that all subjects in the dataset were healthy adult males. This is a substantial limitation for any clinical generalization claim; it should be stated in the main text and the breadth of the conclusions should be adjusted accordingly.
  3. [§4–§5] Several important hyperparameters are fixed without sensitivity analysis: λ=0.1 in Eq. (8), N=8 and α=0.4 in Eq. (14), τ=0.1 in Eq. (7), and the 6/3 fps evaluation rates. A small sensitivity study for at least N and λ would increase confidence that the reported gains are not tuned to these particular choices.
  4. [Table 1] The header of Table 1 ("AvgTrans. Rot.") and the bold/underline convention are ambiguous. Please define precisely which quantities are averaged (e.g., mean of translation and rotation errors over the ten planes) and mark the best and second-best entries consistently.
  5. [Figures and supplementary material] The text contains stray token-like sequences (e.g., repeated "/gid000..." strings) in several figure captions and in the supplementary material. These should be removed before publication.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the pretraining objectives are self-supervised, the fine-tuning loss is a separate supervised guidance loss, and the motion-aware attention consumes history-frame relative poses that are distinct from the unvisited-plane movement targets.

full rationale

EchoWorld's derivation chain is self-contained rather than circular. The pretraining objectives in Eqs. (5) and (7)-(8) are self-supervised: masked feature reconstruction and contrastive prediction of a target frame's pooled features given the relative pose. They do not use the guidance labels employed at fine-tuning. The fine-tuning loss, L_guide = ||a_t - a_hat_t||_1, is supervised with ground-truth movements to ten standard planes, and the reported errors are computed on a held-out test split (72 scans; 30 in the sequential protocol). The motion-aware attention in Eqs. (9)-(12) encodes pairwise pose differences z_{i->j} among history frames into keys and values, whereas the prediction target in Sec. 3.2 is the relative movement p* * p_t^{-1} from the current frame to an unvisited target plane pose. These are distinct quantities, so the prediction is not the fitted input by construction. Baseline comparisons are controlled: the single-frame protocol uses the same prediction head, and the sequential protocol uses the same pretrained visual backbone for all methods. The citations to the authors' prior probe-guidance papers [32, 33] are related-work and baseline attributions, not load-bearing premises or imported uniqueness theorems. The absence of error bars or significance tests is a legitimate evaluation-robustness concern, but it is not an instance of circularity under the criteria used here.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

The method introduces no new physical entities or forces. The relevant ledger entries are the manually chosen hyperparameters in the pretraining objective and the implicit domain assumptions about pose calibration, anatomy labeling, and population representativeness. The absence of error bars and the private dataset also shift the burden of proof onto the reader, but these are not formal axioms.

free parameters (5)
  • loss balancing weight lambda = 0.1
    The total pretraining loss is L_spatial + lambda * L_motion with lambda = 0.1 in Equation (8). The scalar is chosen to balance the two loss scales and is not justified by a principled derivation.
  • sample count N = 8
    The sequential protocol samples N = 8 historical frames with a decayed density rate and scaling factor alpha = 0.4, chosen by the authors as a default without an ablation on N.
  • contrastive temperature tau = 0.1
    The InfoNCE temperature in Equation (7) and the supplementary is set to 0.1 by default, a standard but arbitrary value.
  • EMA decay schedule = 0.996 to 1.0 cosine
    The target encoder uses a starting EMA decay of 0.996 increasing to 1.0, a design choice inherited from I-JEPA-style training without a dedicated analysis for ultrasound data.
  • frame rates for evaluation = 6 fps single-frame, 3 fps sequential
    The evaluation frame rates are reduced from the native 30 fps for computational efficiency. The sequential sampling schedule in the supplementary depends on these rates, and the reported errors may change with different sampling densities.
assumptions (4)
  • domain assumption The robotic arm pose stream is synchronized with the ultrasound video and provides ground-truth 6-DOF probe poses.
    The dataset section in the supplementary states that videos and probe poses are simultaneously recorded, but no synchronization validation or pose accuracy analysis is provided. All guidance labels are computed from these poses.
  • domain assumption Averaged-pooled image features are sufficient tokens for the sequential guidance module.
    Equation (9) average-pools the pre-trained visual features, discarding spatial layout before motion-aware attention. The paper does not compare against a spatially resolved token variant.
  • domain assumption Ten standard planes annotated by professionals are well-defined and consistently labeled across the dataset.
    The supplementary says professionals manually annotate timestamps and frames for the planes, but no inter-annotator agreement or annotation protocol is reported.
  • domain assumption The healthy adult male study population is representative enough for the guidance task.
    The supplementary states all subjects are healthy adult males. The central claim is stated for echocardiography guidance generally, without this population caveat.

how reviews work

0 comments
Cite this review

Pith. "Pith review of EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance." pith.science (2026). https://pith.science/paper/CSD2EXBJ

@misc{pith2026250413065,
  author       = {Pith},
  title        = {Pith review of: EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/CSD2EXBJ}},
  note         = {Machine review of arXiv:2504.13065}
}
read the original abstract

Echocardiography is crucial for cardiovascular disease detection but relies heavily on experienced sonographers. Echocardiography probe guidance systems, which provide real-time movement instructions for acquiring standard plane images, offer a promising solution for AI-assisted or fully autonomous scanning. However, developing effective machine learning models for this task remains challenging, as they must grasp heart anatomy and the intricate interplay between probe motion and visual signals. To address this, we present EchoWorld, a motion-aware world modeling framework for probe guidance that encodes anatomical knowledge and motion-induced visual dynamics, while effectively leveraging past visual-motion sequences to enhance guidance precision. EchoWorld employs a pre-training strategy inspired by world modeling principles, where the model predicts masked anatomical regions and simulates the visual outcomes of probe adjustments. Built upon this pre-trained model, we introduce a motion-aware attention mechanism in the fine-tuning stage that effectively integrates historical visual-motion data, enabling precise and adaptive probe guidance. Trained on more than one million ultrasound images from over 200 routine scans, EchoWorld effectively captures key echocardiographic knowledge, as validated by qualitative analysis. Moreover, our method significantly reduces guidance errors compared to existing visual backbones and guidance frameworks, excelling in both single-frame and sequential evaluation protocols. Code is available at https://github.com/LeapLabTHU/EchoWorld.

Figures

Figures reproduced from arXiv: 2504.13065 by the authors.

Figure 1
Figure 1. Overview of cardiac ultrasound and the probe guidance task. (a) The ultrasound probe captures cross-sectional views of the heart, with variations in probe position and orientation corresponding to different anatomical structures. (b) During the ultrasound scanning process, the sonographer maneuvers the probe on the patient’s chest, continuously adjusting its position and orientation based on real-time visual feedbac… view at source ↗
Figure 2
Figure 2. , our cardiac world model encodes two key dimen￾sions of echocardiology knowledge: 1) the appearance of anatomical structures (e.g., ventricle, valves, and septums) in cardiac ultrasound images and 2) the changing dynamic of visual signals following the probe motions. Building on this pre-trained world model, we introduce a guidance prediction module with a motion-aware atten￾tion mechanism that integrates historica… view at source ↗
Figure 3
Figure 3. Illustration of our dataset and task. Top-left: We col [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Illustration of the world modeling tasks. (a) A basic world modeling framework [37], where the task is to predict the target y from context x in feature space, using a latent variable z encoding their relationship. (b) The spatial world modeling task, which recovers ma…
Figure 5
Figure 5. Figure 5: The probe guidance pipeline. Given a sequence of historical visual-motion pairs, we first extract features using the pre-trained visual and motion encoders. These features are then integrated via a motion-aware attention mechanism and projected to the final guidance ou…
Figure 6
Figure 6. Figure 6: Comparison of standard (left) and motion-aware (right) attention, where the latter incorporates pairwise pose dif￾ferences across the tokens into the key-value pairs. modeling of the spatial relationships between frames. Specifically, we first use the pre-trained world…
Figure 7
Figure 7. Figure 7: Visualization of world modeling predictions. Using a diffusion model, we map the outputs of the predictor to pixel space. The predictor effectively recovers (a) masked anatomical regions and (b) the visual changes resulting from probe movement. The predicted regions ar…
Figure 8
Figure 8. Figure 8: Visualization of attention scores [PITH_FULL_IMAGE:figures/full_fig_p008_8.png]
Figure 9
Figure 9. Figure 9: t-SNE visualization. and motion modeling, leading to a significant improvement in representation quality. Ablation study on motion-awareness is shown in [PITH_FULL_IMAGE:figures/full_fig_p008_9.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

68 extracted references · 39 canonical work pages

  1. [1]

    Oasis: A universe in a transformer

    Decart AI. Oasis: A universe in a transformer. https : / / www . decart . ai / articles / oasis - interactive- ai-video- game- model. Accessed: Nov, 2024. 3

    work page 2024

  2. [2]

    Diffusion for world modeling: Visual details matter in atari

    Eloi Alonso, Adam Jelley, Vincent Micheli, Anssi Kan- ervisto, Amos Storkey, Tim Pearce, and Franc ¸ois Fleuret. Diffusion for world modeling: Visual details matter in atari. arXiv preprint arXiv:2405.12399, 2024. 3

    arXiv 2024

  3. [3]

    Goal-conditioned reinforcement learning for ultrasound nav- igation guidance

    Abdoul Aziz Amadou, Vivek Singh, Florin C Ghesu, Young- Ho Kim, Laura Stanciulescu, Harshitha P Sai, Puneet Sharma, Alistair Young, Ronak Rajani, and Kawal Rhode. Goal-conditioned reinforcement learning for ultrasound nav- igation guidance. In International Conference on Medi- cal Image Computing and Computer-Assisted Intervention , pages 319–329. Springe...

    work page 2024

  4. [4]

    Self-supervised learning from images with a joint-embedding predictive architecture

    Mahmoud Assran, Quentin Duval, Ishan Misra, Piotr Bo- janowski, Pascal Vincent, Michael Rabbat, Yann LeCun, and Nicolas Ballas. Self-supervised learning from images with a joint-embedding predictive architecture. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15619–15629, 2023. 3, 4

    work page 2023

  5. [5]

    Data2vec: A general frame- work for self-supervised learning in speech, vision and lan- guage

    Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, and Michael Auli. Data2vec: A general frame- work for self-supervised learning in speech, vision and lan- guage. In International Conference on Machine Learning , pages 1298–1312. PMLR, 2022. 4

    work page 2022

  6. [6]

    Efficient self-supervised learning with contextualized target representations for vision, speech and language

    Alexei Baevski, Arun Babu, Wei-Ning Hsu, and Michael Auli. Efficient self-supervised learning with contextualized target representations for vision, speech and language. In In- ternational Conference on Machine Learning , pages 1416–

  7. [7]

    V-jepa: Latent video prediction for visual represen- tation learning

    Adrien Bardes, Quentin Garrido, Jean Ponce, Xinlei Chen, Michael Rabbat, Yann LeCun, Mido Assran, and Nicolas Ballas. V-jepa: Latent video prediction for visual represen- tation learning. 2023. 3

    2023

  8. [8]

    High fidelity visualization of what your self-supervised rep- resentation knows about

    Florian Bordes, Randall Balestriero, and Pascal Vincent. High fidelity visualization of what your self-supervised rep- resentation knows about. arXiv preprint arXiv:2112.09164,

    arXiv

Show all 68 references
  1. [9]

    Rt-2: Vision-language-action models transfer web knowledge to robotic control

    Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Xi Chen, Krzysztof Choromanski, Tianli Ding, Danny Driess, Avinava Dubey, Chelsea Finn, et al. Rt-2: Vision-language-action models transfer web knowledge to robotic control. arXiv preprint arXiv:2307.15818, 2023. 3

    2023 arXiv

  2. [10]

    Applied optimal control: optimization, estimation and control

    Arthur Earl Bryson. Applied optimal control: optimization, estimation and control. Routledge, 2018. 2

    2018

  3. [11]

    Constrained model predictive control

    Eduardo F Camacho, Carlos Bordons, Eduardo F Camacho, and Carlos Bordons. Constrained model predictive control. Springer, 2007. 2

    2007

  4. [12]

    Emerg- ing properties in self-supervised vision transformers

    Mathilde Caron, Hugo Touvron, Ishan Misra, Herv ´e J´egou, Julien Mairal, Piotr Bojanowski, and Armand Joulin. Emerg- ing properties in self-supervised vision transformers. In Pro- ceedings of the IEEE/CVF international conference on com- puter vision, pages 9650–9660, 2021. 1

    2021

  5. [13]

    Decision transformer: Reinforce- ment learning via sequence modeling

    Lili Chen, Kevin Lu, Aravind Rajeswaran, Kimin Lee, Aditya Grover, Misha Laskin, Pieter Abbeel, Aravind Srini- vas, and Igor Mordatch. Decision transformer: Reinforce- ment learning via sequence modeling. Advances in neural information processing systems, 34:15084–15097, 2021. 7, 8, 2

    2021

  6. [14]

    A simple framework for contrastive learning of visual representations

    Ting Chen, Simon Kornblith, Mohammad Norouzi, and Ge- offrey Hinton. A simple framework for contrastive learning of visual representations. In International conference on ma- chine learning, pages 1597–1607. PMLR, 2020. 5

    2020

  7. [15]

    An empirical study of training self-supervised vision transformers

    Xinlei Chen, Saining Xie, and Kaiming He. An empirical study of training self-supervised vision transformers. InPro- ceedings of the IEEE/CVF international conference on com- puter vision, pages 9640–9649, 2021. 7, 1, 2

    2021

  8. [16]

    Vision–language foundation model for echocardiogram interpretation

    Matthew Christensen, Milos Vukadinovic, Neal Yuan, and David Ouyang. Vision–language foundation model for echocardiogram interpretation. Nature Medicine, pages 1– 8, 2024. 3, 7, 1, 2

    2024

  9. [17]

    The nature of explanation

    Kenneth James Williams Craik. The nature of explanation. CUP Archive, 1967. 2, 4

    1967

  10. [18]

    Imagenet: A large-scale hierarchical image database

    Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009. 1

    2009

  11. [19]

    Memsam: Taming segment anything model for echocardiog- raphy video segmentation

    Xiaolong Deng, Huisi Wu, Runhao Zeng, and Jing Qin. Memsam: Taming segment anything model for echocardiog- raphy video segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9622–9631, 2024. 3

    2024

  12. [20]

    An image is worth 16x16 words: Trans- formers for image recognition at scale

    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Syl- vain Gelly, et al. An image is worth 16x16 words: Trans- formers for image recognition at scale. arXiv preprint a...

    2010 arXiv

  13. [21]

    Automatic probe movement guidance for freehand obstetric ultrasound

    Richard Droste, Lior Drukker, Aris T Papageorghiou, and J Alison Noble. Automatic probe movement guidance for freehand obstetric ultrasound. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020,...

    2020

  14. [22]

    A learned representation for artistic style

    Vincent Dumoulin, Jonathon Shlens, and Manjunath Kud- lur. A learned representation for artistic style. arXiv preprint arXiv:1610.07629, 2016. 4

    2016 arXiv

  15. [23]

    Vista: A generalizable driving world model with high fidelity and versatile controllability

    Shenyuan Gao, Jiazhi Yang, Li Chen, Kashyap Chitta, Yihang Qiu, Andreas Geiger, Jun Zhang, and Hongyang Li. Vista: A generalizable driving world model with high fidelity and versatile controllability. arXiv preprint arXiv:2405.17398, 2024. 2

    2024 arXiv

  16. [24]

    Learning and leveraging world models in visual representation learning

    Quentin Garrido, Mahmoud Assran, Nicolas Ballas, Adrien Bardes, Laurent Najman, and Yann LeCun. Learning and leveraging world models in visual representation learning. arXiv preprint arXiv:2403.00504, 2024. 3

    2024 arXiv

  17. [25]

    Recurrent world models facilitate policy evolution

    David Ha and J ¨urgen Schmidhuber. Recurrent world models facilitate policy evolution. Advances in neural information processing systems, 31, 2018. 2

    2018

  18. [26]

    World models

    David Ha and J ¨urgen Schmidhuber. World models. arXiv preprint arXiv:1803.10122, 2018. 2, 4 9

    2018 arXiv

  19. [27]

    Dream to control: Learning behaviors by la- tent imagination

    Danijar Hafner, Timothy Lillicrap, Jimmy Ba, and Moham- mad Norouzi. Dream to control: Learning behaviors by la- tent imagination. arXiv preprint arXiv:1912.01603, 2019. 3

    1912 arXiv

  20. [28]

    Mastering atari with discrete world models.arXiv preprint arXiv:2010.02193, 2020

    Danijar Hafner, Timothy Lillicrap, Mohammad Norouzi, and Jimmy Ba. Mastering atari with discrete world models.arXiv preprint arXiv:2010.02193, 2020. 2

    2010 arXiv

  21. [29]

    Mastering diverse domains through world models

    Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, and Timothy Lillicrap. Mastering diverse domains through world models. arXiv preprint arXiv:2301.04104, 2023. 3

    2023 arXiv

  22. [30]

    Masked autoencoders are scalable vision learners

    Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Doll´ar, and Ross Girshick. Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 16000– 16009, 2022. 4, 7, 1, 2

    2022

  23. [31]

    Gaia-1: A generative world model for au- tonomous driving

    Anthony Hu, Lloyd Russell, Hudson Yeo, Zak Murez, George Fedoseev, Alex Kendall, Jamie Shotton, and Gian- luca Corrado. Gaia-1: A generative world model for au- tonomous driving. arXiv preprint arXiv:2309.17080, 2023. 2

    2023 arXiv

  24. [32]

    Cardiac copilot: Automatic probe guidance for echocardiography with world model

    Haojun Jiang, Zhenguo Sun, Ning Jia, Meng Li, Yu Sun, Shaqi Luo, Shiji Song, and Gao Huang. Cardiac copilot: Automatic probe guidance for echocardiography with world model. In International Conference on Medical Image Com- puting and Computer-Assisted Intervention, pages 190–1...

    2024

  25. [33]

    Sequence-aware pre-training for echocardiography probe guidance

    Haojun Jiang, Zhenguo Sun, Yu Sun, Ning Jia, Meng Li, Shaqi Luo, Shiji Song, and Gao Huang. Sequence-aware pre-training for echocardiography probe guidance. arXiv preprint arXiv:2408.15026, 2024. 3, 7, 8, 2

    2024

  26. [34]

    Usfm: A universal ultrasound founda- tion model generalized to tasks and organs towards label effi- cient image analysis

    Jing Jiao, Jin Zhou, Xiaokang Li, Menghua Xia, Yi Huang, Lihong Huang, Na Wang, Xiaofan Zhang, Shichong Zhou, Yuanyuan Wang, et al. Usfm: A universal ultrasound founda- tion model generalized to tasks and organs towards label effi- cient image analysis. Medical Image Analysis,...

  27. [35]

    How far is video generation from world model: A physical law perspective

    Bingyi Kang, Yang Yue, Rui Lu, Zhijie Lin, Yang Zhao, Kaixin Wang, Gao Huang, and Jiashi Feng. How far is video generation from world model: A physical law perspective. arXiv preprint arXiv:2411.02385, 2024. 2

    2024 arXiv

  28. [36]

    Openvla: An open-source vision-language-action model

    Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan Foster, Grace Lam, Pannag Sanketi, et al. Openvla: An open-source vision-language-action model. arXiv preprint arXiv:2406.09246, 2024. 3

    2024 arXiv

  29. [37]

    A path towards autonomous machine intelli- gence version 0.9

    Yann LeCun. A path towards autonomous machine intelli- gence version 0.9. 2, 2022-06-27.Open Review, 62(1), 2022. 2, 4

    2022

  30. [38]

    Rl-tee: Autonomous probe guidance for trans- esophageal echocardiography based on attention-augmented deep reinforcement learning

    Keyu Li, Ang Li, Yangxin Xu, Huahua Xiong, and Max Q- H Meng. Rl-tee: Autonomous probe guidance for trans- esophageal echocardiography based on attention-augmented deep reinforcement learning. IEEE Transactions on Automa- tion Science and Engineering, 21(2):1526–1538, 2023. 3

    2023

  31. [39]

    Be- yond adapting sam: Towards end-to-end ultrasound image segmentation via auto prompting

    Xian Lin, Yangyang Xiang, Li Yu, and Zengqiang Yan. Be- yond adapting sam: Towards end-to-end ultrasound image segmentation via auto prompting. In International Confer- ence on Medical Image Computing and Computer-Assisted Intervention, pages 24–34. Springer, 2024. 3

    2024

  32. [40]

    Gaze-probe joint guidance with multi-task learning in obstetric ultrasound scanning

    Qianhui Men, Clare Teng, Lior Drukker, Aris T Papa- georghiou, and J Alison Noble. Gaze-probe joint guidance with multi-task learning in obstetric ultrasound scanning. Medical image analysis, 90:102981, 2023. 3

    2023

  33. [41]

    Lvm-med: Learning large- scale self-supervised vision models for medical imaging via second-order graph matching

    Duy MH Nguyen, Hoang Nguyen, Nghiem Diep, Tan Ngoc Pham, Tri Cao, Binh Nguyen, Paul Swoboda, Nhat Ho, Shadi Albarqouni, Pengtao Xie, et al. Lvm-med: Learning large- scale self-supervised vision models for medical imaging via second-order graph matching. Advances in Neural Info...

    2024

  34. [42]

    Guidelines for performing a comprehensive transthoracic echocardiographic examination in adults: rec- ommendations from the american society of echocardiogra- phy

    Carol Mitchell, Peter S Rahko, Lori A Blauwet, Barry Cana- day, Joshua A Finstuen, Michael C Foster, Kenneth Hor- ton, Kofo O Ogunyankin, Richard A Palma, and Eric J Velazquez. Guidelines for performing a comprehensive transthoracic echocardiographic examination in adults: rec...

    2019

  35. [43]

    Util- ity of a deep-learning algorithm to guide novices to acquire echocardiograms for limited diagnostic use

    Akhil Narang, Richard Bae, Ha Hong, Yngvil Thomas, Samuel Surette, Charles Cadieu, Ali Chaudhry, Randolph P Martin, Patrick M McCarthy, David S Rubenson, et al. Util- ity of a deep-learning algorithm to guide novices to acquire echocardiograms for limited diagnostic use. JAMA ...

    2021

  36. [44]

    Open x-embodiment: Robotic learning datasets and rt-x models

    Abby O’Neill, Abdul Rehman, Abhinav Gupta, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, et al. Open x-embodiment: Robotic learning datasets and rt-x models. arXiv preprint arXiv:2310.08864, 2023. 3

    arXiv

  37. [45]

    Repre- sentation learning with contrastive predictive coding

    Aaron van den Oord, Yazhe Li, and Oriol Vinyals. Repre- sentation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748, 2018. 5

    2018 arXiv

  38. [46]

    Video generation models as world simula- tors

    OpenAI. Video generation models as world simula- tors. https : / / openai . com / index / video - generation - models - as - world - simulators/. Accessed: Feb, 2024. 2

    2024

  39. [47]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. 7, 1

    2023 arXiv

  40. [48]

    Video-based ai for beat-to-beat assessment of cardiac func- tion

    David Ouyang, Bryan He, Amirata Ghorbani, Neal Yuan, Joseph Ebinger, Curtis P Langlotz, Paul A Heidenreich, Robert A Harrington, David H Liang, Euan A Ashley, et al. Video-based ai for beat-to-beat assessment of cardiac func- tion. Nature, 580(7802):252–256, 2020. 3

    2020

  41. [49]

    Global, regional, and national burden of cardiovascular dis- eases for 10 causes, 1990 to 2015

    Gregory A Roth, Catherine Johnson, Amanuel Abajobir, Foad Abd-Allah, Semaw Ferede Abera, Gebre Abyu, Muk- tar Ahmed, Baran Aksut, Tahiya Alam, Khurshid Alam, et al. Global, regional, and national burden of cardiovascular dis- eases for 10 causes, 1990 to 2015. Journal of the A...

    1990

  42. [50]

    Introducing general world models

    RunwayML. Introducing general world models. https: / / research . runwayml . com / introducing - general-world-models. Accessed: May, 2023. 2

    2023

  43. [51]

    Real-time guidance by deep learning of experienced operators to improve the standardization of echocardiographic acquisitions

    Sigbjorn Sabo, David Pasdeloup, Hakon Neergaard Pet- tersen, Erik Smistad, Andreas Østvik, Sindre Hellum 10 Olaisen, Stian Bergseng Stølen, Bjørnar Leangen Grenne, Espen Holte, Lasse Lovstakken, et al. Real-time guidance by deep learning of experienced operators to improve the...

    2023

  44. [52]

    Self- attention with relative position representations

    Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani. Self- attention with relative position representations. In Proceed- ings of the 2018 Conference of the North American Chap- ter of the Association for Computational Linguistics: Hu- man Language Technologies, Volume 2 (Short Pap...

    2018

  45. [53]

    Automated image acquisition of parasternal long- axis view with robotic echocardiography.IEEE Robotics and Automation Letters, 2023

    Yuuki Shida, Souto Kumagai, Ryosuke Tsumura, and Hiroy- asu Iwata. Automated image acquisition of parasternal long- axis view with robotic echocardiography.IEEE Robotics and Automation Letters, 2023. 1, 3

    2023

  46. [54]

    Diagnos- tic posture control system for seated-style echocardiography robot

    Yuuki Shida, Masami Sugawara, Ryosuke Tsumura, Haru- aki Chiba, Tokuhisa Uejima, and Hiroyasu Iwata. Diagnos- tic posture control system for seated-style echocardiography robot. International Journal of Computer Assisted Radiology and Surgery, 18(5):887–897, 2023. 3

    2023

  47. [55]

    Global and regional prevalence, burden, and risk factors for carotid atherosclerosis: a systematic review, meta- analysis, and modelling study

    Peige Song, Zhe Fang, Hanyu Wang, Yutong Cai, Kazem Rahimi, Yajie Zhu, F Gerald R Fowkes, Freya JI Fowkes, and Igor Rudan. Global and regional prevalence, burden, and risk factors for carotid atherosclerosis: a systematic review, meta- analysis, and modelling study. The Lancet...

    2020

  48. [56]

    Moco pretraining improves representation and transferability of chest x-ray models

    Hari Sowrirajan, Jingbo Yang, Andrew Y Ng, and Pranav Rajpurkar. Moco pretraining improves representation and transferability of chest x-ray models. In Medical Imaging with Deep Learning, pages 728–744. PMLR, 2021. 5

    2021

  49. [57]

    Echo from noise: synthetic ultra- sound image generation using diffusion models for real im- age segmentation

    David Stojanovski, Uxio Hermida, Pablo Lamata, Arian Be- qiri, and Alberto Gomez. Echo from noise: synthetic ultra- sound image generation using diffusion models for real im- age segmentation. In International Workshop on Advances in Simplifying Medical Ultrasound , pages 34–4...

  50. [58]

    Roformer: Enhanced transformer with rotary position embedding

    Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. Roformer: Enhanced transformer with rotary position embedding. Neurocomputing, 568:127063,

  51. [59]

    Training data-efficient image transformers & distillation through at- tention

    Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, and Herv ´e J´egou. Training data-efficient image transformers & distillation through at- tention. In International conference on machine learning , pages 10347–10357. PMLR, 2021. 7, 8, 1

    2021

  52. [60]

    Diffusion models are real-time game engines

    Dani Valevski, Yaniv Leviathan, Moab Arar, and Shlomi Fruchter. Diffusion models are real-time game engines. arXiv preprint arXiv:2408.14837, 2024. 3

    2024 arXiv

  53. [61]

    Attention is all you need

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko- reit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017. 5, 6

    2017

  54. [62]

    Thyroid ultrasound diagnosis improvement via multi-view self-supervised learning and two-stage pre- training

    Jian Wang, Xin Yang, Xiaohong Jia, Wufeng Xue, Rusi Chen, Yanlin Chen, Xiliang Zhu, Lian Liu, Yan Cao, Jian- qiao Zhou, et al. Thyroid ultrasound diagnosis improvement via multi-view self-supervised learning and two-stage pre- training. Computers in Biology and Medicine , 171:108087,

  55. [63]

    Efficienttrain: Exploring gener- alized curriculum learning for training visual backbones

    Yulin Wang, Yang Yue, Rui Lu, Tianjiao Liu, Zhao Zhong, Shiji Song, and Gao Huang. Efficienttrain: Exploring gener- alized curriculum learning for training visual backbones. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 5852–5864, 2023. 4

    2023

  56. [64]

    Fine-grained context and multi-modal alignment for freehand 3d ultrasound re- construction

    Zhongnuo Yan, Xin Yang, Mingyuan Luo, Jiongquan Chen, Rusi Chen, Lian Liu, and Dong Ni. Fine-grained context and multi-modal alignment for freehand 3d ultrasound re- construction. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 340–

  57. [65]

    Generalized predictive model for autonomous driving

    Jiazhi Yang, Shenyuan Gao, Yihang Qiu, Li Chen, Tianyu Li, Bo Dai, Kashyap Chitta, Penghao Wu, Jia Zeng, Ping Luo, et al. Generalized predictive model for autonomous driving. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14662–1467...

    2024

  58. [66]

    Biomedclip: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs

    Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu, Jaspreet Bagga, Robert Tinn, Sam Preston, Rajesh Rao, Mu Wei, Naveen Valluri, et al. Biomedclip: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs. arXiv preprint arXiv:2303.00915,

    arXiv

  59. [67]

    ibot: Image bert pre-training with online tokenizer

    Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, and Tao Kong. ibot: Image bert pre-training with online tokenizer. arXiv preprint arXiv:2111.07832 ,

    arXiv

  60. [2021]

    1 11 EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance Supplementary Material A. Dataset The echocardiography dataset used in this study was col- lected during routine clinical examinations, where certified sonographers performed ultrasound scan...

Pith tools

Reviewed August 16, 2026 · model on record in the stance chip above.