Pith. sign in

REVIEW 3 major objections 5 minor 300 references

MentalThink: Shaping Thoughts in Mental SVG World

T0 review · 3 major / 5 minor · reviewed 2026-07-12 · grok-4.5

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Multimodal models reason better about space when they draw and re-render their own intermediate SVG sketches.

desk verdict SVG as a revisable intermediate medium is a clean, useful idea with large gains; the main soft spot is RL on the same benchmark families, not a collapse of the claim. read the letter →

arxiv 2607.03530 v1 pith:WJMEVWMN submitted 2026-07-03 cs.AI

Kangheng Lin , Jisheng Yin , Dingming Li , En Yu , Yana Wei , Han Zhou , Liang Zhao , Hongyu Zhou
show 6 more authors
Hongbo Peng Jianjian Sun Zheng Ge Xiangyu Zhang Daxin Jiang Jingyu Wang
This is my paper · ORCID
classification cs.AI
keywords MentalThinkthink-with-SVGmultimodalreasoningscalablevectorgraphicsspatialmulti-turnRLimageryvisual-symbolic
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

MentalThink argues that multimodal language models can do stronger spatial reasoning if they treat scalable vector graphics (SVG) code as an executable mental scratchpad. Instead of describing a scene only in words or sparse boxes, the model writes SVG, has it rendered into an image, looks at the result, and revises the sketch over multiple turns. A two-stage recipe first teaches the model to produce valid SVG (supervised fine-tuning) and then uses multi-turn reinforcement learning to reward iterative inspection and self-correction. On spatial benchmarks the method lifts a 7B backbone to 55.1% on VSIBench and 76.0% on MindCube, and qualitative traces show the model spontaneously taking new perspectives, fixing orientation errors, and composing multi-view scenes. The claim is that a deterministic, compositional visual language gives models a verifiable workspace that pure text lacks, so spatial hypotheses can be checked rather than merely narrated.

What carries the argument

The think-with-SVG pipeline: an SVG-augmented reasoning state that interleaves linguistic steps with optional SVG code, a deterministic renderer that turns code into an image observation, and a multi-turn RL loop (format reward plus answer reward) that rewards the model for generating, inspecting, and revising those mental sketches.

What would settle it

Train an identical backbone with matched multi-turn text or bounding-box trajectories (same teacher, same tasks, same RL budget) and check whether the SVG version still shows the reported 40-point MindCube and 24-point VSIBench gains and the same adaptive multi-turn revision patterns on held-out spatial problems.

Watch

Extended reading notes

Core claim

Executable SVG code functions as a structured intermediate representation that lets multimodal models externalize spatial hypotheses, render them deterministically, and refine them multi-turn, producing large gains on geometry-heavy spatial benchmarks and eliciting dynamic perspective taking, visual reflection, and compositional scene construction that language-only or bounding-box intermediates do not match.

Load-bearing premise

That teacher-synthesized multi-turn SVG traces plus a simple format-and-answer reward are enough to produce genuine geometric self-correction rather than style-matching or benchmark-prompt memorization.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. MentalThink proposes a think-with-SVG pipeline that lets multimodal LLMs externalize spatial hypotheses as executable SVG code, render them deterministically, and condition subsequent reasoning on the rendered images. The method is realized by a two-stage recipe: SFT for syntactic alignment and SVG-mediated thought externalization, followed by multi-turn GRPO (Eq. 10) that rewards format validity and final-answer correctness. On a Qwen2.5-VL-7B backbone the approach reports large gains on spatial benchmarks (55.1% VSIBench, 76.0% MindCube-Tiny; Table 1), with ablations isolating SVG data, general spatial data, and RL (Table 2), a controlled paradigm comparison against text- and bbox-based intermediates (Table 3), and qualitative traces of perspective taking, visual refinement, and scene construction (Figure 3).

Significance. If the gains reflect a transferable geometric workspace rather than benchmark-specific pattern matching, the work supplies a clean, tool-free intermediate representation that is both linguistically native to LLMs and deterministically visualizable. The formalization of SVG-augmented states (Definitions 3.4–3.6), the closed render–inspect loop, and the controlled paradigm comparison (Table 3) are concrete contributions that other multimodal reasoning systems can build on. The adaptive System-1/System-2 statistics (Table 4) further suggest that the model can allocate visual computation according to task difficulty, which is a useful empirical finding for test-time scaling of spatial reasoning.

major comments (3)
  1. Section 4.1 and Appendix A.1 state that the RL corpus is drawn from the training splits of VSIBench and MindCube—the same two benchmarks that dominate the headline numbers in Table 1. The reward (Eq. 10) contains only format validity and final-answer match; there is no geometric-consistency, multi-view-consistency, or intermediate-SVG quality term. Consequently the large RL increments (especially MindCube 36%→76%) and the multi-turn revision patterns in Figure 3 remain compatible with the policy learning to emit teacher-style SVG sketches that co-occur with correct answers on these particular prompt distributions, rather than acquiring a general inspect-and-revise geometric capability. A held-out spatial suite never seen in RL (or an ablation that freezes the SVG generator after SFT and only optimizes answer selection) is needed to separate these explanations.
  2. Table 3’s paradigm comparison (Text / BBox / SVG) is the cleanest evidence that the intermediate representation itself matters, yet it is reported only for a single teacher-generated SFT setting and without error bars or multiple seeds. Because the subsequent RL stage re-uses the same benchmark families, it is unclear whether the SVG advantage survives once the policy is optimized under the format+answer reward. Reporting the same three-way comparison after RL (or at least variance across seeds) would make the central claim load-bearing rather than suggestive.
  3. The qualitative claim of “iterative inspection, revision, and refinement” (Abstract, §3.3, Figure 3) is supported only by selected traces. Table 4 shows that average turns rise only from 1.19 to 1.64 and that SVG is invoked on 63.7% of compositional items; there is no quantitative measure of how often an intermediate SVG is actually revised after rendering (as opposed to a single successful sketch followed by an answer). Without such a revision-rate or self-correction statistic, the multi-turn RL narrative remains under-supported relative to the performance claims.
minor comments (5)
  1. Table 1 reports MindCube* (MindCube-Tiny) without stating the exact subset size or selection criterion; a one-sentence clarification would aid reproducibility.
  2. The reward coefficients λ_fmt=0.25 / λ_ans=0.75 and T_max=5 are given without sensitivity analysis; a short appendix note on robustness would strengthen confidence in the free parameters.
  3. Figure 2’s example trajectory is helpful, but the rendered <image1–3> thumbnails are too small to verify that the SVG actually encodes the claimed egocentric axes; larger insets or an appendix figure would help.
  4. Several related-work citations (e.g., Visual Sketchpad, cognitive-map methods) are discussed at a high level; a short paragraph contrasting the executable, code-native nature of SVG against non-executable sketch or map tokens would sharpen the novelty claim.
  5. Typographical inconsistencies appear in model names (LLaV A vs LLaVA) and in the arXiv header date; a light copy-edit pass is warranted.

Circularity Check

0 steps flagged · score 2.0 of 10

Empirical SFT+RL pipeline on public benchmarks; only minor train-split reuse for RL prompts, not a by-construction tautology.

full rationale

MentalThink is an empirical methods paper: it defines a think-with-SVG state (Defs. 3.4–3.6), trains via SFT likelihood (Eq. 7) then GRPO with hybrid reward (Eq. 10: format validity + final-answer match), and reports measured accuracies on held-out splits of VSIBench, MindCube, etc. (Table 1). No first-principles derivation, uniqueness theorem, or fitted parameter is re-labeled as a “prediction.” The reward does not encode geometric self-consistency of intermediate SVGs, so the claim that RL “encourages iterative inspection” is interpretive rather than forced by construction; that is a causal-strength issue, not circularity. RL prompts are drawn from the training splits of the same two benchmarks that dominate the headline numbers (Sec. 4.1, A.1), which is a standard (if imperfect) practice and creates a mild contamination risk, but the evaluation remains against external baselines and official test splits. Data synthesis uses an external teacher (Gemini 3) and is filtered for renderability; this is ordinary distillation, not self-definitional. No load-bearing self-citation of an unverified uniqueness result appears. Hence only minor circularity risk (score 2); the central performance claims are externally falsifiable measurements, not tautologies.

Assumptions & free parameters 4 free parameters · 3 assumptions · 2 invented entities

The central performance claim rests on standard ML training assumptions plus a handful of design choices (reward weights, horizon, teacher model) that are free parameters of the method rather than derived quantities. No new physical or mathematical entities are postulated beyond the engineering construct of the SVG environment.

free parameters (4)
  • format/answer reward weights (λ_fmt=0.25, λ_ans=0.75)
    Chosen by hand to balance syntactic validity against final correctness; not derived from first principles.
  • maximum reasoning horizon T_max=5
    Hard-coded cap on multi-turn refinement; affects both compute and the System-2 statistics reported.
  • SFT and RL learning rates / batch sizes
    5e-5 / 256 then 2e-6 / 64; standard but free hyper-parameters that control convergence.
  • volume and mix of synthetic SVG data (50k+50k+100k)
    Curated quantities and source mix that determine the inductive bias transferred from the teacher.
assumptions (3)
  • domain assumption SVG code that is grammatically valid and renderable constitutes a complete and compositional representation of the spatial layouts needed for the target benchmarks.
    Stated in Definition 3.4 and used throughout; not proved, only motivated by SVG’s design.
  • domain assumption A deterministic SVG renderer can be inserted into the model’s context without breaking end-to-end differentiability of the policy or introducing non-stationary visual noise.
    Required by the interactive loop (Eqs. 8–9); assumed true for the experimental environment.
  • domain assumption Group Relative Policy Optimization with the hybrid reward yields stable multi-turn visual self-correction.
    Taken from prior RL literature and applied without additional theoretical guarantee.
invented entities (2)
  • think-with-SVG pipeline / SVG-augmented reasoning state
    purpose: Provides the intermediate visual-symbolic medium that the policy learns to generate, render, and revise.
    Defined in Definitions 3.5–3.6; the core engineering contribution of the paper.
  • MentalThink two-stage training recipe
    purpose: Instantiates the pipeline via SFT for syntax then multi-turn RL for iterative refinement.
    Described in Section 3.3; no external validation outside the reported experiments.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MentalThink: Shaping Thoughts in Mental SVG World." pith.science (2026). https://pith.science/paper/WJMEVWMN

@misc{pith2026260703530,
  author       = {Pith},
  title        = {Pith review of: MentalThink: Shaping Thoughts in Mental SVG World},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/WJMEVWMN}},
  note         = {Machine review of arXiv:2607.03530}
}
read the original abstract

We introduce MentalThink, a visual-symbolic reasoning paradigm that equips Multimodal LLMs (MLLMs) with an executable mechanism for "mental" visualization. The core of MentalThink is a think-with-SVG pipeline, where the model learns to generate, render, and interpret scalable vector graphics (SVG) code as an intermediate visual representation for multi-turn reasoning. By creating structured vector sketches, the model can externalize spatial hypotheses, inspect them through deterministic rendering, and reason within a constrained geometric space, effectively mimicking the human process of mental imagery. We instantiate this paradigm through a two-stage training framework, combining Supervised Fine-Tuning (SFT) for SVG syntactic alignment with multi-turn Reinforcement Learning (RL) to encourage iterative inspection, revision, and refinement of intermediate visual hypotheses. Extensive evaluations demonstrate that MentalThink achieves superior performance on spatial understanding and reasoning benchmarks (e.g., 55.1% on VSIBench, 76.0% on MindCube), showing that executable vector graphics provide a verifiable visual workspace for dynamic perspective taking, visual reflection, and compositional scene construction.

Figures

Figures reproduced from arXiv: 2607.03530 by the authors.

Figure 1
Figure 1. Conceptual comparison of different thinking paradigms. standing, transcending the surface-level pattern matching often observed in pure text generation. Second, being inher￾ently code-based, this representation aligns natively with the architecture of LLMs. Since models are extensively pretrained on both large-scale text corpora and markup or programming languages (e.g., HTML/XML), they can read￾ily reuse existing h… view at source ↗
Figure 2
Figure 2. Think-with-SVG Pipeline. MentalThink trains MLLMs to natively use SVG code to render “mental images” during multi-turn thinking process with SVG environment, enabling more advanced and effective reasoning for complex problem-solving. The rendering pipeline R consists of three sequential trans￾formations: σ Parse −−−→ TDOM Layout −−−→ G = {g1, . . . , gm} Rasterize −−−−−→ Iσ (6) where TDOM is the document object mode… view at source ↗
Figure 3
Figure 3. Examples of Spatial Reasoning Patterns. MENTALTHINK demonstrates dynamic perspective taking, reflective visual refinement, and compositional scene construction. time compute into rigorous visual grounding when faced with intricate spatial logic. 5.2. Case Analysis: Emergent Spatial Reasoning via Think-with-SVG [PITH_FULL_IMAGE:figures/full_fig_p008_3.png] view at source ↗
Figures from the paper (3 more)
Figure 4
Figure 4. Figure 4: Additional case studies for the SVG reconstruction capability of MENTALTHINK. After listing bounding boxes, explicitly reason about spatial relations (left/right/front/behind/overlapping) based on the boxes. After <think>, output the final answer in **\\ boxed{}**. A.3…
Figure 5
Figure 5. Figure 5: Additional case studies for think-with-SVG reasoning of MENTALTHINK (1/2). 16 [PITH_FULL_IMAGE:figures/full_fig_p016_5.png]
Figure 6
Figure 6. Figure 6: Additional case studies for think-with-SVG reasoning of MENTALTHINK (2/2). 17 [PITH_FULL_IMAGE:figures/full_fig_p017_6.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

300 extracted references · 148 linked inside Pith

  1. [1]

    Scaling Learning Algorithms Towards

    Bengio, Yoshua and LeCun, Yann , booktitle =. Scaling Learning Algorithms Towards

  2. [2]

    and Osindero, Simon and Teh, Yee Whye , journal =

    Hinton, Geoffrey E. and Osindero, Simon and Teh, Yee Whye , journal =. A Fast Learning Algorithm for Deep Belief Nets , volume =

  3. [3]

    2016 , publisher=

    Deep learning , author=. 2016 , publisher=

    2016

  4. [4]

    International Conference on Machine Learning , pages=

    Zero-shot text-to-image generation , author=. International Conference on Machine Learning , pages=. 2021 , organization=

    2021

  5. [5]

    arXiv preprint arXiv:2206.10789 , volume=

    Scaling autoregressive models for content-rich text-to-image generation , author=. arXiv preprint arXiv:2206.10789 , volume=. 2022 , publisher=

    arXiv 2022

  6. [6]

    arXiv preprint arXiv:2110.04627 , year=

    Vector-quantized image modeling with improved vqgan , author=. arXiv preprint arXiv:2110.04627 , year=

    arXiv

  7. [7]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Taming transformers for high-resolution image synthesis , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  8. [8]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Autoregressive image generation using residual quantization , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Show all 300 references
  1. [9]

    Advances in neural information processing systems , volume=

    Neural discrete representation learning , author=. Advances in neural information processing systems , volume=

  2. [10]

    Advances in neural information processing systems , volume=

    Generating diverse high-fidelity images with vq-vae-2 , author=. Advances in neural information processing systems , volume=

  3. [11]

    arXiv preprint arXiv:1308.3432 , year=

    Estimating or propagating gradients through stochastic neurons for conditional computation , author=. arXiv preprint arXiv:1308.3432 , year=

    arXiv

  4. [12]

    arXiv preprint arXiv:1312.6114 , year=

    Auto-encoding variational bayes , author=. arXiv preprint arXiv:1312.6114 , year=

    arXiv

  5. [13]

    Advances in neural information processing systems , volume=

    Denoising diffusion probabilistic models , author=. Advances in neural information processing systems , volume=

  6. [14]

    Advances in neural information processing systems , volume=

    Generative modeling by estimating gradients of the data distribution , author=. Advances in neural information processing systems , volume=

  7. [15]

    arXiv preprint arXiv:2010.02502 , year=

    Denoising diffusion implicit models , author=. arXiv preprint arXiv:2010.02502 , year=

    2010 arXiv

  8. [16]

    Advances in neural information processing systems , volume=

    Diffusion models beat gans on image synthesis , author=. Advances in neural information processing systems , volume=

  9. [17]

    Advances in Neural Information Processing Systems , volume=

    Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps , author=. Advances in Neural Information Processing Systems , volume=

  10. [18]

    arXiv preprint arXiv:2207.12598 , year=

    Classifier-free diffusion guidance , author=. arXiv preprint arXiv:2207.12598 , year=

    arXiv

  11. [19]

    The Journal of Machine Learning Research , volume=

    Cascaded diffusion models for high fidelity image generation , author=. The Journal of Machine Learning Research , volume=. 2022 , publisher=

    2022

  12. [20]

    arXiv preprint arXiv:2204.06125 , volume=

    Hierarchical text-conditional image generation with clip latents , author=. arXiv preprint arXiv:2204.06125 , volume=

    arXiv

  13. [21]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    High-resolution image synthesis with latent diffusion models , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  14. [22]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Scalable diffusion models with transformers , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  15. [23]

    Advances in Neural Information Processing Systems , volume=

    Photorealistic text-to-image diffusion models with deep language understanding , author=. Advances in Neural Information Processing Systems , volume=

  16. [24]

    arXiv preprint arXiv:2305.18295 , year=

    Raphael: Text-to-image generation via large mixture of diffusion paths , author=. arXiv preprint arXiv:2305.18295 , year=

    arXiv

  17. [25]

    arXiv preprint arXiv:2112.10741 , year=

    Glide: Towards photorealistic image generation and editing with text-guided diffusion models , author=. arXiv preprint arXiv:2112.10741 , year=

    arXiv

  18. [26]

    arXiv preprint arXiv:2307.01952 , year=

    Sdxl: Improving latent diffusion models for high-resolution image synthesis , author=. arXiv preprint arXiv:2307.01952 , year=

    arXiv

  19. [27]

    arXiv preprint arXiv:2310.00426 , year=

    PixArt: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis , author=. arXiv preprint arXiv:2310.00426 , year=

    arXiv

  20. [28]

    arXiv preprint arXiv:2312.04557 , year=

    GenTron: Delving Deep into Diffusion Transformers for Image and Video Generation , author=. arXiv preprint arXiv:2312.04557 , year=

    arXiv

  21. [29]

    2024 , eprint=

    Scaling Rectified Flow Transformers for High-Resolution Image Synthesis , author=. 2024 , eprint=

    2024

  22. [30]

    arXiv preprint arXiv:2303.01469 , year=

    Consistency models , author=. arXiv preprint arXiv:2303.01469 , year=

    arXiv

  23. [31]

    Computer Science

    Improving image generation with better captions , author=. Computer Science. https://cdn. openai. com/papers/dall-e-3. pdf , volume=

  24. [32]

    5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generation , author=

    Playground v2. 5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generation , author=. arXiv preprint arXiv:2402.17245 , year=

    arXiv

  25. [33]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Maskgit: Masked generative image transformer , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  26. [34]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Mage: Masked generative encoder to unify representation learning and image synthesis , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  27. [35]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Magvit: Masked generative video transformer , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  28. [36]

    Advances in Neural Information Processing Systems , volume=

    Movq: Modulating quantized vectors for high-fidelity image generation , author=. Advances in Neural Information Processing Systems , volume=

  29. [37]

    arXiv preprint arXiv:2309.15505 , year=

    Finite scalar quantization: Vq-vae made simple , author=. arXiv preprint arXiv:2309.15505 , year=

    arXiv

  30. [38]

    arXiv preprint arXiv:2310.05737 , year=

    Language Model Beats Diffusion--Tokenizer is Key to Visual Generation , author=. arXiv preprint arXiv:2310.05737 , year=

    arXiv

  31. [39]

    International Conference on Learning Representations , year=

    Phenaki: Variable length video generation from open domain textual descriptions , author=. International Conference on Learning Representations , year=

  32. [40]

    arXiv preprint arXiv:2301.00704 , year=

    Muse: Text-to-image generation via masked generative transformers , author=. arXiv preprint arXiv:2301.00704 , year=

    arXiv

  33. [41]

    arXiv preprint arXiv:2404.02905 , year=

    Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction , author=. arXiv preprint arXiv:2404.02905 , year=

    arXiv

  34. [42]

    Advances in neural information processing systems , volume=

    Generative adversarial nets , author=. Advances in neural information processing systems , volume=

  35. [43]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Image-to-image translation with conditional adversarial networks , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  36. [44]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    A style-based generator architecture for generative adversarial networks , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  37. [45]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Analyzing and improving the image quality of stylegan , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  38. [46]

    Advances in Neural Information Processing Systems , volume=

    Alias-free generative adversarial networks , author=. Advances in Neural Information Processing Systems , volume=

  39. [47]

    ACM SIGGRAPH 2022 conference proceedings , pages=

    Stylegan-xl: Scaling stylegan to large diverse datasets , author=. ACM SIGGRAPH 2022 conference proceedings , pages=

    2022

  40. [48]

    arXiv preprint arXiv:2301.09515 , year=

    Stylegan-t: Unlocking the power of gans for fast large-scale text-to-image synthesis , author=. arXiv preprint arXiv:2301.09515 , year=

    arXiv

  41. [49]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Scaling up gans for text-to-image synthesis , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  42. [50]

    Proceedings of the IEEE international conference on computer vision , pages=

    Unpaired image-to-image translation using cycle-consistent adversarial networks , author=. Proceedings of the IEEE international conference on computer vision , pages=

  43. [51]

    arXiv preprint arXiv:1809.11096 , year=

    Large scale GAN training for high fidelity natural image synthesis , author=. arXiv preprint arXiv:1809.11096 , year=

    arXiv

  44. [52]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    The unreasonable effectiveness of deep features as a perceptual metric , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  45. [53]

    Advances in neural information processing systems , volume=

    Gans trained by a two time-scale update rule converge to a local nash equilibrium , author=. Advances in neural information processing systems , volume=

  46. [54]

    Advances in neural information processing systems , volume=

    Improved techniques for training gans , author=. Advances in neural information processing systems , volume=

  47. [55]

    arXiv preprint arXiv:2103.03841 , year=

    Generating images with sparse representations , author=. arXiv preprint arXiv:2103.03841 , year=

    arXiv

  48. [56]

    Advances in neural information processing systems , volume=

    Improved precision and recall metric for assessing generative models , author=. Advances in neural information processing systems , volume=

  49. [57]

    Advances in neural information processing systems , volume=

    Attention is all you need , author=. Advances in neural information processing systems , volume=

  50. [58]

    arXiv preprint arXiv:1810.04805 , year=

    Bert: Pre-training of deep bidirectional transformers for language understanding , author=. arXiv preprint arXiv:1810.04805 , year=

    arXiv

  51. [59]

    The Journal of Machine Learning Research , volume=

    Exploring the limits of transfer learning with a unified text-to-text transformer , author=. The Journal of Machine Learning Research , volume=. 2020 , publisher=

    2020

  52. [60]

    article , year=

    Improving language understanding by generative pre-training , author=. article , year=

  53. [61]

    OpenAI blog , volume=

    Language models are unsupervised multitask learners , author=. OpenAI blog , volume=

  54. [62]

    Advances in neural information processing systems , volume=

    Language models are few-shot learners , author=. Advances in neural information processing systems , volume=

  55. [63]

    Advances in Neural Information Processing Systems , volume=

    Training language models to follow instructions with human feedback , author=. Advances in Neural Information Processing Systems , volume=

  56. [64]

    arXiv preprint arXiv:2303.08774 , year=

    Gpt-4 technical report , author=. arXiv preprint arXiv:2303.08774 , year=

    arXiv

  57. [65]

    GPT-4V(ision) system card , author =

  58. [66]

    International conference on machine learning , pages=

    Generative pretraining from pixels , author=. International conference on machine learning , pages=. 2020 , organization=

    2020

  59. [67]

    2022 , howpublished =

    OpenAI , title =. 2022 , howpublished =

    2022

  60. [68]

    2023 , howpublished =

    Google , title =. 2023 , howpublished =

    2023

  61. [69]

    2023 , howpublished =

    Anthropic , title =. 2023 , howpublished =

    2023

  62. [70]

    arXiv preprint arXiv:2302.13971 , year=

    Llama: Open and efficient foundation language models , author=. arXiv preprint arXiv:2302.13971 , year=

    arXiv

  63. [71]

    arXiv preprint arXiv:2307.09288 , year=

    Llama 2: Open foundation and fine-tuned chat models , author=. arXiv preprint arXiv:2307.09288 , year=

    arXiv

  64. [72]

    arXiv preprint arXiv:2203.15556 , year=

    Training compute-optimal large language models , author=. arXiv preprint arXiv:2203.15556 , year=

    arXiv

  65. [73]

    Journal of Machine Learning Research , volume=

    Palm: Scaling language modeling with pathways , author=. Journal of Machine Learning Research , volume=

  66. [74]

    arXiv preprint arXiv:2305.10403 , year=

    Palm 2 technical report , author=. arXiv preprint arXiv:2305.10403 , year=

    arXiv

  67. [75]

    arXiv preprint arXiv:2211.05100 , year=

    Bloom: A 176b-parameter open-access multilingual language model , author=. arXiv preprint arXiv:2211.05100 , year=

    arXiv

  68. [76]

    arXiv preprint arXiv:2205.01068 , year=

    Opt: Open pre-trained transformer language models , author=. arXiv preprint arXiv:2205.01068 , year=

    arXiv

  69. [77]

    arXiv preprint arXiv:2309.16609 , year=

    Qwen technical report , author=. arXiv preprint arXiv:2309.16609 , year=

    arXiv

  70. [78]

    arXiv preprint arXiv:2309.10305 , year=

    Baichuan 2: Open large-scale language models , author=. arXiv preprint arXiv:2309.10305 , year=

    arXiv

  71. [79]

    2023-01-06)[2023-09-27]

    Internlm: A multilingual language model with progressively enhanced capabilities , author=. 2023-01-06)[2023-09-27]. https://github. com/InternLM/InternLM , year=

    2023

  72. [80]

    arXiv preprint arXiv:2401.02954 , year=

    Deepseek llm: Scaling open-source language models with longtermism , author=. arXiv preprint arXiv:2401.02954 , year=

    arXiv

  73. [81]

    arXiv preprint arXiv:2001.08361 , year=

    Scaling laws for neural language models , author=. arXiv preprint arXiv:2001.08361 , year=

    2001 arXiv

  74. [82]

    arXiv preprint arXiv:2010.14701 , year=

    Scaling laws for autoregressive generative modeling , author=. arXiv preprint arXiv:2010.14701 , year=

    2010 arXiv

  75. [83]

    arXiv preprint arXiv:1712.00409 , year=

    Deep learning scaling is predictable, empirically , author=. arXiv preprint arXiv:1712.00409 , year=

    arXiv

  76. [84]

    arXiv preprint arXiv:2206.07682 , year=

    Emergent abilities of large language models , author=. arXiv preprint arXiv:2206.07682 , year=

    arXiv

  77. [85]

    C Users Journal , volume=

    A new algorithm for data compression , author=. C Users Journal , volume=. 1994 , publisher=

    1994

  78. [86]

    Advances in Neural Information Processing Systems , volume=

    Revisiting neural scaling laws in language and vision , author=. Advances in Neural Information Processing Systems , volume=

  79. [87]

    2009 IEEE conference on computer vision and pattern recognition , pages=

    Imagenet: A large-scale hierarchical image database , author=. 2009 IEEE conference on computer vision and pattern recognition , pages=. 2009 , organization=

    2009

  80. [88]

    International Journal of Computer Vision , volume=

    The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale , author=. International Journal of Computer Vision , volume=. 2020 , publisher=

    2020

  81. [89]

    arXiv preprint arXiv:2312.00785 , year=

    Sequential modeling enables scalable learning for large vision models , author=. arXiv preprint arXiv:2312.00785 , year=

    arXiv

  82. [90]

    arXiv preprint arXiv:2303.11331 , year=

    Eva-02: A visual representation for neon genesis , author=. arXiv preprint arXiv:2303.11331 , year=

    arXiv

  83. [91]

    arXiv preprint arXiv:2206.08916 , year=

    Unified-io: A unified model for vision, language, and multi-modal tasks , author=. arXiv preprint arXiv:2206.08916 , year=

    arXiv

  84. [92]

    arXiv preprint arXiv:2312.17172 , year=

    Unified-io 2: Scaling autoregressive multimodal models with vision, language, audio, and action , author=. arXiv preprint arXiv:2312.17172 , year=

    arXiv

  85. [93]

    arXiv preprint arXiv:2010.11929 , year=

    An image is worth 16x16 words: Transformers for image recognition at scale , author=. arXiv preprint arXiv:2010.11929 , year=

    2010 arXiv

  86. [94]

    International conference on machine learning , pages=

    Learning transferable visual models from natural language supervision , author=. International conference on machine learning , pages=. 2021 , organization=

    2021

  87. [95]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Masked autoencoders are scalable vision learners , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  88. [96]

    arXiv preprint arXiv:2106.08254 , year=

    Beit: Bert pre-training of image transformers , author=. arXiv preprint arXiv:2106.08254 , year=

    arXiv

  89. [97]

    arXiv preprint arXiv:2108.07258 , year=

    On the opportunities and risks of foundation models , author=. arXiv preprint arXiv:2108.07258 , year=

    arXiv

  90. [98]

    arXiv preprint arXiv:2304.02643 , year=

    Segment anything , author=. arXiv preprint arXiv:2304.02643 , year=

    arXiv

  91. [99]

    arXiv preprint arXiv:2304.07193 , year=

    Dinov2: Learning robust visual features without supervision , author=. arXiv preprint arXiv:2304.07193 , year=

    arXiv

  92. [100]

    2024 , journal=

    Video generation models as world simulators , author=. 2024 , journal=

    2024

  93. [101]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Feature pyramid networks for object detection , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  94. [102]

    Advances in neural information processing systems , volume=

    Visual instruction tuning , author=. Advances in neural information processing systems , volume=

  95. [103]

    International conference on machine learning , pages=

    Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation , author=. International conference on machine learning , pages=. 2022 , organization=

    2022

  96. [104]

    arXiv preprint arXiv:2405.09818 , year=

    Chameleon: Mixed-Modal Early-Fusion Foundation Models , author=. arXiv preprint arXiv:2405.09818 , year=

    arXiv

  97. [105]

    arXiv preprint arXiv:2307.05222 , year=

    Generative pretraining in multimodality , author=. arXiv preprint arXiv:2307.05222 , year=

    arXiv

  98. [106]

    arXiv preprint arXiv:2312.11805 , year=

    Gemini: a family of highly capable multimodal models , author=. arXiv preprint arXiv:2312.11805 , year=

    arXiv

  99. [107]

    Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 , pages=

    Pytorch 2: Faster machine learning through dynamic python bytecode transformation and graph compilation , author=. Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 , pages=

  100. [108]

    Advances in Neural Information Processing Systems , volume=

    Flashattention: Fast and memory-efficient exact attention with io-awareness , author=. Advances in Neural Information Processing Systems , volume=

  101. [109]

    Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining , pages=

    Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters , author=. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining , pages=

  102. [110]

    arXiv preprint arXiv:1909.08053 , year=

    Megatron-lm: Training multi-billion parameter language models using model parallelism , author=. arXiv preprint arXiv:1909.08053 , year=

    1909 arXiv

  103. [111]

    Advances in Neural Information Processing Systems , volume=

    Root mean square layer normalization , author=. Advances in Neural Information Processing Systems , volume=

  104. [112]

    arXiv preprint arXiv:2002.05202 , year=

    Glu variants improve transformer , author=. arXiv preprint arXiv:2002.05202 , year=

    2002 arXiv

  105. [113]

    Neurocomputing , volume=

    Roformer: Enhanced transformer with rotary position embedding , author=. Neurocomputing , volume=. 2024 , publisher=

    2024

  106. [114]

    arXiv preprint arXiv:2304.11277 , year=

    Pytorch fsdp: experiences on scaling fully sharded data parallel , author=. arXiv preprint arXiv:2304.11277 , year=

    arXiv

  107. [115]

    Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles , year=

    Efficient Memory Management for Large Language Model Serving with PagedAttention , author=. Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles , year=

  108. [116]

    arXiv preprint arXiv:2302.01318 , year=

    Accelerating large language model decoding with speculative sampling , author=. arXiv preprint arXiv:2302.01318 , year=

    arXiv

  109. [117]

    2022 , howpublished =

    Tim Dettmers , title =. 2022 , howpublished =

    2022

  110. [118]

    2024 , howpublished =

    Alpha-VLLM , title =. 2024 , howpublished =

    2024

  111. [119]

    2023 , howpublished =

    OpenLM-Research , title =. 2023 , howpublished =

    2023

  112. [120]

    Journal of Machine Learning Research , volume=

    Scaling instruction-finetuned language models , author=. Journal of Machine Learning Research , volume=

  113. [121]

    2022 , howpublished =

    LAION , title =. 2022 , howpublished =

    2022

  114. [122]

    Computer Vision--ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13 , pages=

    Microsoft coco: Common objects in context , author=. Computer Vision--ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13 , pages=. 2014 , organization=

    2014

  115. [123]

    2023 , eprint=

    MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models , author=. 2023 , eprint=

    2023

  116. [124]

    Advances in Neural Information Processing Systems , volume=

    Instructblip: Towards general-purpose vision-language models with instruction tuning , author=. Advances in Neural Information Processing Systems , volume=

  117. [125]

    arXiv preprint arXiv:2306.14824 , year=

    Kosmos-2: Grounding multimodal large language models to the world , author=. arXiv preprint arXiv:2306.14824 , year=

    arXiv

  118. [126]

    arXiv preprint arXiv:2307.03601 , year=

    Gpt4roi: Instruction tuning large language model on region-of-interest , author=. arXiv preprint arXiv:2307.03601 , year=

    arXiv

  119. [127]

    arXiv preprint arXiv:2404.13013 , year=

    Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models , author=. arXiv preprint arXiv:2404.13013 , year=

    arXiv

  120. [128]

    The Twelfth International Conference on Learning Representations , year =

    Dong, Runpei and Han, Chunrui and Peng, Yuang and Qi, Zekun and Ge, Zheng and Yang, Jinrong and Zhao, Liang and Sun, Jianjian and Zhou, Hongyu and Wei, Haoran and Kong, Xiangwen and Zhang, Xiangyu and Ma, Kaisheng and Yi, Li , title =. The Twelfth International Conference on L...

  121. [129]

    arXiv preprint arXiv:2406.16855 , year=

    Dreambench++: A human-aligned benchmark for personalized image generation , author=. arXiv preprint arXiv:2406.16855 , year=

    arXiv

  122. [130]

    arXiv preprint arXiv:2310.01218 , year=

    Making llama see and draw with seed tokenizer , author=. arXiv preprint arXiv:2310.01218 , year=

    arXiv

  123. [131]

    arXiv preprint arXiv:2402.03310 , year=

    V-irl: Grounding virtual intelligence in real life , author=. arXiv preprint arXiv:2402.03310 , year=

    arXiv

  124. [132]

    arXiv preprint arXiv:2308.00352 , year=

    Metagpt: Meta programming for multi-agent collaborative framework , author=. arXiv preprint arXiv:2308.00352 , year=

    arXiv

  125. [133]

    Advances in Neural Information Processing Systems , volume=

    Camel: Communicative agents for" mind" exploration of large language model society , author=. Advances in Neural Information Processing Systems , volume=

  126. [134]

    arXiv preprint arXiv:2307.15818 , year=

    Rt-2: Vision-language-action models transfer web knowledge to robotic control , author=. arXiv preprint arXiv:2307.15818 , year=

    arXiv

  127. [135]

    arXiv preprint arXiv:2212.06817 , year=

    Rt-1: Robotics transformer for real-world control at scale , author=. arXiv preprint arXiv:2212.06817 , year=

    arXiv

  128. [136]

    arXiv preprint arXiv:2307.09474 , year=

    Chatspot: Bootstrapping multimodal llms via precise referring instruction tuning , author=. arXiv preprint arXiv:2307.09474 , year=

    arXiv

  129. [137]

    arXiv preprint arXiv:2310.01412 , year=

    Drivegpt4: Interpretable end-to-end autonomous driving via large language model , author=. arXiv preprint arXiv:2310.01412 , year=

    arXiv

  130. [138]

    2024 , eprint=

    LLaVA-OneVision: Easy Visual Task Transfer , author=. 2024 , eprint=

    2024

  131. [139]

    arXiv preprint arXiv:2310.01415 , year=

    Gpt-driver: Learning to drive with gpt , author=. arXiv preprint arXiv:2310.01415 , year=

    arXiv

  132. [140]

    2025 , eprint=

    SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models , author=. 2025 , eprint=

    2025

  133. [141]

    arXiv preprint arXiv:2403.15377 , year=

    Internvideo2: Scaling video foundation models for multimodal video understanding , author=. arXiv preprint arXiv:2403.15377 , year=

    arXiv

  134. [142]

    LLaVA-NeXT: A Strong Zero-shot Video Understanding Model , url=

    Zhang, Yuanhan and Li, Bo and Liu, haotian and Lee, Yong jae and Gui, Liangke and Fu, Di and Feng, Jiashi and Liu, Ziwei and Li, Chunyuan , month=. LLaVA-NeXT: A Strong Zero-shot Video Understanding Model , url=

  135. [143]

    2025 , eprint=

    Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence , author=. 2025 , eprint=

    2025

  136. [144]

    arXiv preprint arXiv:2404.16994 , year=

    Pllava: Parameter-free llava extension from images to videos for video dense captioning , author=. arXiv preprint arXiv:2404.16994 , year=

    arXiv

  137. [145]

    arXiv preprint arXiv:2306.02858 , year=

    Video-llama: An instruction-tuned audio-visual language model for video understanding , author=. arXiv preprint arXiv:2306.02858 , year=

    arXiv

  138. [146]

    arXiv preprint arXiv:2406.07476 , year=

    VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs , author=. arXiv preprint arXiv:2406.07476 , year=

    arXiv

  139. [147]

    Advances in neural information processing systems , volume=

    Videomae: Masked autoencoders are data-efficient learners for self-supervised video pre-training , author=. Advances in neural information processing systems , volume=

  140. [148]

    Advances in neural information processing systems , volume=

    Masked autoencoders as spatiotemporal learners , author=. Advances in neural information processing systems , volume=

  141. [149]

    and Barto, Andrew G

    Sutton, Richard S. and Barto, Andrew G. , year =

  142. [150]

    Advances in Neural Information Processing Systems , volume=

    Defining and characterizing reward gaming , author=. Advances in Neural Information Processing Systems , volume=

  143. [151]

    Applied Intelligence , volume=

    A novel multi-step reinforcement learning method for solving reward hacking , author=. Applied Intelligence , volume=. 2019 , publisher=

    2019

  144. [152]

    arXiv preprint arXiv:2312.00589 , year=

    Merlin: Empowering multimodal llms with foresight minds , author=. arXiv preprint arXiv:2312.00589 , year=

    arXiv

  145. [153]

    arXiv preprint arXiv:2401.00849 , year=

    COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training , author=. arXiv preprint arXiv:2401.00849 , year=

    arXiv

  146. [154]

    arXiv preprint arXiv:2307.06942 , year=

    Internvid: A large-scale video-text dataset for multimodal understanding and generation , author=. arXiv preprint arXiv:2307.06942 , year=

    arXiv

  147. [155]

    arXiv preprint arXiv:2306.09085 , year=

    Cosa: Concatenated sample pretrained vision-language foundation model , author=. arXiv preprint arXiv:2306.09085 , year=

    arXiv

  148. [156]

    arXiv preprint arXiv:2407.07577 , year=

    IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model , author=. arXiv preprint arXiv:2407.07577 , year=

    arXiv

  149. [157]

    arXiv preprint arXiv:2212.00280 , year=

    Grit: A generative region-to-text transformer for object understanding , author=. arXiv preprint arXiv:2212.00280 , year=

    arXiv

  150. [158]

    arXiv preprint arXiv:2303.05499 , year=

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection , author=. arXiv preprint arXiv:2303.05499 , year=

    arXiv

  151. [159]

    European conference on computer vision , pages=

    Bytetrack: Multi-object tracking by associating every detection box , author=. European conference on computer vision , pages=. 2022 , organization=

    2022

  152. [160]

    Philosophical Transactions of the Royal Society of London

    The persistences of vision , author=. Philosophical Transactions of the Royal Society of London. B, Biological Sciences , volume=. 1980 , publisher=

    1980

  153. [161]

    arXiv preprint arXiv:2407.10671 , year=

    Qwen2 technical report , author=. arXiv preprint arXiv:2407.10671 , year=

    arXiv

  154. [162]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Sigmoid loss for language image pre-training , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  155. [163]

    arXiv preprint arXiv:2407.12772 , year=

    LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models , author=. arXiv preprint arXiv:2407.12772 , year=

    arXiv

  156. [164]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    Howto100m: Learning a text-video embedding by watching hundred million narrated video clips , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  157. [165]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    MeViS: A large-scale benchmark for video segmentation with motion expressions , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  158. [166]

    arXiv preprint arXiv:2406.08324 , year=

    LaMOT: Language-Guided Multi-Object Tracking , author=. arXiv preprint arXiv:2406.08324 , year=

    arXiv

  159. [167]

    arXiv preprint arXiv:2407.00634 , year=

    Tarsier: Recipes for Training and Evaluating Large Video Description Models , author=. arXiv preprint arXiv:2407.00634 , year=

    arXiv

  160. [168]

    arXiv preprint arXiv:2401.12503 , year=

    Small language model meets with reinforced vision vocabulary , author=. arXiv preprint arXiv:2401.12503 , year=

    arXiv

  161. [169]

    (No Title) , year=

    Monetary theory and practice: The UK experience , author=. (No Title) , year=

  162. [170]

    arXiv preprint arXiv:1811.07871 , year=

    Scalable agent alignment via reward modeling: a research direction , author=. arXiv preprint arXiv:1811.07871 , year=

    arXiv

  163. [171]

    arXiv preprint arXiv:1711.09883 , year=

    AI safety gridworlds , author=. arXiv preprint arXiv:1711.09883 , year=

    arXiv

  164. [172]

    Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society , pages=

    Reward reports for reinforcement learning , author=. Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society , pages=

    2023

  165. [173]

    Specification gaming: the flip side of AI ingenuity , author=

  166. [174]

    arXiv preprint arXiv:2201.03544 , year=

    The effects of reward misspecification: Mapping and mitigating misaligned models , author=. arXiv preprint arXiv:2201.03544 , year=

    arXiv

  167. [175]

    arXiv preprint arXiv:2403.03185 , year=

    Preventing reward hacking with occupancy measure regularization , author=. arXiv preprint arXiv:2403.03185 , year=

    arXiv

  168. [176]

    arXiv preprint arXiv:2305.06355 , year=

    Videochat: Chat-centric video understanding , author=. arXiv preprint arXiv:2305.06355 , year=

    arXiv

  169. [177]

    arXiv preprint arXiv:2306.05424 , year=

    Video-chatgpt: Towards detailed video understanding via large vision and language models , author=. arXiv preprint arXiv:2306.05424 , year=

    arXiv

  170. [178]

    arXiv preprint arXiv:2311.10122 , year=

    Video-llava: Learning united visual representation by alignment before projection , author=. arXiv preprint arXiv:2311.10122 , year=

    arXiv

  171. [179]

    arXiv preprint arXiv:2408.03326 , year=

    Llava-onevision: Easy visual task transfer , author=. arXiv preprint arXiv:2408.03326 , year=

    arXiv

  172. [180]

    arXiv preprint arXiv:2308.12966 , year=

    Qwen-vl: A frontier large vision-language model with versatile abilities , author=. arXiv preprint arXiv:2308.12966 , year=

    arXiv

  173. [181]

    arXiv preprint arXiv:2409.12191 , year=

    Qwen2-vl: Enhancing vision-language model's perception of the world at any resolution , author=. arXiv preprint arXiv:2409.12191 , year=

    arXiv

  174. [182]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Improved baselines with visual instruction tuning , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  175. [183]

    arXiv preprint arXiv:2311.12793 , year=

    Sharegpt4v: Improving large multi-modal models with better captions , author=. arXiv preprint arXiv:2311.12793 , year=

    arXiv

  176. [184]

    arXiv preprint arXiv:2309.07915 , year=

    Mmicl: Empowering vision-language model with multi-modal in-context learning , author=. arXiv preprint arXiv:2309.07915 , year=

    arXiv

  177. [185]

    arXiv preprint arXiv:2401.16420 , year=

    Internlm-xcomposer2: Mastering free-form text-image composition and comprehension in vision-language large model , author=. arXiv preprint arXiv:2401.16420 , year=

    arXiv

  178. [186]

    Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval

    Max Bain and Arsha Nagrani and G \"u l Varol and Andrew Zisserman. Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval. IEEE International Conference on Computer Vision. 2021

    2021

  179. [187]

    arXiv preprint arXiv:2402.00530 , year=

    Superfiltering: Weak-to-strong data filtering for fast instruction-tuning , author=. arXiv preprint arXiv:2402.00530 , year=

    arXiv

  180. [188]

    arXiv preprint arXiv:2311.17043 , year=

    Llama-vid: An image is worth 2 tokens in large language models , author=. arXiv preprint arXiv:2311.17043 , year=

    arXiv

  181. [189]

    Pattern Recognition , volume=

    A large cross-modal video retrieval dataset with reading comprehension , author=. Pattern Recognition , volume=. 2025 , publisher=

    2025

  182. [190]

    Proceedings of the AAAI Conference on Artificial Intelligence , volume=

    Towards automatic learning of procedures from web instructional videos , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=

  183. [191]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Mvbench: A comprehensive multi-modal video understanding benchmark , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  184. [192]

    arXiv preprint arXiv:2403.00476 , year=

    TempCompass: Do Video LLMs Really Understand Videos? , author=. arXiv preprint arXiv:2403.00476 , year=

    arXiv

  185. [193]

    arXiv preprint arXiv:2405.21075 , year=

    Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis , author=. arXiv preprint arXiv:2405.21075 , year=

    arXiv

  186. [194]

    Proceedings of the 25th ACM international conference on Multimedia , pages=

    Video question answering via gradually refined attention over appearance and motion , author=. Proceedings of the 25th ACM international conference on Multimedia , pages=

  187. [195]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Tgif-qa: Toward spatio-temporal reasoning in visual question answering , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  188. [196]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Msr-vtt: A large video description dataset for bridging video and language , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  189. [197]

    Proceedings of the ieee conference on computer vision and pattern recognition , pages=

    Activitynet: A large-scale video benchmark for human activity understanding , author=. Proceedings of the ieee conference on computer vision and pattern recognition , pages=

  190. [198]

    arXiv preprint arXiv:2308.02490 , year=

    Mm-vet: Evaluating large multimodal models for integrated capabilities , author=. arXiv preprint arXiv:2308.02490 , year=

    arXiv

  191. [199]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Mmmu: A massive multi-discipline multimodal understanding and reasoning benchmark for expert agi , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  192. [200]

    arXiv preprint arXiv:2307.06281 , year=

    Mmbench: Is your multi-modal model an all-around player? , author=. arXiv preprint arXiv:2307.06281 , year=

    arXiv

  193. [201]

    arXiv preprint arXiv:2306.13394 , year=

    MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models , author=. arXiv preprint arXiv:2306.13394 , year=

    arXiv

  194. [202]

    arXiv preprint arXiv:2305.10355 , year=

    Evaluating object hallucination in large vision-language models , author=. arXiv preprint arXiv:2305.10355 , year=

    arXiv

  195. [203]

    Computer Vision--ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11--14, 2016, Proceedings, Part IV 14 , pages=

    A diagram is worth a dozen images , author=. Computer Vision--ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11--14, 2016, Proceedings, Part IV 14 , pages=. 2016 , organization=

    2016

  196. [204]

    Faulty Reward Functions in the Wild , url =

    Jack, Clark and Dario, Amodei , year =. Faulty Reward Functions in the Wild , url =

  197. [205]

    International conference on machine learning , pages=

    Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models , author=. International conference on machine learning , pages=. 2023 , organization=

    2023

  198. [206]

    arXiv preprint arXiv:2304.14178 , year=

    mplug-owl: Modularization empowers large language models with multimodality , author=. arXiv preprint arXiv:2304.14178 , year=

    arXiv

  199. [207]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Eyes wide shut? exploring the visual shortcomings of multimodal llms , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  200. [208]

    The Twelfth International Conference on Learning Representations , year=

    Mitigating hallucination in large multi-modal models via robust instruction tuning , author=. The Twelfth International Conference on Learning Representations , year=

  201. [209]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Mitigating object hallucinations in large vision-language models through visual contrastive decoding , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  202. [210]

    Proceedings of the 32nd ACM International Conference on Multimedia , pages=

    Self-supervised visual preference alignment , author=. Proceedings of the 32nd ACM International Conference on Multimedia , pages=

  203. [211]

    Advances in neural information processing systems , volume=

    Training language models to follow instructions with human feedback , author=. Advances in neural information processing systems , volume=

  204. [212]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Rlhf-v: Towards trustworthy mllms via behavior alignment from fine-grained correctional human feedback , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  205. [213]

    Advances in neural information processing systems , volume=

    Chain-of-thought prompting elicits reasoning in large language models , author=. Advances in neural information processing systems , volume=

  206. [214]

    arXiv preprint arXiv:2308.00436 , year=

    Selfcheck: Using llms to zero-shot check their own step-by-step reasoning , author=. arXiv preprint arXiv:2308.00436 , year=

    arXiv

  207. [215]

    Advances in Neural Information Processing Systems , volume=

    Reflexion: Language agents with verbal reinforcement learning , author=. Advances in Neural Information Processing Systems , volume=

  208. [216]

    arXiv preprint arXiv:2210.03629 , year=

    React: Synergizing reasoning and acting in language models , author=. arXiv preprint arXiv:2210.03629 , year=

    arXiv

  209. [217]

    arXiv preprint arXiv:2406.02378 , year=

    On the Intrinsic Self-Correction Capability of LLMs: Uncertainty and Latent Concept , author=. arXiv preprint arXiv:2406.02378 , year=

    arXiv

  210. [218]

    arXiv preprint arXiv:2407.18219 , year=

    Recursive introspection: Teaching language model agents how to self-improve , author=. arXiv preprint arXiv:2407.18219 , year=

    arXiv

  211. [219]

    arXiv preprint arXiv:2409.12917 , year=

    Training language models to self-correct via reinforcement learning , author=. arXiv preprint arXiv:2409.12917 , year=

    arXiv

  212. [220]

    arXiv preprint arXiv:2306.15195 , year=

    Shikra: Unleashing multimodal llm's referential dialogue magic , author=. arXiv preprint arXiv:2306.15195 , year=

    arXiv

  213. [221]

    arXiv preprint arXiv:2403.16999 , year=

    Visual cot: Unleashing chain-of-thought reasoning in multi-modal language models , author=. arXiv preprint arXiv:2403.16999 , year=

    arXiv

  214. [222]

    arXiv preprint arXiv:2302.00923 , year=

    Multimodal chain-of-thought reasoning in language models , author=. arXiv preprint arXiv:2302.00923 , year=

    arXiv

  215. [223]

    arXiv preprint arXiv:2403.11236 , year=

    ChartThinker: A Contextual Chain-of-Thought Approach to Optimized Chart Summarization , author=. arXiv preprint arXiv:2403.11236 , year=

    arXiv

  216. [224]

    arXiv preprint arXiv:2402.14767 , year=

    DualFocus: Integrating Macro and Micro Perspectives in Multi-modal Large Language Models , author=. arXiv preprint arXiv:2402.14767 , year=

    arXiv

  217. [225]

    Wu, Penghao and Xie, Saining , booktitle=

  218. [226]

    arXiv preprint arXiv:2311.07362 , year=

    Volcano: mitigating multimodal hallucination through self-feedback guided revision , author=. arXiv preprint arXiv:2311.07362 , year=

    arXiv

  219. [227]

    arXiv preprint arXiv:2404.06510 , year=

    Can Feedback Enhance Semantic Grounding in Large Vision-Language Models? , author=. arXiv preprint arXiv:2404.06510 , year=

    arXiv

  220. [228]

    International conference on machine learning , pages=

    On calibration of modern neural networks , author=. International conference on machine learning , pages=. 2017 , organization=

    2017

  221. [229]

    arXiv preprint arXiv:2402.04788 , year=

    MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark , author=. arXiv preprint arXiv:2402.04788 , year=

    arXiv

  222. [230]

    Advances in Neural Information Processing Systems , volume=

    Direct preference optimization: Your language model is secretly a reward model , author=. Advances in Neural Information Processing Systems , volume=

  223. [231]

    arXiv preprint arXiv:2402.01878 , year=

    Lipo: Listwise preference optimization through learning-to-rank , author=. arXiv preprint arXiv:2402.01878 , year=

    arXiv

  224. [232]

    arXiv preprint arXiv:2406.16860 , year=

    Cambrian-1: A fully open, vision-centric exploration of multimodal llms , author=. arXiv preprint arXiv:2406.16860 , year=

    arXiv

  225. [233]

    arXiv preprint arXiv:2406.08418 , year=

    OmniCorpus: An Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text , author=. arXiv preprint arXiv:2406.08418 , year=

    arXiv

  226. [234]

    Proceedings of the fourteenth international conference on artificial intelligence and statistics , pages=

    A reduction of imitation learning and structured prediction to no-regret online learning , author=. Proceedings of the fourteenth international conference on artificial intelligence and statistics , pages=. 2011 , organization=

    2011

  227. [235]

    International Conference on Machine Learning , pages=

    Inverse reinforcement learning without reinforcement learning , author=. International Conference on Machine Learning , pages=. 2023 , organization=

    2023

  228. [236]

    2025 , eprint=

    SpaceR: Reinforcing MLLMs in Video Spatial Reasoning , author=. 2025 , eprint=

    2025

  229. [237]

    2025 , eprint=

    Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing , author=. 2025 , eprint=

    2025

  230. [238]

    2025 , eprint=

    Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Tasks , author=. 2025 , eprint=

    2025

  231. [239]

    arXiv preprint arXiv:2405.08448 , year=

    Understanding the performance gap between online and offline alignment algorithms , author=. arXiv preprint arXiv:2405.08448 , year=

    arXiv

  232. [240]

    Proceedings of the 24th international conference on Machine learning , pages=

    Reinforcement learning by reward-weighted regression for operational space control , author=. Proceedings of the 24th international conference on Machine learning , pages=

  233. [241]

    arXiv preprint arXiv:2403.09629 , year=

    Quiet-star: Language models can teach themselves to think before speaking , author=. arXiv preprint arXiv:2403.09629 , year=

    arXiv

  234. [242]

    arXiv preprint arXiv:1908.04319 , year=

    Neural text generation with unlikelihood training , author=. arXiv preprint arXiv:1908.04319 , year=

    1908 arXiv

  235. [243]

    arXiv preprint arXiv:2408.15240 , year=

    Generative verifiers: Reward modeling as next-token prediction , author=. arXiv preprint arXiv:2408.15240 , year=

    arXiv

  236. [244]

    arXiv preprint arXiv:2410.02712 , year=

    LLaVA-Critic: Learning to Evaluate Multimodal Models , author=. arXiv preprint arXiv:2410.02712 , year=

    arXiv

  237. [245]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Opera: Alleviating hallucination in multi-modal large language models via over-trust penalty and retrospection-allocation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  238. [246]

    arXiv preprint arXiv:2405.01525 , year=

    Flame: Factuality-aware alignment for large language models , author=. arXiv preprint arXiv:2405.01525 , year=

    arXiv

  239. [247]

    arXiv preprint arXiv:2406.11839 , year=

    mDPO: Conditional Preference Optimization for Multimodal Large Language Models , author=. arXiv preprint arXiv:2406.11839 , year=

    arXiv

  240. [248]

    Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track , pages=

    RESTful-Llama: Connecting User Queries to RESTful APIs , author=. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track , pages=

    2024

  241. [249]

    LLaVA-NeXT: Improved reasoning, OCR, and world knowledge , url=

    Liu, Haotian and Li, Chunyuan and Li, Yuheng and Li, Bo and Zhang, Yuanhan and Shen, Sheng and Lee, Yong Jae , month=. LLaVA-NeXT: Improved reasoning, OCR, and world knowledge , url=

  242. [250]

    arXiv preprint arXiv:2405.19092 , year=

    Benchmarking and Improving Detail Image Caption , author=. arXiv preprint arXiv:2405.19092 , year=

    arXiv

  243. [251]

    arXiv preprint arXiv:2411.01111 , year=

    Rule based rewards for language model safety , author=. arXiv preprint arXiv:2411.01111 , year=

    arXiv

  244. [252]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Deep residual learning for image recognition , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  245. [253]

    IEEE transactions on pattern analysis and machine intelligence , volume=

    Faster R-CNN: Towards real-time object detection with region proposal networks , author=. IEEE transactions on pattern analysis and machine intelligence , volume=. 2016 , publisher=

    2016

  246. [254]

    Proceedings of the IEEE international conference on computer vision , pages=

    Mask r-cnn , author=. Proceedings of the IEEE international conference on computer vision , pages=

  247. [255]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  248. [256]

    Proceedings of the International Conference on Computer Vision (ICCV) , year=

    Emerging Properties in Self-Supervised Vision Transformers , author=. Proceedings of the International Conference on Computer Vision (ICCV) , year=

  249. [257]

    arXiv:2309.16588 , year=

    Vision Transformers Need Registers , author=. arXiv:2309.16588 , year=

    arXiv

  250. [258]

    2024 , eprint=

    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context , author=. 2024 , eprint=

    2024

  251. [259]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    HallusionBench: an advanced diagnostic suite for entangled language hallucination and visual illusion in large vision-language models , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  252. [260]

    2023 , eprint=

    Aligning Large Multimodal Models with Factually Augmented RLHF , author=. 2023 , eprint=

    2023

  253. [261]

    arXiv preprint arXiv:2306.14565 , year=

    Aligning large multi-modal model with robust instruction tuning , author=. arXiv preprint arXiv:2306.14565 , year=

    arXiv

  254. [262]

    arXiv preprint arXiv:2304.10592 , year=

    Minigpt-4: Enhancing vision-language understanding with advanced large language models , author=. arXiv preprint arXiv:2304.10592 , year=

    arXiv

  255. [263]

    Zhiqing Sun and Sheng Shen and Shengcao Cao and Haotian Liu and Chunyuan Li and Yikang Shen and Chuang Gan and Liang-Yan Gui and Yu-Xiong Wang and Yiming Yang and Kurt Keutzer and Trevor Darrell , title =

  256. [264]

    Liu, Haotian and Li, Chunyuan and Li, Yuheng and Lee, Yong Jae , title=

  257. [265]

    arXiv preprint arXiv:1504.00325 , year=

    Microsoft coco captions: Data collection and evaluation server , author=. arXiv preprint arXiv:1504.00325 , year=

    arXiv

  258. [266]

    Proceedings of the IEEE/CVF international conference on computer vision , pages=

    Nocaps: Novel object captioning at scale , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=

  259. [267]

    arXiv preprint arXiv:2402.15116 , year=

    Large multimodal agents: A survey , author=. arXiv preprint arXiv:2402.15116 , year=

    arXiv

  260. [268]

    ACM Computing Surveys , year=

    Deep learning methods for abstract visual reasoning: A survey on raven's progressive matrices , author=. ACM Computing Surveys , year=

  261. [269]

    arXiv preprint arXiv:2207.07568 , year=

    Reasoning about actions over visual and linguistic modalities: A survey , author=. arXiv preprint arXiv:2207.07568 , year=

    arXiv

  262. [270]

    arXiv preprint arXiv:2406.09246 , year=

    OpenVLA: An Open-Source Vision-Language-Action Model , author=. arXiv preprint arXiv:2406.09246 , year=

    arXiv

  263. [271]

    The Method of Paired Comparisons , author=

    Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons , author=. Biometrika , year=

  264. [272]

    Foundations and Trends

    Learning to rank for information retrieval , author=. Foundations and Trends. 2009 , publisher=

    2009

  265. [273]

    European Conference on Computer Vision , pages=

    Sharegpt4v: Improving large multi-modal models with better captions , author=. European Conference on Computer Vision , pages=. 2025 , organization=

    2025

  266. [274]

    arXiv preprint arXiv:2305.17497 , year=

    Factual: A benchmark for faithful and consistent textual scene graph parsing , author=. arXiv preprint arXiv:2305.17497 , year=

    arXiv

  267. [275]

    Communications of the ACM , volume=

    WordNet: a lexical database for English , author=. Communications of the ACM , volume=. 1995 , publisher=

    1995

  268. [276]

    arXiv preprint arXiv:2412.19437 , year=

    Deepseek-v3 technical report , author=. arXiv preprint arXiv:2412.19437 , year=

    arXiv

  269. [277]

    2025 , eprint=

    DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning , author=. 2025 , eprint=

    2025

  270. [278]

    Learning to Reason with LLMs , url =

    OpenAI , month =. Learning to Reason with LLMs , url =

  271. [279]

    OpenAI o3-mini System Card , url =

    OpenAI , year =. OpenAI o3-mini System Card , url =

  272. [280]

    2005 , publisher=

    Cognitive psychology , author=. 2005 , publisher=

    2005

  273. [281]

    arXiv preprint arXiv:2402.03300 , year=

    Deepseekmath: Pushing the limits of mathematical reasoning in open language models , author=. arXiv preprint arXiv:2402.03300 , year=

    arXiv

  274. [282]

    5: Scaling reinforcement learning with llms , author=

    Kimi k1. 5: Scaling reinforcement learning with llms , author=. arXiv preprint arXiv:2501.12599 , year=

    arXiv

  275. [283]

    Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

    Generation and comprehension of unambiguous object descriptions , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

  276. [284]

    arXiv preprint arXiv:2409.17146 , year=

    Molmo and pixmo: Open weights and open data for state-of-the-art multimodal models , author=. arXiv preprint arXiv:2409.17146 , year=

    arXiv

  277. [285]

    2025 , howpublished=

    Open-Reasoner-Zero: An Open Source Approach to Scaling Reinforcement Learning on the Base Model , author=. 2025 , howpublished=

    2025

  278. [286]

    arXiv preprint arXiv:1707.06347 , year=

    Proximal policy optimization algorithms , author=. arXiv preprint arXiv:1707.06347 , year=

    arXiv

  279. [287]

    arXiv preprint arXiv:2502.12081 , year=

    Unhackable Temporal Rewarding for Scalable Video MLLMs , author=. arXiv preprint arXiv:2502.12081 , year=

    arXiv

  280. [288]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Cogagent: A visual language model for gui agents , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  281. [289]

    arXiv preprint arXiv:2405.14295 , year=

    Focus anywhere for fine-grained multi-page document understanding , author=. arXiv preprint arXiv:2405.14295 , year=

    arXiv

  282. [290]

    arXiv preprint arXiv:2412.20631 , year=

    Slow Perception: Let's Perceive Geometric Figures Step-by-step , author=. arXiv preprint arXiv:2412.20631 , year=

    arXiv

  283. [291]

    Computer Vision--ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14 , pages=

    Modeling context in referring expressions , author=. Computer Vision--ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14 , pages=. 2016 , organization=

    2016

  284. [292]

    2024 , eprint=

    DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search , author=. 2024 , eprint=

    2024

  285. [293]

    2024 , eprint=

    Interpretable Contrastive Monte Carlo Tree Search Reasoning , author=. 2024 , eprint=

    2024

  286. [294]

    2023 , eprint=

    Let's Verify Step by Step , author=. 2023 , eprint=

    2023

  287. [295]

    arXiv preprint arXiv:2501.19393 , year=

    s1: Simple test-time scaling , author=. arXiv preprint arXiv:2501.19393 , year=

    arXiv

  288. [296]

    5-VL Technical Report , author=

    Qwen2. 5-VL Technical Report , author=. arXiv preprint arXiv:2502.13923 , year=

    arXiv

  289. [297]

    arXiv preprint arXiv:2501.17161 , year=

    Sft memorizes, rl generalizes: A comparative study of foundation model post-training , author=. arXiv preprint arXiv:2501.17161 , year=

    arXiv

  290. [298]

    arXiv preprint arXiv:2503.01785 , year=

    Visual-rft: Visual reinforcement fine-tuning , author=. arXiv preprint arXiv:2503.01785 , year=

    arXiv

  291. [299]

    arXiv preprint arXiv:2503.07365 , year=

    MM-Eureka: Exploring Visual Aha Moment with Rule-based Large-scale Reinforcement Learning , author=. arXiv preprint arXiv:2503.07365 , year=

    arXiv

  292. [300]

    Chen, Liang and Li, Lei and Zhao, Haozhe and Song, Yifan and Vinci , title =

Pith tools

Reviewed July 12, 2026 · model on record in the stance chip above.