Pith. sign in

REVIEW 26 cited by

G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Model

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2312.11370 v2 pith:C76NLIIP submitted 2023-12-18 cs.CL

Jiahui Gao , Renjie Pi , Jipeng Zhang , Jiacheng Ye , Wanjun Zhong , Yufei Wang , Lanqing Hong , Jianhua Han
show 3 more authors
Hang Xu Zhenguo Li Lingpeng Kong
This is my paper · ORCID
classification cs.CL
keywords geometricproblemsdatasetlanguagelargellmssolvingcurrent
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large language models (LLMs) have shown remarkable proficiency in human-level reasoning and generation capabilities, which encourages extensive research on their application in mathematical problem solving. However, current work has been largely focused on text-based mathematical problems, with limited investigation in problems involving geometric information. Addressing this gap, we aim to enable LLMs to solve geometric problems by understanding image input. We first analyze the limitations of current Multimodal Large Language Models (MLLMs) in this area: they struggle to accurately comprehending basic geometric elements and their relationships. To overcome these challenges, we take advantage of the unique characteristics of geometric problems (such as unique geometric logical form, and geometric scalability) and the capacity of the textual LLMs to build an enriched multimodal geometry dataset based on existing data. The augmented dataset, Geo170K, contains more than 170K geometric image-caption and question-answer pairs. Utilizing our constructed Geo170K dataset, we develop G-LLaVA, which demonstrates exceptional performance in solving geometric problems, significantly outperforming GPT-4-V on the MathVista benchmark with only 7B parameters.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 26 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. PRISM: Priority-aware Rubric Internalization via Structured Multimodal Data Synthesis

    cs.LG 2026-08 conditional novelty 7.0 of 10

    PRISM trains MLLMs to act as rubric executors by synthesizing typed, prioritized rules and verification traces, lifting Qwen3-VL-4B from 9.5% to 30.1% Strict accuracy on the authors' PRISM-Eval benchmark.

  2. Self-Boosting Vision-Language Models with Noisy Student On-Policy Self-Distillation

    cs.LG 2026-07 conditional novelty 6.0 of 10

    NOPD trains a VLM on corrupted images to match its own clean-image predictions, improving accuracy on reasoning benchmarks with no external supervision.

  3. HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models

    cs.CV 2026-07 conditional novelty 6.0 of 10

    HalluScope couples span-level hallucination detection, 12-way type classification, and explanation generation in one model, and shows the resulting feedback reduces hallucinations in two MLLMs.

  4. OpenCoF: Learning to Reason Through Video Generation

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Fine-tuning a video generator on a new 17K reasoning-video dataset improves Chain-of-Frame reasoning, and adding learnable visual/textual reasoning tokens yields further gains on external benchmarks.

  5. E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenes

    cs.CV 2026-04 conditional novelty 6.0 of 10

    E-VLA integrates event streams directly into VLA models via lightweight fusion, raising Pick-Place success from 0% to 60-90% at 20 lux and from 0% to 20-25% under severe motion blur.

  6. LaRe: Latent Refocusing for Multimodal Reasoning

    cs.CV 2025-11 reject novelty 6.0 of 10

    LaRe performs iterative visual refocusing in latent space and reports accuracy gains with fewer tokens, but its main experiments compare against baselines trained with less data.

  7. Correspondence as Video: Test-Time Adaption on SAM2 for Reference Segmentation in the Wild

    cs.CV 2025-08 unverdicted novelty 6.0 of 10

    CAV-SAM reformulates reference segmentation as pseudo-video object segmentation using diffusion-based semantic transitions and test-time geometric alignment, claiming over 5% improvement over state-of-the-art.

  8. Multimodal Mathematical Reasoning with Diverse Solving Perspective

    cs.CL 2025-07 conditional novelty 6.0 of 10

    Training a multimodal language model on multiple diverse solution paths per problem, plus rewards for distinguishing correct from incorrect solutions, improves math benchmark accuracy and output diversity.

  9. AntiGrounding: Lifting Robotic Actions into VLM Representation Space for Decision Making

    cs.RO 2025-06 conditional novelty 6.0 of 10

    AntiGrounding lifts candidate robot trajectories into the VLM's visual space via multi-view rendering and structured VQA, and reports 57.5% average success across eight manipulation tasks, beating three intermediate-r...

  10. VisualToolAgent (VisTA): A Reinforcement Learning Framework for Visual Tool Selection

    cs.CV 2025-05 conditional novelty 6.0 of 10

    VisTA uses GRPO reinforcement learning to train a vision-language agent to select external visual tools for a frozen reasoning model, improving accuracy on ChartQA, Geometry3K, BlindTest, and MathVerse.

  11. ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects

    cs.CL 2025-05 conditional novelty 6.0 of 10

    Execution-driven bootstrapping, where a model generates SQL, executes it, and keeps only queries that run, lets a 7B model outperform GPT-4o on PostgreSQL, MySQL, and Oracle text-to-SQL benchmarks.

  12. GeoX: Geometric Problem Solving Through Unified Formalized Vision-Language Pre-training

    cs.CV 2024-12 conditional novelty 6.0 of 10

    GeoX achieves state-of-the-art accuracy on GeoQA, UniGeo, Geometry3K, and PGPS9K geometry benchmarks using formalized vision-language pre-training with a Generator-and-Sampler Transformer.

  13. Geo-LLaVA: A Large Multi-Modal Model for Solving Geometry Math Problems with Meta In-Context Learning

    cs.CV 2024-12 reject novelty 6.0 of 10

    Geo-LLaVA combines retrieval-augmented fine-tuning with in-context learning, reporting 65.25% and 42.36% on selected subsets of GeoQA and the new GeoMath dataset.

  14. Chimera: Improving Generalist Model with Domain-Specific Experts

    cs.CV 2024-12 conditional novelty 6.0 of 10

    Chimera fuses frozen domain-expert encoders into a generalist multimodal LLM via routing and a 30% masking of general tokens, lifting InternVL2-8B from 61.6 to 64.9 on MathVista and from 31.3 to 32.4 on MathVerse.

  15. Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models

    cs.CV 2024-11 conditional novelty 6.0 of 10

    Insight-V uses machine-generated long-chain reasoning data, a reasoning-plus-summary multi-agent setup, and iterative DPO to improve visual reasoning scores of multimodal LLMs.

  16. Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery

    cs.AI 2026-06 unverdicted novelty 5.0 of 10

    An integrated survey organizing AI mathematical reasoning into informal, formal, discovery, and technique axes while cataloging benchmarks and assessing failure modes.

  17. Evaluating Visual Mathematics in Multimodal LLMs: A Multilingual Benchmark Based on the Kangaroo Tests

    cs.AI 2025-06 conditional novelty 5.0 of 10

    A new multilingual, image-based Kangaroo math benchmark shows Gemini 2.0 Flash, Qwen-VL 2.5 72B, and GPT-4o lead current multimodal LLMs, but all remain far below human accuracy on visual math reasoning.

  18. MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning

    cs.CV 2025-06 conditional novelty 5.0 of 10

    MINT-CoT-7B interleaves fine-grained visual tokens into each math reasoning step and reports 73.70 on MathVista-Math, 64.72 on GeoQA, and 69.6 on MMStar-Math.

  19. Mixpert: Mitigating Multimodal Learning Conflicts with Efficient Mixture-of-Vision-Experts

    cs.CV 2025-05 conditional novelty 5.0 of 10

    Splitting the vision encoder of an MLLM into domain-specific experts with a lightweight router yields small benchmark improvements at near-zero extra inference cost.

  20. Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought

    cs.CV 2025-05 conditional novelty 5.0 of 10

    Argus adds explicit language-guided visual attention to multimodal LLMs by grounding questions to bounding boxes and re-engaging those regions, improving vision-centric reasoning and grounding accuracy.

  21. Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Search

    cs.CV 2024-12 conditional novelty 5.0 of 10

    Using a group of MLLMs to search reasoning trees and training on the resulting paths improves MLLM reasoning, with Mulberry models beating their base models by up to 7.5 points on average.

  22. Diving into Self-Evolving Training for Multimodal Reasoning

    cs.CL 2024-12 conditional novelty 5.0 of 10

    M-STAR, a self-evolving training recipe combining continuous updates, a process-reward-model reranker, and adaptive sampling temperature, improves multimodal reasoning on several benchmarks across three vision-languag...

  23. MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale

    cs.CL 2024-12 conditional novelty 5.0 of 10

    A fully open pipeline that rewrites multimodal instruction data into CoT-style rationales yields a 12M dataset and an 8B model with strong benchmark gains, though some evaluation benchmarks overlap the training data.

  24. Improving Multimodal LLMs Ability In Geometry Problem Solving, Reasoning, And Multistep Scoring

    cs.AI 2024-12 conditional novelty 5.0 of 10

    GPSM4K is a new geometry QA dataset with step-by-step solutions; the paper reports that fine-tuning on it improves LVLM scores, with captioning and RAG giving smaller gains.

  25. Towards Geometry Problem Solving in the Large Model Era: A Survey

    cs.CV 2025-06 conditional novelty 4.0 of 10

    A survey that organizes geometry problem-solving research into benchmark construction, parsing, and reasoning, and proposes a unified parse-then-reason paradigm for the large-model era.

  26. Visual Large Language Models for Generalized and Specialized Applications

    cs.CV 2025-01 conditional novelty 3.0 of 10

    This paper reviews and taxonomizes VLLM applications into vision-to-text, vision-to-action, and text-to-vision, adding ethics and future-work discussion.

Pith tools