A modular 8B agent with episodic visual memory and RL-trained retrieval reaches 91.4% cross-turn image recall over 20 turns, outperforming 32B all-context baselines with ~1.8× lower latency.
Mmctagent: Multi-modal critical thinking agent framework for complex visual reasoning
3 Pith papers cite this work. Polarity classification is still indexing.
3
Pith papers citing it
abstract
Recent advancements in Multi-modal Large Language Models (MLLMs) have significantly improved their performance in tasks combining vision and language. However, challenges persist in detailed multi-modal understanding, comprehension of complex tasks, and reasoning over multi-modal information. This paper introduces MMCTAgent, a novel multi-modal critical thinking agent framework designed to address the inherent limitations of current MLLMs in complex visual reasoning tasks. Inspired by human cognitive processes and critical thinking, MMCTAgent iteratively analyzes multi-modal information, decomposes queries, plans strategies, and dynamically evolves its reasoning. Additionally, MMCTAgent incorporates critical thinking elements such as verification of final answers and self-reflection through a novel approach that defines a vision-based critic and identifies task-specific evaluation criteria, thereby enhancing its decision-making abilities. Through rigorous evaluations across various image and video understanding benchmarks, we demonstrate that MMCTAgent (with and without the critic) outperforms both foundational MLLMs and other tool-augmented pipelines.
representative citing papers
An adaptive, multi-tool verifier for multimodal RL that scores final answers, spatial grounding, and reasoning quality improves agentic models on spatial, hallucination, embodied, and robotic benchmarks.
LLM Orchestration integrates modality experts via an LLM controller, cross-modal memory, and interaction layer to enable multimodal input-output without gradient-based training.
citing papers explorer
-
Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing
A modular 8B agent with episodic visual memory and RL-trained retrieval reaches 91.4% cross-turn image recall over 20 turns, outperforming 32B all-context baselines with ~1.8× lower latency.
-
Multimodal Reinforcement Learning with Adaptive Verifier for AI Agents
An adaptive, multi-tool verifier for multimodal RL that scores final answers, spatial grounding, and reasoning quality improves agentic models on spatial, hallucination, embodied, and robotic benchmarks.
-
Training-Free Multimodal Large Language Model Orchestration
LLM Orchestration integrates modality experts via an LLM controller, cross-modal memory, and interaction layer to enable multimodal input-output without gradient-based training.