Introduces DMC-CF benchmark from real videos for multimodal causal counterfactual QA, with DGI dynamic evaluation, showing current MLLMs require substantial improvement in real-world causal reasoning.
Junzhe Zhang, Huixuan Zhang, and Xiaojun Wan
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
fields
cs.CV 2years
2026 2verdicts
UNVERDICTED 2representative citing papers
ReKey introduces a live benchmark protocol that regenerates visual keys in images to produce contamination-resilient VQA evaluations, showing 9.5-18.8 point higher scores on original items across eight VLMs.
citing papers explorer
-
DMC-CF: Dynamic Multimodal CounterFactual QA benchmark for Causal Reasoning
Introduces DMC-CF benchmark from real videos for multimodal causal counterfactual QA, with DGI dynamic evaluation, showing current MLLMs require substantial improvement in real-world causal reasoning.
-
REKEY: Metadata-Grounded Visual-Key Regeneration for Contamination-Resilient VQA Evaluation
ReKey introduces a live benchmark protocol that regenerates visual keys in images to produce contamination-resilient VQA evaluations, showing 9.5-18.8 point higher scores on original items across eight VLMs.