REVIEW 7 cited by
VQA$^2$: Visual Question Answering for Video Quality Assessment
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The advent and proliferation of large multi-modal models (LMMs) have introduced new paradigms to computer vision, transforming various tasks into a unified visual question answering framework. Video Quality Assessment (VQA), a classic field in low-level visual perception, focused initially on quantitative video quality scoring. However, driven by advances in LMMs, it is now progressing toward more holistic visual quality understanding tasks. Recent studies in the image domain have demonstrated that Visual Question Answering (VQA) can markedly enhance low-level visual quality evaluation. Nevertheless, related work has not been explored in the video domain, leaving substantial room for improvement. To address this gap, we introduce the VQA2 Instruction Dataset - the first visual question answering instruction dataset that focuses on video quality assessment. This dataset consists of 3 subsets and covers various video types, containing 157,755 instruction question-answer pairs. Then, leveraging this foundation, we present the VQA2 series models. The VQA2 series models interleave visual and motion tokens to enhance the perception of spatial-temporal quality details in videos. We conduct extensive experiments on video quality scoring and understanding tasks, and results demonstrate that the VQA2series models achieve excellent performance in both tasks. Notably, our final model, the VQA2-Assistant, exceeds the renowned GPT-4o in visual quality understanding tasks while maintaining strong competitiveness in quality scoring tasks. Our work provides a foundation and feasible approach for integrating low-level video quality assessment and understanding with LMMs.
Forward citations
Cited by 7 Pith papers
-
Flow reorganization and transport enhancement in two-dimensional horizontal convection near a density extremum
Horizontal convection with a water-like density maximum reorganizes into a single roll with full-depth plumes, and heat transport scales as Nu ~ Ra^{1/4} to Ra^{1/3}, faster than the classical Ra^{1/5} law.
-
RadarQA: Multi-modal Quality Analysis of Weather Radar Forecasts
RadarQA introduces a specialized MLLM and a 70,000-example dataset for descriptive weather radar forecast quality analysis, outperforming general-purpose MLLMs on its own benchmark.
-
VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learning
VQ-Insight uses progressive reinforcement learning with temporal shuffle and task rewards to teach a vision-language model to score and compare AI-generated videos, with gains on multiple video quality benchmarks.
-
Scaling-up Perceptual Video Quality Assessment
A new pipeline plus datasets (OmniVQA-Chat-400K, OmniVQA-MOS-20K, OmniVQA-FG-Benchmark) yield LMMs with state-of-the-art video quality understanding and rating.
-
Generalizable Video Quality Assessment via Weak-to-Strong Learning
Self-supervised ranking-based training on a 10x larger unlabeled video dataset enables a VQA model to match supervised zero-shot performance, show strong OOD generalization, and set new SOTA when fine-tuned.
-
Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Model
AIGVEval combines BLIP, 3D Swin Transformer, and SlowFast features with a LoRA-tuned LLM to predict AI-generated video quality, hitting second place on the NTIRE 2025 Track 2 leaderboard.
-
Engagement Prediction of Short Videos with Large Multimodal Models
Large multimodal models, especially one that also processes audio, predict short-video engagement better than the prior feature-based baseline on the SnapUGC test set.
Discussion (0). Continue with ORCID to comment.