REVIEW 7 cited by
VRT: A Video Restoration Transformer
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
Video restoration (e.g., video super-resolution) aims to restore high-quality frames from low-quality frames. Different from single image restoration, video restoration generally requires to utilize temporal information from multiple adjacent but usually misaligned video frames. Existing deep methods generally tackle with this by exploiting a sliding window strategy or a recurrent architecture, which either is restricted by frame-by-frame restoration or lacks long-range modelling ability. In this paper, we propose a Video Restoration Transformer (VRT) with parallel frame prediction and long-range temporal dependency modelling abilities. More specifically, VRT is composed of multiple scales, each of which consists of two kinds of modules: temporal mutual self attention (TMSA) and parallel warping. TMSA divides the video into small clips, on which mutual attention is applied for joint motion estimation, feature alignment and feature fusion, while self attention is used for feature extraction. To enable cross-clip interactions, the video sequence is shifted for every other layer. Besides, parallel warping is used to further fuse information from neighboring frames by parallel feature warping. Experimental results on five tasks, including video super-resolution, video deblurring, video denoising, video frame interpolation and space-time video super-resolution, demonstrate that VRT outperforms the state-of-the-art methods by large margins ($\textbf{up to 2.16dB}$) on fourteen benchmark datasets.
Forward citations
Cited by 7 Pith papers
-
Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion
Stream-DiffVSR enables practical low-latency video super-resolution by combining a four-step distilled denoiser, auto-regressive temporal guidance, and a temporal processor in a strictly causal pipeline.
-
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels
Q-Align trains LMMs on discrete text-defined levels for visual scoring, achieving SOTA on IQA, IAA, and VQA while unifying the tasks in OneAlign.
-
FMA-Net++: Motion- and Exposure-Aware Joint Video Super-Resolution and Deblurring
A non-recurrent, exposure-conditioned video super-resolution and deblurring model achieves state-of-the-art results on synthetic multi-exposure benchmarks and generalizes to GoPro and real-world videos.
-
Visko Orbis 1.0: A Live Model for Real-Time Interactive Long Video Generation
A chunk-wise streaming video model with bounded multi-scale memory and streaming 4K upscaling reports real-time interactive long-form generation and top Arena preference/stability scores.
-
TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration
TIGER is a tri-prior fusion method for face video restoration using identity, geometry, and generative priors with progressive training to achieve SOTA identity fidelity and temporal stability on a new large-scale dataset.
-
TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration
TIGER fuses identity embeddings, disentangled 3D geometry parameters, and one-step generative priors with three-stage training to achieve claimed state-of-the-art identity fidelity and temporal stability in face video...
-
From Pixels to Semantics: A Multi-Stage AI Framework for Structural Damage Detection in Satellite Imagery
A hybrid AI system combines super-resolution, YOLO-based detection, and vision-language models to semantically classify building damage severity in pre- and post-disaster satellite images.
Discussion (0). Sign in to comment.