REVIEW 4 major objections 5 minor 95 references
EvEnhancer: Empowering Effectiveness, Efficiency and Generalizability for Continuous Space-Time Video Super-Resolution with Events
T0 review · 4 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read EvEnhancer claims that event streams can be fused with ordinary frames to produce a continuous video representation that super-resolves video at arbitrary spatial and temporal scales, outperforming prior methods by more than 1 dB PSNR…
desk verdict Solid INR paper with a genuinely new unified 3D architecture and thorough ablations; the 'superiority' claim leans on a not-rerun baseline and a PSNR-only reading, but the work deserves peer review. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Two components carry the argument. The event-adapted synthesis module (EASM) turns a pair of low-resolution frames plus a voxelized event stream into a high-temporal-resolution feature sequence. Its event-modulated alignment builds a three-level pyramid of deformable-convolution offsets, with each offset modulated by the event feature at that timestamp, producing $M$ intermediate frame features in both forward and backward directions; the bidirectional recurrent compensation then propagates event and frame features across time and fuses them. The local implicit video transformer (LIVT) is the continuous decoder: for a queried space-time coordinate $(T,x,y)$, it selects the $T_G$ nearest temporal slices, applies cross-scale 3D attention between the large-scale query and small-scale key/value features sampled on a local $3\times3\times3$ grid, adds cosine positional encoding of relative coordinates, and feeds the result through a five-layer MLP to output RGB. This replaces the separate spatial and temporal implicit networks of earlier methods with one unified video INR, and it is what lets the model answer arbitrary spatial and temporal queries without re-extracting input frames.
What would settle it
Train the identical EASM+LIVT architecture on real event streams from an event camera instead of vid2e-simulated events and test on the same videos; if the margin over frame-only baselines vanishes or reverses under real training events, the claimed advantage of event-modulated synthesis over frame-based motion estimation is not supported.
Extended reading notes
Core claim
The paper's central claim is that the two weaknesses of continuous space-time video super-resolution—poor out-of-distribution behavior and inaccurate motion under large or nonlinear motion—can be traced to decoupling the video implicit neural representation into separate spatial and temporal branches and to estimating inter-frame motion from frames alone. EvEnhancer instead binds frames and events in a single pipeline: EASM learns long-term motion trajectories from events, and LIVT decodes arbitrary space-time coordinates from a unified local implicit video transformer. The paper reports that this design outperforms state-of-the-art methods, including event-based HR-INR, at in-distribution and out-of-distribution scales on synthetic GoPro and Adobe240 data and on real-world BS-ERGB and ALPIX-VSR data, with model sizes of 5.81M and 6.55M parameters and more than 1 dB PSNR gains in several settings.
Load-bearing premise
The load-bearing premise is that events synthesized from ordinary frames by the vid2e simulator behave enough like real event-camera signals that a model trained on them transfers to real sensors; if that premise fails, the real-world results in the paper do not actually test the central claim.
Editorial extensions
If this is right
- At the in-distribution scale (temporal $t=8$, spatial $s=4$), EvEnhancer reports more than 1 dB PSNR improvement over the best prior continuous STVSR models on GoPro and Adobe240 while using fewer parameters.
- At out-of-distribution scales, especially large temporal factors ($t=12$, $t=16$), the improvement over prior methods grows; at very large spatial factor $s=12$ the advantage shrinks, suggesting a limit tied to the local neighborhood size.
- On real-world BS-ERGB and ALPIX-VSR data, the model trained only on simulated events transfers without fine-tuning and beats cascaded event VFI+VSR pipelines.
- The unified 3D implicit video transformer decodes any queried space-time coordinate in one pass, avoiding the repeated frame-extraction redundancy of decoupled event-based INR methods.
Reading between the lines
- Editorial inference: if simulated events are the only training signal, the real-world transfer results imply that the motion cues events provide are roughly domain-agnostic; a direct test would fine-tune on real event streams and measure the additional gain.
- Editorial inference: because LIVT is a coordinate-based decoder, the same EASM output could be queried for non-integer times and resolutions; the paper demonstrates this but does not explore user-controllable trade-offs between temporal and spatial scale at fixed compute.
- Editorial inference: the shrinking gains at $s=12$ suggest that a fixed $3\times3\times3$ local grid is the limiting factor; increasing grid size adaptively with scale is a plausible next step the paper does not test.
- Editorial inference: the comparison to HR-INR relies on numbers from the original paper rather than a shared re-run; an independent evaluation on a common protocol would help pin down the true margin.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes EvEnhancer, an event-driven continuous space-time video super-resolution (C-STVSR) method. It combines an event-adapted synthesis module (EASM), which uses event-modulated alignment and bidirectional recurrent compensation, with a local implicit video transformer (LIVT) that integrates cross-scale spatiotemporal attention into a unified continuous video INR. The model is trained on Adobe240 with synthetic events from vid2e and evaluated on GoPro, Adobe240, BS-ERGB, and ALPIX-VSR, at both in-distribution scales (t=8, s=4) and out-of-distribution scales (t=6,12,16; s=1,4,6,12). The central claims are state-of-the-art effectiveness with fewer parameters, better efficiency than MoTIF at larger temporal scales, and preferable generalization on OOD scales.
Significance. If the claims hold, the paper makes a useful empirical contribution: it demonstrates that event streams can be integrated into a unified continuous space-time INR, achieving strong PSNR at most tested scales with lower model complexity than existing C-STVSR methods. The strengths are the thorough ablations of EASM and LIVT components, the genuinely held-out OOD scales that produce predictions rather than fitted values, the availability of code, and the empirical transfer to real-world event data. However, the central comparison with the closest event-based baseline HR-INR is based on numbers copied from the original paper rather than re-run under the same protocol, and the reported superiority is not uniform on SSIM or at all OOD scales.
major comments (4)
- [§4.2, Tables 1 and 2] The comparison against HR-INR, the closest event-based one-stage C-STVSR baseline, is not controlled: the paper states in §4.2 that HR-INR results are taken from its original paper because the code is unavailable. Since the dagger marker in Table 1 ('trained on the same Adobe240 dataset as ours') cannot be verified, differences in the train/test split, vid2e event simulation parameters, bicubic LR generation, voxelization, or the Center/Average evaluation convention could change the reported gaps. Because the 'more than 1 dB PSNR improvement' claim in §4.2 is made specifically against HR-INR numbers in Table 1, please either re-run HR-INR under the same protocol or substantially qualify the superiority claim.
- [Table 1] The in-distribution results do not show uniform superiority on SSIM. HR-INR achieves higher SSIM in all four settings (GoPro-Center 0.9298 vs 0.9295, GoPro-Average 0.9371 vs 0.9279, Adobe240-Center 0.9246 vs 0.9129, Adobe240-Average 0.9216 vs 0.9116), while EvEnhancer leads only in PSNR. The Abstract and §4.2 state 'superiority' and 'more than 1 dB PSNR improvements' without this caveat; the claim should be reported as a PSNR advantage with an explicit discussion of the SSIM trade-off, or additional evidence should be provided that the method is superior overall.
- [Table 2] The out-of-distribution generalization claim is contradicted at one tested setting: at t=6, s=12, MoTIF achieves 25.81 dB / 0.7330 SSIM, while EvEnhancer achieves 25.50 dB / 0.7323 and EvEnhancer-light 25.41 dB / 0.7261. The text says the models 'exceed almost all existing methods,' but the Abstract's broader claim of 'preferable generalizability on out-of-distribution scales against state-of-the-art methods' should be qualified to the scales where the advantage holds, with an explanation of why the advantage disappears at large spatial scale.
- [§4.1 and Tables 3–4] All training uses only synthetic events generated by vid2e on Adobe240, while the real-world claims rest on BS-ERGB and ALPIX-VSR. If the simulated event statistics are not representative of the real sensors, the real-world gains in Tables 3 and 4 are not direct evidence for the central claim. Please add an explicit domain-gap discussion or a small real-event fine-tuning experiment; at minimum, state this as a limitation in the conclusion.
minor comments (5)
- [Eq. (4)] The notation 'sin(20δC)' and 'cos(20δC)' is ambiguous; write the powers explicitly (e.g., sin(2^j δ)) and specify the intended frequency range.
- [§3.4, Eq. (3)] The expression 'Sτ = arg min ...' is not well-posed without the cardinality constraint |Sτ| = T_G; please include it in the definition.
- [§4.1, Training Settings] The sentence 'we uniformly samples in [1, 4]' is grammatically incomplete and does not state whether both the spatial scale s and temporal scale t are sampled in [1,4]; please clarify.
- [Table 5, footnote] The footnote that MoTIF uses 'repeated iterations during inference' due to 'their large computations' is vague; specify exactly how TFLOPs were accumulated for the repeated-iteration setting.
- [Figure 1(b)] The axis labels such as 't × 12s × 6' are confusing; use explicit notation such as 't=12, s=6' and define all symbols in the caption.
Circularity Check
No circularity found: EvEnhancer is an empirical architecture paper whose OOD-scale results are genuine held-out predictions, and no fitted parameter is renamed as a prediction.
full rationale
The paper's central claim is an empirical performance comparison for continuous space-time video super-resolution. The method is built from learned modules (EASM and LIVT) described by explicit equations, and none of those equations defines an output in terms of the target metric or fits a parameter to the data being 'predicted.' The OOD scales (s=6, s=12, t=12, t=16) are outside the training sampling ranges stated in Sec. 4.1 (first stage s=4,t=8; second stage uniform in [1,4]), so the reported generalization results are genuine extrapolation rather than interpolation over fitted values. Hyperparameter choices (event segments M, local grid size, INR channels) were selected via ablations and reported in Tables 6-11; this is standard model selection, not circularity. The use of synthetic events via vid2e is an input-modality choice, and the real-world BS-ERGB and ALPIX-VSR evaluations provide an external check. The only notable weakness is that HR-INR results are taken from its original paper rather than re-run under the authors' protocol, as stated in Sec. 4.2: 'Due to the limitation that the HR-INR source code is not yet available, the results of HR-INR are derived from its original paper.' That is a legitimate comparability/correctness concern, but it is not circularity: the paper does not derive its own result from HR-INR's numbers, nor does it fit anything to them. The self-citations to prior VSR work by the same authors are related-work context and are not load-bearing for the main claim. Overall, no circular step could be identified and quoted; the appropriate finding is no significant circularity.
Assumptions & free parameters
free parameters (3)
- Event segments M (full model) =
7
- Local grid size TG x HG x WG =
3x3x3
- INR channel number =
64 (full), 16 (light)
assumptions (3)
- domain assumption Events simulated with vid2e on Adobe240 are representative of real event streams from BS-ERGB and ALPIX-VSR sensors.
- domain assumption The voxel grid representation with M linearly discretized segments retains the motion information needed for long-term trajectory modeling.
- domain assumption Local neighborhoods in the LR spatiotemporal feature grid are sufficient to decode arbitrary HR coordinates.
Cite this review
Pith. "Pith review of EvEnhancer: Empowering Effectiveness, Efficiency and Generalizability for Continuous Space-Time Video Super-Resolution with Events." pith.science (2026). https://pith.science/paper/EQKKGDFD
@misc{pith2026250504657,
author = {Pith},
title = {Pith review of: EvEnhancer: Empowering Effectiveness, Efficiency and Generalizability for Continuous Space-Time Video Super-Resolution with Events},
year = {2026},
howpublished = {\url{https://pith.science/paper/EQKKGDFD}},
note = {Machine review of arXiv:2505.04657}
}
read the original abstract
Continuous space-time video super-resolution (C-STVSR) endeavors to upscale videos simultaneously at arbitrary spatial and temporal scales, which has recently garnered increasing interest. However, prevailing methods struggle to yield satisfactory videos at out-of-distribution spatial and temporal scales. On the other hand, event streams characterized by high temporal resolution and high dynamic range, exhibit compelling promise in vision tasks. This paper presents EvEnhancer, an innovative approach that marries the unique advantages of event streams to elevate effectiveness, efficiency, and generalizability for C-STVSR. Our approach hinges on two pivotal components: 1) Event-adapted synthesis capitalizes on the spatiotemporal correlations between frames and events to discern and learn long-term motion trajectories, enabling the adaptive interpolation and fusion of informative spatiotemporal features; 2) Local implicit video transformer integrates local implicit video neural function with cross-scale spatiotemporal attention to learn continuous video representations utilized to generate plausible videos at arbitrary resolutions and frame rates. Experiments show that EvEnhancer achieves superiority on synthetic and real-world datasets and preferable generalizability on out-of-distribution scales against state-of-the-art methods. Code is available at https://github.com/W-Shuoyan/EvEnhancer.
Figures
Figures from the paper (8 more)
Reference graph
Works this paper leans on
-
[1]
Depth-aware video frame interpolation
Wenbo Bao, Wei-Sheng Lai, Chao Ma, Xiaoyun Zhang, Zhiyong Gao, and Ming-Hsuan Yang. Depth-aware video frame interpolation. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition , pages 3703–3712, 2019. 2
2019
-
[2]
Basicvsr: The search for essential compo- nents in video super-resolution and beyond
Kelvin CK Chan, Xintao Wang, Ke Yu, Chao Dong, and Chen Change Loy. Basicvsr: The search for essential compo- nents in video super-resolution and beyond. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4947–4956, 2021. 1, 2
2021
-
[3]
Basicvsr++: Improving video super- 10 resolution with enhanced propagation and alignment
Kelvin CK Chan, Shangchen Zhou, Xiangyu Xu, and Chen Change Loy. Basicvsr++: Improving video super- 10 resolution with enhanced propagation and alignment. InPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5972–5981, 2022. 1
2022
-
[4]
Cascaded local implicit transformer for arbitrary-scale super-resolution
Hao-Wei Chen, Yu-Syuan Xu, Min-Fong Hong, Yi-Min Tsai, Hsien-Kai Kuo, and Chun-Yi Lee. Cascaded local implicit transformer for arbitrary-scale super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 18257–18267, 2023. 3, 6
2023
-
[5]
Learning continuous image representation with local implicit image function
Yinbo Chen, Sifei Liu, and Xiaolong Wang. Learning continuous image representation with local implicit image function. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8628–8638,
-
[6]
Motif: Learning motion trajectories with local implicit neural functions for continuous space-time video super- resolution
Yi-Hsin Chen, Si-Cun Chen, Yen-Yu Lin, and Wen-Hsiao Peng. Motif: Learning motion trajectories with local implicit neural functions for continuous space-time video super- resolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 23131–23141, 2023. 1, 2, 3, 5, 6, 7, 8, 9, 15, 16, 17, 18, 19
2023
-
[7]
Videoinr: Learning video implicit neural representa- tion for continuous space-time super-resolution
Zeyuan Chen, Yinbo Chen, Jingwen Liu, Xingqian Xu, Vidit Goel, Zhangyang Wang, Humphrey Shi, and Xiaolong Wang. Videoinr: Learning video implicit neural representa- tion for continuous space-time super-resolution. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2047–2057, 2022. 1, 2, 3, 5, 6, 7, 8, 9, 10, 15, ...
2022
-
[8]
Video frame inter- polation via deformable separable convolution
Xianhang Cheng and Zhenzhong Chen. Video frame inter- polation via deformable separable convolution. In Proceed- ings of the AAAI Conference on Artificial Intelligence, pages 10607–10614, 2020. 2
2020
Show all 95 references
-
[9]
All at once: Temporally adaptive multi-frame interpolation with advanced motion modeling
Zhixiang Chi, Rasoul Mohammadi Nasiri, Zheng Liu, Juwei Lu, Jin Tang, and Konstantinos N Plataniotis. All at once: Temporally adaptive multi-frame interpolation with advanced motion modeling. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 20...
2020
-
[10]
Flownet: Learning optical flow with convolutional networks
Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick Van Der Smagt, Daniel Cremers, and Thomas Brox. Flownet: Learning optical flow with convolutional networks. In Pro- ceedings of the IEEE international conference on computer...
2015
-
[11]
Video to events: Recycling video datasets for event cameras
Daniel Gehrig, Mathias Gehrig, Javier Hidalgo-Carri ´o, and Davide Scaramuzza. Video to events: Recycling video datasets for event cameras. In CVPR, pages 3586–3595,
-
[12]
Rstt: Real-time spatial temporal transformer for space-time video super-resolution
Zhicheng Geng, Luming Liang, Tianyu Ding, and Ilya Zharkov. Rstt: Real-time spatial temporal transformer for space-time video super-resolution. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 17441–17451, 2022. 3
2022
-
[13]
Evintsr-net: Event guided multiple latent frames reconstruc- tion and super-resolution
Jin Han, Yixin Yang, Chu Zhou, Chao Xu, and Boxin Shi. Evintsr-net: Event guided multiple latent frames reconstruc- tion and super-resolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4882– 4891, 2021. 2, 3
2021
-
[14]
Recurrent back-projection network for video super- resolution
Muhammad Haris, Gregory Shakhnarovich, and Norimichi Ukita. Recurrent back-projection network for video super- resolution. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3897–3906,
-
[15]
Space-time-aware multi-resolution video enhance- ment
Muhammad Haris, Greg Shakhnarovich, and Norimichi Ukita. Space-time-aware multi-resolution video enhance- ment. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2859–2868,
-
[16]
Neighborhood attention transformer
Ali Hassani, Steven Walton, Jiachen Li, Shen Li, and Humphrey Shi. Neighborhood attention transformer. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6185–6194, 2023. 10
2023
-
[17]
Timereplayer: Unlocking the potential of event cameras for video interpolation
Weihua He, Kaichao You, Zhendong Qiao, Xu Jia, Ziyang Zhang, Wenhui Wang, Huchuan Lu, Yaoyuan Wang, and Jianxing Liao. Timereplayer: Unlocking the potential of event cameras for video interpolation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recog...
2022
-
[18]
Latent modulated function for com- putational optimal continuous image representation
Zongyao He and Zhi Jin. Latent modulated function for com- putational optimal continuous image representation. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 26026–26035, 2024. 3
2024
-
[19]
A perceptual quality metric for video frame interpolation
Qiqi Hou, Abhijay Ghildyal, and Feng Liu. A perceptual quality metric for video frame interpolation. In European Conference on Computer Vision , pages 234–253. Springer,
-
[20]
Spatial-temporal space hand-in- hand: Spatial-temporal video super-resolution via cycle- projected mutual learning
Mengshun Hu, Kui Jiang, Liang Liao, Jing Xiao, Junjun Jiang, and Zheng Wang. Spatial-temporal space hand-in- hand: Spatial-temporal video super-resolution via cycle- projected mutual learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition...
2022
-
[21]
Cycmunet+: Cycle-projected mutual learning for spatial-temporal video super-resolution
Mengshun Hu, Kui Jiang, Zheng Wang, Xiang Bai, and Ruimin Hu. Cycmunet+: Cycle-projected mutual learning for spatial-temporal video super-resolution. IEEE Transac- tions on Pattern Analysis and Machine Intelligence, 2023. 2
2023
-
[22]
Video frame interpolation with many-to-many splat- ting and spatial selective refinement
Ping Hu, Simon Niklaus, Lu Zhang, Stan Sclaroff, and Kate Saenko. Video frame interpolation with many-to-many splat- ting and spatial selective refinement. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023. 2
2023
-
[23]
Arbitrary-scale video super-resolution guided by dynamic context
Cong Huang, Jiahao Li, Lei Chu, Dong Liu, and Yan Lu. Arbitrary-scale video super-resolution guided by dynamic context. In Proceedings of the AAAI Conference on Artifi- cial Intelligence, pages 2294–2302, 2024. 2
2024
-
[24]
Video super- resolution via bidirectional recurrent convolutional net- works
Yan Huang, Wei Wang, and Liang Wang. Video super- resolution via bidirectional recurrent convolutional net- works. IEEE transactions on pattern analysis and machine intelligence, 40(4):1015–1028, 2017. 2
2017
-
[25]
Real-time intermediate flow estimation for video frame interpolation
Zhewei Huang, Tianyuan Zhang, Wen Heng, Boxin Shi, and Shuchang Zhou. Real-time intermediate flow estimation for video frame interpolation. In European Conference on Com- puter Vision, pages 624–642. Springer, 2022. 2
2022
-
[26]
Scale-adaptive feature aggregation for efficient space-time video super-resolution
Zhewei Huang, Ailin Huang, Xiaotao Hu, Chen Hu, Jun Xu, and Shuchang Zhou. Scale-adaptive feature aggregation for efficient space-time video super-resolution. In Proceed- 11 ings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 4228–4239, 2024. 3, 6, 7, 15
2024
-
[27]
Flownet 2.0: Evolu- tion of optical flow estimation with deep networks
Eddy Ilg, Nikolaus Mayer, Tonmoy Saikia, Margret Keuper, Alexey Dosovitskiy, and Thomas Brox. Flownet 2.0: Evolu- tion of optical flow estimation with deep networks. In Pro- ceedings of the IEEE conference on computer vision and pat- tern recognition, pages 2462–2470, 2017. 2
2017
-
[28]
Video super-resolution with temporal group attention
Takashi Isobe, Songjiang Li, Xu Jia, Shanxin Yuan, Gregory Slabaugh, Chunjing Xu, Ya-Li Li, Shengjin Wang, and Qi Tian. Video super-resolution with temporal group attention. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 8008–8017...
2020
-
[29]
Re- visiting temporal modeling for video super-resolution
Takashi Isobe, Fang Zhu, Xu Jia, and Shengjin Wang. Re- visiting temporal modeling for video super-resolution. arXiv preprint arXiv:2008.05765, 2020. 2
2008 arXiv
-
[30]
Super slomo: High quality estimation of multiple intermediate frames for video interpolation
Huaizu Jiang, Deqing Sun, Varun Jampani, Ming-Hsuan Yang, Erik Learned-Miller, and Jan Kautz. Super slomo: High quality estimation of multiple intermediate frames for video interpolation. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages ...
2018
-
[31]
Turning frequency to resolution: Video super-resolution via event cameras
Yongcheng Jing, Yiding Yang, Xinchao Wang, Mingli Song, and Dacheng Tao. Turning frequency to resolution: Video super-resolution via event cameras. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7772–7781, 2021. 2, 3
2021
-
[32]
EvTexture: Event-driven Texture Enhancement for Video Super-Resolution
Dachun Kai, Jiayao Lu, Yueyi Zhang, and Xiaoyan Sun. EvTexture: Event-driven Texture Enhancement for Video Super-Resolution. In Proceedings of the 41st International Conference on Machine Learning , pages 22817–22839. PMLR, 2024. 3, 6, 7, 9, 15
2024
-
[33]
Flavr: Flow-agnostic video representations for fast frame interpolation
Tarun Kalluri, Deepak Pathak, Manmohan Chandraker, and Du Tran. Flavr: Flow-agnostic video representations for fast frame interpolation. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 2071– 2082, 2023. 2
2023
-
[34]
Fisr: Deep joint frame interpolation and super-resolution with a multi- scale temporal loss
Soo Ye Kim, Jihyong Oh, and Munchurl Kim. Fisr: Deep joint frame interpolation and super-resolution with a multi- scale temporal loss. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 11278–11286, 2020. 2
2020
-
[35]
Event-based video frame interpolation with cross- modal asymmetric bidirectional motion fields
Taewoo Kim, Yujeong Chae, Hyun-Kurl Jang, and Kuk-Jin Yoon. Event-based video frame interpolation with cross- modal asymmetric bidirectional motion fields. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 18032–18042, 2023. 3, 6, 7, 9, 15
2023
-
[36]
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 ,
-
[37]
Deep laplacian pyramid networks for fast and accurate super-resolution
Wei-Sheng Lai, Jia-Bin Huang, Narendra Ahuja, and Ming- Hsuan Yang. Deep laplacian pyramid networks for fast and accurate super-resolution. In Proceedings of the IEEE con- ference on computer vision and pattern recognition , pages 624–632, 2017. 6
2017
-
[38]
Adacof: Adaptive col- laboration of flows for video frame interpolation
Hyeongmin Lee, Taeoh Kim, Tae-young Chung, Daehyun Pak, Yuseok Ban, and Sangyoun Lee. Adacof: Adaptive col- laboration of flows for video frame interpolation. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5316–5325, 2020. 2
2020
-
[39]
Local texture estima- tor for implicit representation function
Jaewon Lee and Kyong Hwan Jin. Local texture estima- tor for implicit representation function. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1929–1938, 2022. 3
1929
-
[40]
Learning a deep dual attention network for video super-resolution
Feng Li, Huihui Bai, and Yao Zhao. Learning a deep dual attention network for video super-resolution. IEEE transac- tions on image processing, 29:4474–4488, 2020. 1, 2
2020
-
[41]
Enhanced video super-resolution network to- wards compressed data
Feng Li, Yixuan Wu, Anqi Li, Huihui Bai, Runmin Cong, and Yao Zhao. Enhanced video super-resolution network to- wards compressed data. ACM Transactions on Multimedia Computing, Communications and Applications, 20(7):1–21,
-
[42]
Fast spatio-temporal residual network for video super-resolution
Sheng Li, Fengxiang He, Bo Du, Lefei Zhang, Yonghao Xu, and Dacheng Tao. Fast spatio-temporal residual network for video super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 10522–10531, 2019. 1
2019
-
[43]
Mucan: Multi-correspondence aggregation net- work for video super-resolution
Wenbo Li, Xin Tao, Taian Guo, Lu Qi, Jiangbo Lu, and Jiaya Jia. Mucan: Multi-correspondence aggregation net- work for video super-resolution. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23– 28, 2020, Proceedings, Part X 16, pages 335–351. Springer,
2020
-
[44]
Savsr: Arbitrary-scale video super-resolution via a learned scale-adaptive network
Zekun Li, Hongying Liu, Fanhua Shang, Yuanyuan Liu, Liang Wan, and Wei Feng. Savsr: Arbitrary-scale video super-resolution via a learned scale-adaptive network. In Proceedings of the AAAI Conference on Artificial Intelli- gence, pages 3288–3296, 2024. 2
2024
-
[45]
Recurrent video restoration trans- former with guided deformable attention
Jingyun Liang, Yuchen Fan, Xiaoyu Xiang, Rakesh Ranjan, Eddy Ilg, Simon Green, Jiezhang Cao, Kai Zhang, Radu Timofte, and Luc V Gool. Recurrent video restoration trans- former with guided deformable attention. Advances in Neu- ral Information Processing Systems, 35:378–393, 2022. 2
2022
-
[46]
Learning event-driven video deblurring and interpolation
Songnan Lin, Jiawei Zhang, Jinshan Pan, Zhe Jiang, Dongqing Zou, Yongtian Wang, Jing Chen, and Jimmy Ren. Learning event-driven video deblurring and interpolation. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VIII 1...
2020
-
[47]
Learning trajectory-aware transformer for video super- resolution
Chengxu Liu, Huan Yang, Jianlong Fu, and Xueming Qian. Learning trajectory-aware transformer for video super- resolution. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5687–5696,
-
[48]
Sparse global matching for video frame interpolation with large motion
Chunxu Liu, Guozhen Zhang, Rui Zhao, and Limin Wang. Sparse global matching for video frame interpolation with large motion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 19125– 19134, 2024. 2
2024
-
[49]
Video frame interpolation with transformer
Liying Lu, Ruizheng Wu, Huaijia Lin, Jiangbo Lu, and Jiaya Jia. Video frame interpolation with transformer. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3532–3542, 2022. 2
2022
-
[50]
Learning spatial-temporal implicit neural repre- 12 sentations for event-guided video super-resolution
Yunfan Lu, Zipeng Wang, Minjie Liu, Hongjian Wang, and Lin Wang. Learning spatial-temporal implicit neural repre- 12 sentations for event-guided video super-resolution. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1557–1567, 202...
2023
-
[51]
Hr-inr: Continuous space-time video super-resolution via event camera
Yunfan Lu, Zipeng Wang, Yusheng Wang, and Hui Xiong. Hr-inr: Continuous space-time video super-resolution via event camera. arXiv preprint arXiv:2405.13389 , 2024. 2, 3, 5, 6, 7
2024
-
[52]
Nerf: Representing scenes as neural radiance fields for view syn- thesis
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes as neural radiance fields for view syn- thesis. Communications of the ACM , 65(1):99–106, 2021. 10
2021
-
[53]
Deep multi-scale convolutional neural network for dynamic scene deblurring
Seungjun Nah, Tae Hyun Kim, and Kyoung Mu Lee. Deep multi-scale convolutional neural network for dynamic scene deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3883–3891,
-
[54]
Softmax splatting for video frame interpolation
Simon Niklaus and Feng Liu. Softmax splatting for video frame interpolation. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition , pages 5437–5446, 2020. 2
2020
-
[55]
Video frame in- terpolation via adaptive separable convolution
Simon Niklaus, Long Mai, and Feng Liu. Video frame in- terpolation via adaptive separable convolution. In Proceed- ings of the IEEE international conference on computer vi- sion, pages 261–270, 2017. 2
2017
-
[56]
Video frame in- terpolation via adaptive convolution
Simon Niklaus, Long Mai, and Feng Liu. Video frame in- terpolation via adaptive convolution. In Proceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 670–679, 2017. 2
2017
-
[57]
Splatting-based synthesis for video frame interpolation
Simon Niklaus, Ping Hu, and Jiawen Chen. Splatting-based synthesis for video frame interpolation. InProceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 713–723, 2023. 2
2023
-
[58]
Asymmetric bilateral motion estimation for video frame interpolation
Junheum Park, Chul Lee, and Chang-Su Kim. Asymmetric bilateral motion estimation for video frame interpolation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 14539–14548, 2021. 2
2021
-
[59]
Learning degradation-robust spatiotemporal frequency-transformer for video super- resolution
Zhongwei Qiu, Huan Yang, Jianlong Fu, Daochang Liu, Chang Xu, and Dongmei Fu. Learning degradation-robust spatiotemporal frequency-transformer for video super- resolution. IEEE Transactions on Pattern Analysis and Ma- chine Intelligence, 2023. 2
2023
-
[60]
Spatio-temporal perception-distortion trade-off in learned video sr
Nasrin Rahimi and A Murat Tekalp. Spatio-temporal perception-distortion trade-off in learned video sr. In 2023 IEEE International Conference on Image Processing (ICIP), pages 1400–1404. IEEE, 2023. 1
2023
-
[61]
Unsupervised video interpolation us- ing cycle consistency
Fitsum A Reda, Deqing Sun, Aysegul Dundar, Mohammad Shoeybi, Guilin Liu, Kevin J Shih, Andrew Tao, Jan Kautz, and Bryan Catanzaro. Unsupervised video interpolation us- ing cycle consistency. In Proceedings of the IEEE/CVF in- ternational conference on computer Vision, pages 892–900,
-
[62]
Space-time super-resolution from a single video
Oded Shahar, Alon Faktor, and Michal Irani. Space-time super-resolution from a single video. IEEE, 2011. 3
2011
-
[63]
Arbitrary-scale video super- resolution with structural and textural priors
Wei Shang, Dongwei Ren, Wanying Zhang, Yuming Fang, Wangmeng Zuo, and Kede Ma. Arbitrary-scale video super- resolution with structural and textural priors. In European Conference on Computer Vision , pages 73–90. Springer,
-
[64]
Space-time super-resolution
Eli Shechtman, Yaron Caspi, and Michal Irani. Space-time super-resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(4):531–545, 2005. 3
2005
-
[65]
Video frame interpolation transformer
Zhihao Shi, Xiangyu Xu, Xiaohong Liu, Jun Chen, and Ming-Hsuan Yang. Video frame interpolation transformer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17482–17491, 2022. 2
2022
-
[66]
Deep video deblurring for hand-held cameras
Shuochen Su, Mauricio Delbracio, Jue Wang, Guillermo Sapiro, Wolfgang Heidrich, and Oliver Wang. Deep video deblurring for hand-held cameras. In Proceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 1279–1288, 2017. 1, 2, 6, 7, 8, 9, 17
2017
-
[67]
Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume
Deqing Sun, Xiaodong Yang, Ming-Yu Liu, and Jan Kautz. Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 8934–8943,
-
[68]
Event-based frame interpolation with ad-hoc de- blurring
Lei Sun, Christos Sakaridis, Jingyun Liang, Peng Sun, Jiezhang Cao, Kai Zhang, Qi Jiang, Kaiwei Wang, and Luc Van Gool. Event-based frame interpolation with ad-hoc de- blurring. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 18043–...
2023
-
[69]
Tdan: Temporally-deformable alignment network for video super-resolution
Yapeng Tian, Yulun Zhang, Yun Fu, and Chenliang Xu. Tdan: Temporally-deformable alignment network for video super-resolution. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition , pages 3360–3369, 2020. 2
2020
-
[70]
Time lens: Event-based video frame interpo- lation
Stepan Tulyakov, Daniel Gehrig, Stamatios Georgoulis, Julius Erbach, Mathias Gehrig, Yuanyou Li, and Davide Scaramuzza. Time lens: Event-based video frame interpo- lation. In Proceedings of the IEEE/CVF conference on com- puter vision and pattern recognition , pages 16155–16164,
-
[71]
Time lens++: Event-based frame interpolation with paramet- ric non-linear flow and multi-scale fusion
Stepan Tulyakov, Alfredo Bochicchio, Daniel Gehrig, Sta- matios Georgoulis, Yuanyou Li, and Davide Scaramuzza. Time lens++: Event-based frame interpolation with paramet- ric non-linear flow and multi-scale fusion. In Proceedings of the IEEE/CVF Conference on Computer Vision an...
2022
-
[72]
Bi- rstu: Bidirectional recurrent upsampling network for space- time video super-resolution
Hai Wang, Wenming Yang, Qingmin Liao, and Jie Zhou. Bi- rstu: Bidirectional recurrent upsampling network for space- time video super-resolution. IEEE Transactions on Multime- dia, 2022. 2
2022
-
[73]
Stdan: deformable attention network for space-time video super-resolution
Hai Wang, Xiaoyu Xiang, Yapeng Tian, Wenming Yang, and Qingmin Liao. Stdan: deformable attention network for space-time video super-resolution. IEEE Transactions on Neural Networks and Learning Systems, 2023. 2
2023
-
[74]
Learning for video super-resolution through hr op- tical flow estimation
Longguang Wang, Yulan Guo, Zaiping Lin, Xinpu Deng, and Wei An. Learning for video super-resolution through hr op- tical flow estimation. In Computer Vision–ACCV 2018: 14th Asian Conference on Computer Vision, Perth, Australia, De- cember 2–6, 2018, Revised Selected Papers, Pa...
2018
-
[75]
Dual super-resolution learning for semantic segmentation
Li Wang, Dong Li, Yousong Zhu, Lu Tian, and Yi Shan. Dual super-resolution learning for semantic segmentation. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3774–3783, 2020. 1
2020
-
[76]
Non-local neural networks
Xiaolong Wang, Ross Girshick, Abhinav Gupta, and Kaim- ing He. Non-local neural networks. In Proceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 7794–7803, 2018. 2
2018
-
[77]
Edvr: Video restoration with enhanced deformable convolutional networks
Xintao Wang, Kelvin CK Chan, Ke Yu, Chao Dong, and Chen Change Loy. Edvr: Video restoration with enhanced deformable convolutional networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pages 0–0, 2019. 1, 2, 4
2019
-
[78]
Compression-aware video super- resolution
Yingwei Wang, Takashi Isobe, Xu Jia, Xin Tao, Huchuan Lu, and Yu-Wing Tai. Compression-aware video super- resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 2012– 2021, 2023. 1
2012
-
[79]
Perception-oriented video frame interpolation via asymmetric blending
Guangyang Wu, Xin Tao, Changlin Li, Wenyi Wang, Xiao- hong Liu, and Qingqing Zheng. Perception-oriented video frame interpolation via asymmetric blending. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2753–2762, 2024. 1
2024
-
[80]
Video in- terpolation by event-driven anisotropic adjustment of optical flow
Song Wu, Kaichao You, Weihua He, Chen Yang, Yang Tian, Yaoyuan Wang, Ziyang Zhang, and Jianxing Liao. Video in- terpolation by event-driven anisotropic adjustment of optical flow. In European Conference on Computer Vision , pages 267–283. Springer, 2022. 3
2022
-
[81]
Zooming slow-mo: Fast and accurate one-stage space-time video super-resolution
Xiaoyu Xiang, Yapeng Tian, Yulun Zhang, Yun Fu, Jan P Allebach, and Chenliang Xu. Zooming slow-mo: Fast and accurate one-stage space-time video super-resolution. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 3370–3379, 2020. 2, 3, 4, 6
2020
-
[82]
Ibvc: Interpolation-driven b-frame video compres- sion
Chenming Xu, Meiqin Liu, Chao Yao, Weisi Lin, and Yao Zhao. Ibvc: Interpolation-driven b-frame video compres- sion. Pattern Recognition, 153:110465, 2024. 1
2024
-
[83]
Temporal modulation network for con- trollable space-time video super-resolution
Gang Xu, Jun Xu, Zhen Li, Liang Wang, Xing Sun, and Ming-Ming Cheng. Temporal modulation network for con- trollable space-time video super-resolution. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 6388–6397, 2021. 3, 4, 6, 7
2021
-
[84]
Quadratic video interpolation
Xiangyu Xu, Li Siyao, Wenxiu Sun, Qian Yin, and Ming- Hsuan Yang. Quadratic video interpolation. Advances in Neural Information Processing Systems, 32, 2019. 2
2019
-
[85]
Im- plicit transformer network for screen content image continu- ous super-resolution
Jingyu Yang, Sheng Shen, Huanjing Yue, and Kun Li. Im- plicit transformer network for screen content image continu- ous super-resolution. Advances in Neural Information Pro- cessing Systems, 34:13304–13315, 2021. 3
2021
-
[86]
Progressive fusion video super-resolution network via exploiting non-local spatio-temporal correlations
Peng Yi, Zhongyuan Wang, Kui Jiang, Junjun Jiang, and Ji- ayi Ma. Progressive fusion video super-resolution network via exploiting non-local spatio-temporal correlations. InPro- ceedings of the IEEE/CVF international conference on com- puter vision, pages 3106–3115, 2019. 2
2019
-
[87]
Video object segmentation-aware video frame interpolation
Jun-Sang Yoo, Hongjae Lee, and Seung-Won Jung. Video object segmentation-aware video frame interpolation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 12322–12333, 2023. 1
2023
-
[88]
Memory- augmented non-local attention for video super-resolution
Jiyang Yu, Jingen Liu, Liefeng Bo, and Tao Mei. Memory- augmented non-local attention for video super-resolution. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 17834–17843, 2022. 2
2022
-
[89]
Training weakly super- vised video frame interpolation with events
Zhiyang Yu, Yu Zhang, Deyuan Liu, Dongqing Zou, Xijun Chen, Yebin Liu, and Jimmy S Ren. Training weakly super- vised video frame interpolation with events. In Proceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 14589–14598, 2021. 2
2021
-
[90]
Extracting motion and ap- pearance via inter-frame attention for efficient video frame interpolation
Guozhen Zhang, Yuhan Zhu, Haonan Wang, Youxin Chen, Gangshan Wu, and Limin Wang. Extracting motion and ap- pearance via inter-frame attention for efficient video frame interpolation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 5...
2023
-
[91]
Two-stream action recognition-oriented video super-resolution
Haochen Zhang, Dong Liu, and Zhiwei Xiong. Two-stream action recognition-oriented video super-resolution. In Pro- ceedings of the IEEE/CVF international conference on com- puter vision, pages 8799–8808, 2019. 1
2019
-
[92]
Revisiting temporal alignment for video restora- tion
Kun Zhou, Wenbo Li, Liying Lu, Xiaoguang Han, and Jiangbo Lu. Revisiting temporal alignment for video restora- tion. In Proceedings of the IEEE/CVF conference on com- puter vision and pattern recognition , pages 6053–6062,
-
[93]
Video super-resolution trans- former with masked inter&intra-frame attention
Xingyu Zhou, Leheng Zhang, Xiaorui Zhao, Keze Wang, Leida Li, and Shuhang Gu. Video super-resolution trans- former with masked inter&intra-frame attention. InProceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 25399–25408, 2024. 2
2024
-
[94]
De- formable convnets v2: More deformable, better results
Xizhou Zhu, Han Hu, Stephen Lin, and Jifeng Dai. De- formable convnets v2: More deformable, better results. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 9308–9316, 2019. 4, 6 14 LR Frames LR Events TimeLens[70] +EvTexture[32] CB...
2019
-
[2017]
1, 2, 6, 7, 8, 9, 18, 19
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.