Pith. sign in

REVIEW 2 major objections 1 minor 31 references

StableNet: Semi-Online, Multi-Scale Deep Video Stabilization

T0 review · 2 major / 1 minor · reviewed 2026-05-24 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A multi-scale neural network learns to stabilize video frames by outputting affine transformations after training on synthesized shaky footage.

desk verdict The paper gives a multi-scale learned affine predictor for online stabilization plus a synthetic dataset, but the results stay tied to that data with no clear real-world validation. read the letter →

arxiv 1907.10283 v1 pith:UHWL5HWY submitted 2019-07-24 cs.CV eess.IV

Chia-Hung Huang , Hang Yin , Yu-Wing Tai , Chi-Keung Tang This is my paper · ORCID
classification cs.CVeess.IV
keywords videostabilizationdeeplearningaffinetransformationmulti-scalenetworkonlineprocessingsyntheticdatasethandheld
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper introduces StableNet, a data-driven method that processes each unsteady video frame progressively across scales from low to high resolution and predicts an affine transform to correct shake. The approach runs online, frame by frame, and learns the stabilization mapping implicitly from paired training data rather than relying on explicit feature tracking or optical flow. Because public stabilization datasets are scarce, the authors create their own by synthesizing unstable videos that vary in shake intensity to mimic handheld camera motion. Experiments indicate the resulting model matches or exceeds prior methods on several test clips and remains effective on complex scene content it never saw during training.

What carries the argument

The multi-scale network that ingests an unsteady frame at successively higher resolutions and regresses an affine transformation matrix to stabilize it.

What would settle it

Measure stabilization quality on a set of real handheld videos captured independently of the synthesis process and compare against the performance reported on the synthetic test set.

Watch

Extended reading notes

Core claim

The central claim is that an end-to-end multi-scale network can be trained to perform online video stabilization by directly regressing per-frame affine transformations from synthetic shaky-stable pairs, eliminating the need for separate motion estimation steps while generalizing to unseen complex footage.

Load-bearing premise

Synthesized videos with varying shake extents accurately replicate real handheld camera motion so that training on them produces a model that works on genuine footage.

Editorial extensions

If this is right

  • Stabilization becomes possible without separate feature tracking or optical-flow computation at runtime.
  • The method operates online, producing a stabilized output for each frame as soon as it arrives.
  • A single model trained on synthetic data can dampen shake in scene types it was never explicitly shown.
  • The same progressive multi-scale architecture could be applied to other per-frame geometric correction tasks.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Real-time deployment on mobile devices becomes feasible once the network is quantized or distilled, because no external motion estimators are required.
  • Collecting a modest amount of real paired data could further close any remaining domain gap between synthetic and genuine camera motion.
  • The learned affine corrections might serve as a lightweight prior for more expressive stabilization models that also handle rolling-shutter or parallax effects.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 1 minor

Summary. The paper proposes StableNet, a semi-online multi-scale deep network for video stabilization that progressively processes frames from low to high resolution to predict stabilizing affine transformations. It introduces a paired dataset of synthesized unstable videos with varying shake extents that are claimed to simulate real-life camera motion, and reports that the method outperforms prior approaches on several unstable samples while remaining comparable in general and showing robustness on complex content not seen during training.

Significance. If the synthetic data accurately reproduces the statistics of real handheld camera trajectories and the learned model generalizes, the implicit multi-scale affine prediction approach could provide an efficient online alternative to explicit feature-tracking or optical-flow methods. The design avoids per-frame feature extraction, which is a practical strength if the performance claims hold on real footage.

major comments (2)
  1. [Abstract] Abstract and dataset section: The central performance and generalization claims rest on the assertion that 'synthesized unstable videos with different extent of shake ... simulate real-life camera movement,' yet the manuscript supplies no description of the generative process (2-D affine vs. 3-D paths, inclusion of parallax, frequency content of trajectories, or any quantitative match to real handheld statistics). This is load-bearing for the reported outperformance and robustness results.
  2. [Experiments] Experiments section: The abstract states outperformance 'in several unstable samples' and robustness on untrained complex content, but without visible quantitative tables, standard metrics (cropping ratio, distortion, inter-frame consistency), held-out real-world test sets, or comparison against public benchmarks, it is impossible to assess whether gains are supported or affected by sample selection.
minor comments (1)
  1. [Abstract] The term 'semi-online' is introduced in the title and abstract but is not explicitly defined relative to fully online or offline methods.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive feedback. We address the two major comments point by point below, indicating planned revisions where the manuscript requires strengthening.

read point-by-point responses

  1. Referee: [Abstract] Abstract and dataset section: The central performance and generalization claims rest on the assertion that 'synthesized unstable videos with different extent of shake ... simulate real-life camera movement,' yet the manuscript supplies no description of the generative process (2-D affine vs. 3-D paths, inclusion of parallax, frequency content of trajectories, or any quantitative match to real handheld statistics). This is load-bearing for the reported outperformance and robustness results.

    Authors: We agree that the current manuscript provides insufficient detail on the data synthesis procedure, which weakens the support for the generalization claims. The unstable videos were generated by applying controlled 2D affine perturbations to stable source videos, with shake extent varied across low, medium, and high levels; however, no explicit frequency matching or parallax modeling was performed. In the revised manuscript we will expand the dataset section with a full description of the generative process, the exact affine parameter ranges, and any quantitative comparison to real handheld trajectories that can be added. revision: yes

  2. Referee: [Experiments] Experiments section: The abstract states outperformance 'in several unstable samples' and robustness on untrained complex content, but without visible quantitative tables, standard metrics (cropping ratio, distortion, inter-frame consistency), held-out real-world test sets, or comparison against public benchmarks, it is impossible to assess whether gains are supported or affected by sample selection.

    Authors: The experiments section currently emphasizes qualitative visual results on selected synthesized samples and a limited number of real videos. We acknowledge that the absence of standard quantitative metrics and systematic benchmark comparisons makes it difficult to evaluate the strength of the performance claims. In the revision we will add tables reporting cropping ratio, distortion, and inter-frame consistency, include results on additional held-out real-world sequences, and provide comparisons against public stabilization benchmarks to allow a more objective assessment. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; empirical training on synthetic data does not reduce claims to self-definition

full rationale

The paper presents an empirical, data-driven neural network for video stabilization trained on author-synthesized unstable/stable pairs. No derivation chain, equations, or first-principles steps are described that reduce a claimed prediction or result to its own inputs by construction. The abstract explicitly states the network learns the process implicitly from training data and reports outperformance on samples from that process plus robustness on untrained complex content; this is standard supervised learning rather than any of the enumerated circularity patterns (self-definitional, fitted-input-called-prediction, self-citation load-bearing, etc.). No load-bearing self-citations, uniqueness theorems, or ansatzes are invoked. The evaluation uses the authors' own synthetic distribution, but the paper does not claim external real-world generalization as a derived theorem; the result remains self-contained as an empirical demonstration on the generated data.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

The central claim rests on the representativeness of the synthetic shake model and on the sufficiency of affine transforms; both are domain assumptions rather than derived quantities.

assumptions (2)
  • domain assumption Affine transformations are sufficient to model the dominant motion between consecutive frames in handheld video.
    The network outputs only an affine transform; this modeling choice is invoked in the abstract description of the output.
  • domain assumption Synthetic shake added to steady video produces training pairs whose distribution matches real handheld camera motion.
    The abstract states that unstable videos were synthesized to simulate real-life camera movement and used for training.

how reviews work

0 comments
Cite this review

Pith. "Pith review of StableNet: Semi-Online, Multi-Scale Deep Video Stabilization." pith.science (2026). https://pith.science/paper/UHWL5HWY

@misc{pith2026190710283,
  author       = {Pith},
  title        = {Pith review of: StableNet: Semi-Online, Multi-Scale Deep Video Stabilization},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/UHWL5HWY}},
  note         = {Machine review of arXiv:1907.10283}
}
read the original abstract

Video stabilization algorithms are of greater importance nowadays with the prevalence of hand-held devices which unavoidably produce videos with undesirable shaky motions. In this paper we propose a data-driven online video stabilization method along with a paired dataset for deep learning. The network processes each unsteady frame progressively in a multi-scale manner, from low resolution to high resolution, and then outputs an affine transformation to stabilize the frame. Different from conventional methods which require explicit feature tracking or optical flow estimation, the underlying stabilization process is learned implicitly from the training data, and the stabilization process can be done online. Since there are limited public video stabilization datasets available, we synthesized unstable videos with different extent of shake that simulate real-life camera movement. Experiments show that our method is able to outperform other stabilization methods in several unstable samples while remaining comparable in general. Also, our method is tested on complex contents and found robust enough to dampen these samples to some extent even it was not explicitly trained in the contents.

Figures

Figures reproduced from arXiv: 1907.10283 by the authors.

Figure 1
Figure 1. Overview of Multi-Scale StableNet. The input is a stack [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Network Architecture. The Multi-scale StableNet is based on Siamese architecture. Two consecutive unstable frames will be [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Implementation Details. All padding are in VALID [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: Frames from our dataset. The dataset consists of about 420 pairs of steady and synthesized shaky videos with three extents of [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: Fidelity experiments results. The fidelity is measured by calculating the average interframe PSNR (in dB): (a) shows the eval [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 6
Figure 6. Figure 6: Stability experiments results. Stability is measured based on the minimum energy percentage in rotation, horizontal translation and [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]
Figure 7
Figure 7. Figure 7: Fidelity and stability for (a) zooming and (b) parallax videos. Although there is no scaling or grid warping in the output affine [PITH_FULL_IMAGE:figures/full_fig_p008_7.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

31 extracted references · 31 canonical work pages

  1. [1]

    Bosco, A

    A. Bosco, A. Bruno, S. Battiato, G. Bella, and G. Puglisi. Digital video stabilization through curve warping tech- niques. IEEE Transactions on Consumer Electronics , 54(2):220–224, 2008. 2

    work page 2008

  2. [2]

    J.-Y . Bouguet. Pyramidal implementation of the affine lu- cas kanade feature tracker description of the algorithm. Intel Corporation, 5(1-10):4, 2001. 3, 4

    work page 2001

  3. [3]

    Chang, S.-H

    H.-C. Chang, S.-H. Lai, and K.-R. Lu. A robust and effi- cient video stabilization algorithm. In Multimedia and Expo,

    work page

  4. [4]

    2004 IEEE International Conference on , volume 1, pages 29–32

    ICME’04. 2004 IEEE International Conference on , volume 1, pages 29–32. IEEE, 2004. 2

    work page 2004

  5. [5]

    Goldstein and R

    A. Goldstein and R. Fattal. Video stabilization using epipo- lar geometry. ACM Transactions on Graphics (TOG) , 8 31(5):126, 2012. 2, 6, 7

    work page 2012

  6. [6]

    Grundmann, V

    M. Grundmann, V . Kwatra, and I. Essa. Auto-directed video stabilization with robust l1 optimal camera paths. In The IEEE Conference on Computer Vision and Pattern Recogni- tion (CVPR), pages 225–232. IEEE, 2011. 2, 6, 7

    work page 2011

  7. [7]

    R. Hu, R. Shi, I.-f. Shen, and W. Chen. Video stabilization using scale-invariant features. In Information Visualization,

    work page

  8. [8]

    11th International Conference, pages 871–877

    IV’07. 11th International Conference, pages 871–877. IEEE, 2007. 2

    work page 2007

Show all 31 references
  1. [9]

    J. S. Jin, Z. Zhu, and G. Xu. Digital video sequence stabi- lization based on 2.5 d motion estimation and inertial motion filtering. Real-Time Imaging, 7(4):357–365, 2001. 2

    2001

  2. [10]

    Karpenko, D

    A. Karpenko, D. Jacobs, J. Baek, and M. Levoy. Digital video stabilization and rolling shutter correction using gyro- scopes. CSTR, 1:2, 2011. 2

    2011

  3. [11]

    D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. CoRR, abs/1412.6980, 2014. 5

    2014 arXiv

  4. [12]

    Lee, Y .-Y

    K.-Y . Lee, Y .-Y . Chuang, B.-Y . Chen, and M. Ouhyoung. Video stabilization using robust feature trajectories. InCom- puter Vision, 2009 IEEE 12th International Conference on , pages 1397–1404. IEEE, 2009. 2

    2009

  5. [13]

    P. Lei, F. Li, and S. Todorovic. Boundary flow: A siamese network that predicts boundary motion without training on motion. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018. 4

    2018

  6. [14]

    Litvin, J

    A. Litvin, J. Konrad, and W. C. Karl. Probabilistic video sta- bilization using kalman filtering and mosaicing. In Image and Video Communications and Processing 2003 , volume 5022, pages 663–675. International Society for Optics and Photonics, 2003. 2

    2003

  7. [15]

    F. Liu, M. Gleicher, H. Jin, and A. Agarwala. Content- preserving warps for 3d video stabilization. In ACM Trans- actions on Graphics (TOG) , volume 28, page 44. ACM,

  8. [16]

    F. Liu, M. Gleicher, J. Wang, H. Jin, and A. Agarwala. Sub- space video stabilization. ACM Transactions on Graphics (TOG), 30(1):4, 2011. 2

    2011

  9. [17]

    S. Liu, P. Tan, L. Yuan, J. Sun, and B. Zeng. Meshflow: Minimum latency online video stabilization. In European Conference on Computer Vision , pages 800–815. Springer,

  10. [18]

    S. Liu, L. Yuan, P. Tan, and J. Sun. Bundled camera paths for video stabilization. ACM Transactions on Graphics (TOG), 32(4):78, 2013. 2, 6, 7

    2013

  11. [19]

    S. Liu, L. Yuan, P. Tan, and J. Sun. Steadyflow: Spatially smooth optical flow for video stabilization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4209–4216, 2014. 2

    2014

  12. [20]

    Matsushita, E

    Y . Matsushita, E. Ofek, W. Ge, X. Tang, and H.-Y . Shum. Full-frame video stabilization with motion inpainting. IEEE Transactions on pattern analysis and Machine Intelligence , 28(7):1150–1163, 2006. 2

    2006

  13. [21]

    Morimoto and R

    C. Morimoto and R. Chellappa. Evaluation of image stabi- lization algorithms. In 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP ’98 (Cat. No.98CH36181) , volume 5, pages 2789–2792 vol.5, May 1998. 6

    1998

  14. [22]

    Oreifej, X

    O. Oreifej, X. Li, and M. Shah. Simultaneous video stabi- lization and moving object detection in turbulence. IEEE transactions on pattern analysis and machine intelligence , 35(2):450–462, 2013. 2

    2013

  15. [23]

    Ratakonda

    K. Ratakonda. Real-time digital video stabilization for multi- media applications. In Circuits and Systems, 1998. IS- CAS’98. Proceedings of the 1998 IEEE International Sym- posium on, volume 4, pages 69–72. IEEE, 1998. 2

    1998

  16. [24]

    Shi and Tomasi

    J. Shi and Tomasi. Good features to track. In 1994 Proceed- ings of IEEE Conference on Computer Vision and Pattern Recognition, pages 593–600, June 1994. 4

    1994

  17. [25]

    S. Su, M. Delbracio, J. Wang, G. Sapiro, W. Heidrich, and O. Wang. Deep video deblurring for hand-held cameras. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), volume 2, page 6, 2017. 1

    2017

  18. [26]

    Tulyakov, M.-Y

    S. Tulyakov, M.-Y . Liu, X. Yang, and J. Kautz. Moco- gan: Decomposing motion and content for video generation. arXiv preprint arXiv:1707.04993, 2017. 1

    2017 arXiv

  19. [27]

    Wang, G.-Y

    M. Wang, G.-Y . Yang, J.-K. Lin, A. Shamir, S.-H. Zhang, S.- P. Lu, and S.-M. Hu. Deep online video stabilization. arXiv preprint arXiv:1802.08091, 2018. 3, 6

    2018 arXiv

  20. [28]

    J. Yang, D. Schonfeld, C. Chen, and M. Mohamed. Online video stabilization based on particle filters. In 2006 Interna- tional Conference on Image Processing , pages 1545–1548, Oct 2006. 7

    2006

  21. [29]

    J. Yang, D. Schonfeld, and M. Mohamed. Robust video sta- bilization based on particle filter tracking of projected cam- era motion. IEEE Transactions on Circuits and Systems for Video Technology, 19(7):945–954, 2009. 2

    2009

  22. [30]

    Zhang, W

    G. Zhang, W. Hua, X. Qin, Y . Shao, and H. Bao. Video stabilization based on a 3d perspective camera model. The Visual Computer, 25(11):997, 2009. 2

    2009

  23. [31]

    F. Zhu, Z. Yan, J. Bu, and Y . Yu. Exemplar-based image and video stylization using fully convolutional semantic features. IEEE Transactions on Image Processing, 26(7):3542–3555,

Pith tools

Reviewed May 24, 2026 · model on record in the stance chip above.