RECORD
RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning
Computer Vision and Pattern Recognition · Submitted 4 Jan 2023
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim Experiments show the superiority of our solution over the compared methods on both quantitative and qualitative evaluations.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
The wide-angle lens shows appealing applications in VR technologies, but it introduces severe radial distortion into its captured image. To recover the realistic scene, previous works devote to rectifying the content of the wide-angle image. However, such a rectification solution inevitably distorts the image boundary, which changes related geometric distributions and misleads the current vision perception models. In this work, we explore constructing a win-win representation on both content and boundary by contributing a new learning model, i.e., Rectangling Rectification Network (RecRecNet). In particular, we propose a thin-plate spline (TPS) module to formulate the non-linear and non-rigid transformation for rectangling images. By learning the control points on the rectified image, our model can flexibly warp the source structure to the target domain and achieves an end-to-end unsupervised deformation. To relieve the complexity of structure approximation, we then inspire our RecRecNet to learn the gradual deformation rules with a DoF (Degree of Freedom)-based curriculum learning. By increasing the DoF in each curriculum stage, namely, from similarity transformation (4-DoF) to homography transformation (8-DoF), the network is capable of investigating more detailed deformations, offering fast convergence on the final rectangling task. Experiments show the superiority of our solution over the compared methods on both quantitative and qualitative evaluations. The code and dataset are available at https://github.com/KangLiao929/RecRecNet.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | The wide-angle lens shows appealing applications in VR technologies, but it introduces severe radial distortion into its captured image. | background 1.00 | 0.07 | 0.02 | asserted 1.00 |
| s1 | To recover the realistic scene, previous works devote to rectifying the content of the wide-angle image. | background 1.00 | 0.03 | 0.02 | asserted 1.00 |
| s2 | However, such a rectification solution inevitably distorts the image boundary, which changes related geometric distributions and misleads the current vision perception models. | gap 0.64 | 0.08 | 0.04 | asserted 1.00 |
| s3 | In this work, we explore constructing a win-win representation on both content and boundary by contributing a new learning model, i.e., Rectangling Rectification Network (RecRecNet). | contribution 1.00 | 0.87 | 0.23 | asserted 0.97 |
| s4 | In particular, we propose a thin-plate spline (TPS) module to formulate the non-linear and non-rigid transformation for rectangling images. | method 0.82 | 0.90 | 0.04 | asserted 1.00 |
| s5 | By learning the control points on the rectified image, our model can flexibly warp the source structure to the target domain and achieves an end-to-end unsupervised deformation. | method 0.99 | 0.88 | 0.06 | asserted 0.98 |
| s6 | To relieve the complexity of structure approximation, we then inspire our RecRecNet to learn the gradual deformation rules with a DoF (Degree of Freedom)-based curriculum learning. | method 0.89 | 0.86 | 0.04 | asserted 0.87 |
| s7 | By increasing the DoF in each curriculum stage, namely, from similarity transformation (4-DoF) to homography transformation (8-DoF), the network is capable of investigating more detailed deformations, offering fast convergence on the final rectangling task. | method 0.99 | 0.90 | 0.07 | asserted 0.86 |
| s8 | Experiments show the superiority of our solution over the compared methods on both quantitative and qualitative evaluations. | result 1.00 | 0.95 | 0.69 | asserted 1.00 |
| s9 | The code and dataset are available at https://github.com/KangLiao929/RecRecNet. | contribution 0.44 | 0.46 | 0.02 | asserted 0.96 |
What was examined, and what was not
- arXiv listing abstract v2
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
The wide-angle lens shows appealing applications in VR technologies, but it introduces severe radial distortion into its captured image. To recover the realistic scene, previous works devote to rectifying the content of the wide-angle image. However, such a rectification solution inevitably distorts the image boundary, which changes related geometric distributions and misleads the current vision perception models. In this work, we explore constructing a win-win representation on both content and boundary by contributing a new learning model, i.e., Rectangling Rectification Network (RecRecNet). In particular, we propose a thin-plate spline (TPS) module to formulate the non-linear and non-rigid transformation for rectangling images. By learning the control points on the rectified image, our model can flexibly warp the source structure to the target domain and achieves an end-to-end unsupervised deformation. To relieve the complexity of structure approximation, we then inspire our RecRecNet to learn the gradual deformation rules with a DoF (Degree of Freedom)-based curriculum learning. By increasing the DoF in each curriculum stage, namely, from similarity transformation (4-DoF) to homography transformation (8-DoF), the network is capable of investigating more detailed deformations, offering fast convergence on the final rectangling task. Experiments show the superiority of our solution over the compared methods on both quantitative and qualitative evaluations. The code and dataset are available at https://github.com/KangLiao929/RecRecNet.
Human review
How the literature uses it
2 arXiv papers cite this in 3 sentences
Papers citing it
Cites it as background 2 papers
-
Rectangling aims to obtain regular rectangular boundaries from irregular ones (e.g., stitched image [ref] , rigidly rotated image [ref] , and rectified wide-angle image [ref] ) via warping.
Semi-Supervised Coupled Thin-Plate Spline Model for Rotation Correction and Beyond · Rectangling · 0.91
-
RecRecNet [ref] rectangles rectified wide-angle via curriculum learning with increasing degree of freedom.
FishDreamer: Towards Fisheye Semantic Completion via Unified Image Outpainting and Segmentation · Related Work · 0.97
What it cites
Contests 1 paper
-
While some works [ref] fill the blank region beyond deformed boundaries using outpainting strategy [ref] , the generated contents are usually fictitious and twist the original semantic characterization.
Painting Outside the Box: Image Outpainting with GANs · Introduction · contest 0.71
Uses the method or tool of 1 paper
-
Experimental Configuration: We train RecRecNet with an exponentially decaying learning rate with an initial value of $10^-4$ using Adam [ref] .
Adam: A Method for Stochastic Optimization · Implementation Details · 1.00
Cites as background 3 papers
-
Particularly in computer vision, curriculum learning has been investigated to inspire the learning networks on image classification [ref] , object detection [ref] , and semantic segmentation [ref] , etc.
Multiple Instance Curriculum Learning for Weakly Supervised Object Detection · Curriculum Learning · 0.94
-
Particularly in computer vision, curriculum learning has been investigated to inspire the learning networks on image classification [ref] , object detection [ref] , and semantic segmentation [ref] , etc.
DMT: Dynamic Mutual Training for Semi-Supervised Learning · Curriculum Learning · 0.94
-
The wide-angle lens has been widely applied in various applications such as computational imaging, virtual reality (VR), and autonomous driving, due to their larger field of view (FoV) than conventional lenses [ref] .
Deep Learning for Camera Calibration and Beyond: A Survey · Introduction · 0.95
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.