RECORD
MVImgNet: A Large-scale Dataset of Multi-view Images
Computer Vision and Pattern Recognition · Submitted 10 Mar 2023
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim We conduct pilot studies for probing the potential of MVImgNet on a variety of 3D and 2D visual tasks, including radiance field reconstruction, multi-view stereo, and view-consistent image understanding, where MVImgNet demonstrates promising performance, remaining lots of possibilities for future explorations.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Being data-driven is one of the most iconic properties of deep learning algorithms. The birth of ImageNet drives a remarkable trend of "learning from large-scale data" in computer vision. Pretraining on ImageNet to obtain rich universal representations has been manifested to benefit various 2D visual tasks, and becomes a standard in 2D vision. However, due to the laborious collection of real-world 3D data, there is yet no generic dataset serving as a counterpart of ImageNet in 3D vision, thus how such a dataset can impact the 3D community is unraveled. To remedy this defect, we introduce MVImgNet, a large-scale dataset of multi-view images, which is highly convenient to gain by shooting videos of real-world objects in human daily life. It contains 6.5 million frames from 219,188 videos crossing objects from 238 classes, with rich annotations of object masks, camera parameters, and point clouds. The multi-view attribute endows our dataset with 3D-aware signals, making it a soft bridge between 2D and 3D vision. We conduct pilot studies for probing the potential of MVImgNet on a variety of 3D and 2D visual tasks, including radiance field reconstruction, multi-view stereo, and view-consistent image understanding, where MVImgNet demonstrates promising performance, remaining lots of possibilities for future explorations. Besides, via dense reconstruction on MVImgNet, a 3D object point cloud dataset is derived, called MVPNet, covering 87,200 samples from 150 categories, with the class label on each point cloud. Experiments show that MVPNet can benefit the real-world 3D object classification while posing new challenges to point cloud understanding. MVImgNet and MVPNet will be publicly available, hoping to inspire the broader vision community.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Being data-driven is one of the most iconic properties of deep learning algorithms. | background 1.00 | 0.03 | 0.02 | asserted 1.00 |
| s1 | The birth of ImageNet drives a remarkable trend of "learning from large-scale data" in computer vision. | background 1.00 | 0.04 | 0.02 | asserted 1.00 |
| s2 | Pretraining on ImageNet to obtain rich universal representations has been manifested to benefit various 2D visual tasks, and becomes a standard in 2D vision. | background 1.00 | 0.05 | 0.03 | asserted 1.00 |
| s3 | However, due to the laborious collection of real-world 3D data, there is yet no generic dataset serving as a counterpart of ImageNet in 3D vision, thus how such a dataset can impact the 3D community is unraveled. | gap 1.00 | 0.06 | 0.04 | asserted 0.74 |
| s4 | To remedy this defect, we introduce MVImgNet, a large-scale dataset of multi-view images, which is highly convenient to gain by shooting videos of real-world objects in human daily life. | contribution 0.99 | 0.90 | 0.08 | asserted 1.00 |
| s5 | It contains 6.5 million frames from 219,188 videos crossing objects from 238 classes, with rich annotations of object masks, camera parameters, and point clouds. | contribution 0.64 | 0.94 | 0.04 | asserted 1.00 |
| s6 | The multi-view attribute endows our dataset with 3D-aware signals, making it a soft bridge between 2D and 3D vision. | interpretation 0.75 | 0.55 | 0.08 | asserted 0.99 |
| s7 | We conduct pilot studies for probing the potential of MVImgNet on a variety of 3D and 2D visual tasks, including radiance field reconstruction, multi-view stereo, and view-consistent image understanding, where MVImgNet demonstrates promising performance, remaining lots of possibilities for future explorations. | result 0.84 | 0.97 | 0.54 | asserted 0.96 |
| s8 | Besides, via dense reconstruction on MVImgNet, a 3D object point cloud dataset is derived, called MVPNet, covering 87,200 samples from 150 categories, with the class label on each point cloud. | contribution 0.87 | 0.97 | 0.07 | asserted 1.00 |
| s9 | Experiments show that MVPNet can benefit the real-world 3D object classification while posing new challenges to point cloud understanding. | result 0.77 | 0.94 | 0.15 | asserted 1.00 |
| s10 | MVImgNet and MVPNet will be publicly available, hoping to inspire the broader vision community. | future work 0.63 | 0.41 | 0.11 | asserted 0.85 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Being data-driven is one of the most iconic properties of deep learning algorithms. The birth of ImageNet drives a remarkable trend of "learning from large-scale data" in computer vision. Pretraining on ImageNet to obtain rich universal representations has been manifested to benefit various 2D visual tasks, and becomes a standard in 2D vision. However, due to the laborious collection of real-world 3D data, there is yet no generic dataset serving as a counterpart of ImageNet in 3D vision, thus how such a dataset can impact the 3D community is unraveled. To remedy this defect, we introduce MVImgNet, a large-scale dataset of multi-view images, which is highly convenient to gain by shooting videos of real-world objects in human daily life. It contains 6.5 million frames from 219,188 videos crossing objects from 238 classes, with rich annotations of object masks, camera parameters, and point clouds. The multi-view attribute endows our dataset with 3D-aware signals, making it a soft bridge between 2D and 3D vision. We conduct pilot studies for probing the potential of MVImgNet on a variety of 3D and 2D visual tasks, including radiance field reconstruction, multi-view stereo, and view-consistent image understanding, where MVImgNet demonstrates promising performance, remaining lots of possibilities for future explorations. Besides, via dense reconstruction on MVImgNet, a 3D object point cloud dataset is derived, called MVPNet, covering 87,200 samples from 150 categories, with the class label on each point cloud. Experiments show that MVPNet can benefit the real-world 3D object classification while posing new challenges to point cloud understanding. MVImgNet and MVPNet will be publicly available, hoping to inspire the broader vision community.
Human review
References
How the literature uses it
1 arXiv paper cite this in 2 sentences
What it cites · 11 sentences without a confident label
Uses the method or tool of 1 paper
-
For each iteration, we randomly sample two frames from the same video as the positive pair and apply the original data augmentations used in MoCo-v2 [ref] .
Improved Baselines with Momentum Contrastive Learning · View-consistent Contrastive Learning · 0.99
Uses data or values from 1 paper
-
which include Google Scanned Objects [ref] , RealEstate10K [ref] , the Spaces dataset [ref] , and 102 real scenes from handheld cellphone captures.
Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Items · 3D Reconstruction · 0.99
Cites as support 1 paper
-
Moreover, for image understanding, although humans can easily recognize one object from different viewpoints, deep learning models can hardly do that robustly [ref] .
ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpoints · Introduction · 0.96
Cites as background 7 papers
-
One key factor of CL is the construction of positive/negative pairs, , MoCo-v2 [ref] treats an image with different augmentations, a.k.a. views, as the positive pair.
Improved Baselines with Momentum Contrastive Learning · View-consistent Contrastive Learning · 0.84
-
Some works also construct synthetic multi-view datasets [ref] .
HM3D-ABO: A Photo-realistic Dataset for Object-centric Multi-view 3D Reconstruction · Related Work · 0.93
-
Some works also construct synthetic multi-view datasets [ref] .
ShapeNet: An Information-Rich 3D Model Repository · Related Work · 0.93
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.