Unsupervised joint semantic instance segmentation, 4D reconstruction, and scene flow from multi-view video of multi-person dynamic scenes, with reported ~40% gains over prior methods.
hub
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
10 Pith papers cite this work. Polarity classification is still indexing.
abstract
In this work we address the task of semantic image segmentation with Deep Learning and make three main contributions that are experimentally shown to have substantial practical merit. First, we highlight convolution with upsampled filters, or 'atrous convolution', as a powerful tool in dense prediction tasks. Atrous convolution allows us to explicitly control the resolution at which feature responses are computed within Deep Convolutional Neural Networks. It also allows us to effectively enlarge the field of view of filters to incorporate larger context without increasing the number of parameters or the amount of computation. Second, we propose atrous spatial pyramid pooling (ASPP) to robustly segment objects at multiple scales. ASPP probes an incoming convolutional feature layer with filters at multiple sampling rates and effective fields-of-views, thus capturing objects as well as image context at multiple scales. Third, we improve the localization of object boundaries by combining methods from DCNNs and probabilistic graphical models. The commonly deployed combination of max-pooling and downsampling in DCNNs achieves invariance but has a toll on localization accuracy. We overcome this by combining the responses at the final DCNN layer with a fully connected Conditional Random Field (CRF), which is shown both qualitatively and quantitatively to improve localization performance. Our proposed "DeepLab" system sets the new state-of-art at the PASCAL VOC-2012 semantic image segmentation task, reaching 79.7% mIOU in the test set, and advances the results on three other datasets: PASCAL-Context, PASCAL-Person-Part, and Cityscapes. All of our code is made publicly available online.
hub tools
citation-role summary
citation-polarity summary
verdicts
UNVERDICTED 10roles
method 1polarities
extend 1representative citing papers
SegRAG is a training-free retrieval-augmented framework that extracts class-specific point prompts from a filtered DINOv3 feature bank to boost SAM3 semantic segmentation performance on standard and agricultural benchmarks.
InCoM achieves 23-28% higher success rates in mobile manipulation tasks by inferring motion intent for adaptive perception and decoupling base-arm action generation.
DeepLabv3 improves semantic segmentation by capturing multi-scale context with cascaded or parallel atrous convolutions and adding global context to ASPP, achieving better results on PASCAL VOC 2012 without DenseCRF post-processing.
Defining egoistic and altruistic cost functions for class confusions in semantic segmentation changes precision, recall, and segment-wise error rates relative to standard MAP decisions.
A cGAN method with edge-filtered combined inputs generates synthetic polyp images from normal colonoscopy frames to augment training data and improve detection performance.
Adapted Mask-RCNN to 3D and applied it to lung nodule detection and segmentation on CT scans, reporting competitive detection results on the LUNA16 dataset.
A dual-stream fully convolutional network produces competitive character error rates on IAM and RIMES handwriting datasets while avoiding CTC, dictionaries, and heavy preprocessing.
SANet adds a re-sampling-based scale-aware module to semantic segmentation networks to better handle inconsistent object scales in aerial images.
Slim-Net uses stacked Slim Modules of depthwise separable convolutions to predict face attributes on CelebA at 91.24% accuracy with at least 25 times fewer parameters than comparable models.
citing papers explorer
-
U4D: Unsupervised 4D Dynamic Scene Understanding
Unsupervised joint semantic instance segmentation, 4D reconstruction, and scene flow from multi-view video of multi-person dynamic scenes, with reported ~40% gains over prior methods.
-
SegRAG: Training-Free Retrieval-Augmented Semantic Segmentation
SegRAG is a training-free retrieval-augmented framework that extracts class-specific point prompts from a filtered DINOv3 feature bank to boost SAM3 semantic segmentation performance on standard and agricultural benchmarks.
-
InCoM: Intent-Driven Perception and Structured Coordination for Mobile Manipulation
InCoM achieves 23-28% higher success rates in mobile manipulation tasks by inferring motion intent for adaptive perception and decoupling base-arm action generation.
-
Rethinking Atrous Convolution for Semantic Image Segmentation
DeepLabv3 improves semantic segmentation by capturing multi-scale context with cascaded or parallel atrous convolutions and adding global context to ASPP, achieving better results on PASCAL VOC 2012 without DenseCRF post-processing.
-
The Ethical Dilemma when (not) Setting up Cost-based Decision Rules in Semantic Segmentation
Defining egoistic and altruistic cost functions for class confusions in semantic segmentation changes precision, recall, and segment-wise error rates relative to standard MAP decisions.
-
Abnormal Colon Polyp Image Synthesis Using Conditional Adversarial Networks for Improved Detection Performance
A cGAN method with edge-filtered combined inputs generates synthetic polyp images from normal colonoscopy frames to augment training data and improve detection performance.
-
Lung Nodules Detection and Segmentation Using 3D Mask-RCNN
Adapted Mask-RCNN to 3D and applied it to lung nodule detection and segmentation on CT scans, reporting competitive detection results on the LUNA16 dataset.
-
Fully Convolutional Networks for Handwriting Recognition
A dual-stream fully convolutional network produces competitive character error rates on IAM and RIMES handwriting datasets while avoiding CTC, dictionaries, and heavy preprocessing.
-
SAN: Scale-Aware Network for Semantic Segmentation of High-Resolution Aerial Images
SANet adds a re-sampling-based scale-aware module to semantic segmentation networks to better handle inconsistent object scales in aerial images.
-
Slim-CNN: A Light-Weight CNN for Face Attribute Prediction
Slim-Net uses stacked Slim Modules of depthwise separable convolutions to predict face attributes on CelebA at 91.24% accuracy with at least 25 times fewer parameters than comparable models.