Multi-Scale Context Aggregation by Dilated Convolutions
read the original abstract
State-of-the-art models for semantic segmentation are based on adaptations of convolutional networks that had originally been designed for image classification. However, dense prediction and image classification are structurally different. In this work, we develop a new convolutional network module that is specifically designed for dense prediction. The presented module uses dilated convolutions to systematically aggregate multi-scale contextual information without losing resolution. The architecture is based on the fact that dilated convolutions support exponential expansion of the receptive field without loss of resolution or coverage. We show that the presented context module increases the accuracy of state-of-the-art semantic segmentation systems. In addition, we examine the adaptation of image classification networks to dense prediction and show that simplifying the adapted network can increase accuracy.
This paper has not been read by Pith yet.
Forward citations
Cited by 32 Pith papers
-
WaveNet: A Generative Model for Raw Audio
WaveNet generates realistic raw audio using an autoregressive neural network with dilated convolutions, achieving state-of-the-art naturalness in speech synthesis for English and Mandarin.
-
Density estimation using Real NVP
Real NVP uses affine coupling layers to create invertible transformations that support exact density estimation, sampling, and latent inference without approximations.
-
WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning
WD-FQDet decouples modality-shared and modality-specific features in infrared-visible images via wavelet-based frequency decomposition and frequency-aware query selection to achieve state-of-the-art detection performance.
-
Graph-based Semantic Calibration Network for Unaligned UAV RGBT Image Semantic Segmentation and A Large-scale Benchmark
GSCNet with FDAM and SGCM modules plus the URTF benchmark improves fine-grained semantic segmentation on unaligned UAV RGBT images.
-
KAConvNet: Kolmogorov-Arnold Convolutional Networks for Vision Recognition
KAConvNet introduces a Kolmogorov-Arnold Convolutional Layer to build networks competitive with ViTs and CNNs while offering stronger theoretical interpretability.
-
Cross-Stage Attention Propagation for Efficient Semantic Segmentation
CSAP computes attention at the deepest scale and propagates the maps to shallower stages, bypassing per-scale query-key computations to cut decoder FLOPs while preserving multi-scale performance and beating SegNeXt-Ti...
-
Rethink the Role of Neural Decoders in Quantum Error Correction
Neural decoders for surface-code QEC achieve practical microsecond FPGA latency when trained on large datasets with appropriate inductive biases and INT4 quantization, rather than relying on architectural complexity.
-
YOTOnet: Zero-Shot Cross-Domain Fault Diagnosis via Domain-Conditioned Mixture of Experts
YOTOnet achieves improved zero-shot cross-domain fault diagnosis on bearing datasets by combining a physics-aware invariant feature distiller with domain-conditioned sparse experts, showing performance scaling as more...
-
Single Level Feature-to-Feature Forecasting with Deformable Convolutions
Single-level feature-to-feature forecasting with deformable convolutions on coarse abstract features from a segmentation backbone achieves state-of-the-art results for nine-timestep future semantic segmentation on Cit...
-
VRSTC: Occlusion-Free Video Person Re-Identification
STCnet recovers occluded parts in video person re-ID using spatio-temporal cues to form the VRSTC framework, outperforming prior methods on three datasets.
-
ASCNet: Adaptive-Scale Convolutional Neural Networks for Multi-Scale Feature Learning
ASCNet learns per-pixel adaptive dilation rates via a 3-layer convolution structure to produce scale-appropriate receptive fields, yielding higher segmentation accuracy than fixed dilated CNNs on two medical image datasets.
-
Jointly Aligning and Predicting Continuous Emotion Annotations
A multi-delay sinc network jointly aligns speech signals with delayed continuous emotion labels and predicts arousal/valence, claiming state-of-the-art speech-only results on RECOLA and SEWA.
-
Modeling Embedding Dimension Correlations via Convolutional Neural Collaborative Filtering
ConvNCF improves neural collaborative filtering by explicitly modeling pairwise correlations via outer product and high-order correlations via CNN on user-item embeddings.
-
AI-Empowered Low-Altitude Economy: Cooperative Sensing With Fixed Wireless Access
Cooperative AI sensing with FWA CPEs using CSI features, attention, and Transformer achieves 0.63% missed detection and 6.5m positioning error for UAVs.
-
Machine Learning Enhanced Laser Spectroscopy for Multi-Species Gas Detection in Complex and Harsh Environments
Machine learning methods including denoising autoencoders, unsupervised interference mitigation, blind source separation, and certifiable classification are developed and experimentally validated to improve multi-spec...
-
Breaking the Resource Wall: Geometry-Guided Sequence Modeling for Efficient Semantic Segmentation
DGM-Net reaches 82.3% mIoU on Cityscapes and 45.24% on ADE20K using directional geometric guidance inside a linear-complexity Mamba backbone, without heavy pretraining or large models.
-
Cross Attention Network for Semantic Segmentation
Cross Attention Network fuses spatial and contextual features via a cross attention module to improve semantic segmentation performance and speed on Cityscapes and CamVid.
-
Attentive CT Lesion Detection Using Deep Pyramid Inference with Multi-Scale Booster
A Multi-Scale Booster with hierarchical dilated convolutions and attention modules integrated into FPN improves lesion detection accuracy on the DeepLesion dataset over prior methods.
-
The Ethical Dilemma when (not) Setting up Cost-based Decision Rules in Semantic Segmentation
Defining egoistic and altruistic cost functions for class confusions in semantic segmentation changes precision, recall, and segment-wise error rates relative to standard MAP decisions.
-
An Efficient Solution for Breast Tumor Segmentation and Classification in Ultrasound Images Using Deep Adversarial Learning
cGAN with atrous convolutions and channel weighting segments breast tumors in ultrasound at 93.76% Dice and 88.82% IoU, then classifies benign vs malignant at 85% accuracy using boundary shape features.
-
Boosting the rule-out accuracy of deep disease detection using class weight modifiers
Class weight modifiers applied to 'no mention' cases in the loss function improve rule-out performance for negated disease findings in deep classifiers trained on chest X-ray data derived from clinical notes.
-
SpineContextResUNet: A Computationally Efficient Residual UNet for Spine CT Segmentation
SpineContextResUNet achieves Dice scores of 88.17% on VerSe2020 and 88.13% on CTSpine1K while using ~1.7M parameters and running inference on commodity hardware with 8GB RAM.
-
CNNs for Vis-NIR Chemometrics: From Contradiction to Conditional Design
Contradictions across CNN studies for Vis-NIR chemometrics are expected outcomes of uncontrolled variables in spectral physics and validation design, motivating a conditional rather than universal design framework.
-
Cross-subject Muscle Fatigue Detection via Adversarial and Supervised Contrastive Learning with Inception-Attention Network
A model using Inception-attention, adversarial domain adaptation, and contrastive learning reaches 93.54% accuracy in three-class cross-subject muscle fatigue detection from sEMG signals.
-
Generalized SAM: Efficient Fine-Tuning of SAM for Variable Input Image Sizes
GSAM applies random cropping to enable variable input sizes for efficient SAM fine-tuning, claiming lower compute with comparable or higher accuracy on varied datasets.
-
Efficient Segmentation: Learning Downsampling Near Semantic Boundaries
Learned adaptive downsampling for semantic segmentation that prioritizes locations near semantic boundaries to improve the accuracy-efficiency trade-off over uniform sampling.
-
Improving Semantic Segmentation via Dilated Affinity
Dilated affinity is jointly predicted with segmentation labels to strengthen features and support efficient label propagation refinement on benchmark datasets.
-
Multi-level Wavelet Convolutional Neural Networks
MWCNN integrates wavelet transforms into CNNs for image restoration tasks like denoising and super-resolution by using wavelet downsampling and inverse transforms to maintain resolution and expand context.
-
ESNet: An Efficient Symmetric Network for Real-time Semantic Segmentation
ESNet is a lightweight symmetric CNN using factorized residual units and parallel dilated convolutions that reaches over 62 FPS semantic segmentation on Cityscapes with 1.6M parameters.
-
Image Classification via Random Dilated Convolution with Multi-Branch Feature Extraction and Context Excitation
RDCNet reports state-of-the-art accuracy on CIFAR-10, CIFAR-100, SVHN, Imagenette, and Imagewoof by combining random dilated convolutions with multi-branch and attention modules.
-
A Unified Deep Framework for Joint 3D Pose Estimation and Action Recognition from a Single RGB Camera
A multitask framework lifts 2D keypoints to 3D poses via a two-stream network then applies ENAS to model spatio-temporal pose evolution for action recognition on Human3.6M, MSR Action3D and SBU datasets.
-
Understanding Deep Learning Techniques for Image Segmentation
A 2019 survey that categorizes and intuitively explains major deep learning techniques for image segmentation, progressing from classical methods to modern neural architectures.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.