HyperAIHyperAI

Command Palette

Search for a command to run...

a month ago

Rethinking Atrous Convolution for Semantic Image Segmentation

Chen Liang-Chieh Papandreou George Schroff Florian Adam Hartwig

Rethinking Atrous Convolution for Semantic Image Segmentation

Abstract

In this work, we revisit atrous convolution, a powerful tool to explicitlyadjust filter's field-of-view as well as control the resolution of featureresponses computed by Deep Convolutional Neural Networks, in the application ofsemantic image segmentation. To handle the problem of segmenting objects atmultiple scales, we design modules which employ atrous convolution in cascadeor in parallel to capture multi-scale context by adopting multiple atrousrates. Furthermore, we propose to augment our previously proposed AtrousSpatial Pyramid Pooling module, which probes convolutional features at multiplescales, with image-level features encoding global context and further boostperformance. We also elaborate on implementation details and share ourexperience on training our system. The proposed `DeepLabv3' systemsignificantly improves over our previous DeepLab versions without DenseCRFpost-processing and attains comparable performance with other state-of-artmodels on the PASCAL VOC 2012 semantic image segmentation benchmark.

Code Repositories

giovanniguidi/deeplabV3_Pytorch
pytorch
Mentioned in GitHub
xahidbuffon/SUIM
Mentioned in GitHub
chenmengyang/rename_later
Mentioned in GitHub
leimao/DeepLab_v3
tf
Mentioned in GitHub
msminhas93/deeplabv3finetuning
pytorch
Mentioned in GitHub
sharifelguindi/DeepLab
tf
Mentioned in GitHub
Popcorn-sugar/Deep_v2
tf
Mentioned in GitHub
IRVLab/SUIM-Net
Mentioned in GitHub
chenxi116/DeepLabv3.pytorch
pytorch
Mentioned in GitHub
fregu856/deeplabv3
pytorch
Mentioned in GitHub
stigma0617/VoVNet-DeepLabV3
pytorch
Mentioned in GitHub
DLWK/EANet
pytorch
Mentioned in GitHub
giannifranchi/deeplabv3-superpixelmix
pytorch
Mentioned in GitHub
sthalles/deeplab_v3
tf
Mentioned in GitHub
IRVLab/SUIM
Mentioned in GitHub
czarmanu/sentinel_lakeice
tf
Mentioned in GitHub
dajes/DensePose-TorchScript
pytorch
Mentioned in GitHub
TheTrveAnthony/no-Green
pytorch
Mentioned in GitHub
VainF/DeepLabV3Plus-Pytorch
pytorch
Mentioned in GitHub
BebDong/MXNetSeg
mxnet
Mentioned in GitHub
lewandofskee/MobileMamba
pytorch
Mentioned in GitHub
AutomatedAI/deeplab_inference
tf
Mentioned in GitHub
tensorflow/models
tf
Mentioned in GitHub
rishizek/tensorflow-deeplab-v3
tf
Mentioned in GitHub
giovanniguidi/deeplabV3-PyTorch
pytorch
Mentioned in GitHub
ensta-u2is/deeplabv3plus-muad-pytorch
pytorch
Mentioned in GitHub
Robinatp/Deeplab_Tensorflow
tf
Mentioned in GitHub
osmr/imgclsmob
mxnet
Mentioned in GitHub
zhangzjn/emo
pytorch
Mentioned in GitHub
Syarujianai/deeplab-commented
tf
Mentioned in GitHub
mathildor/DeepLab-v3
tf
Mentioned in GitHub
it6aidl/outdoorsegmentation
pytorch
Mentioned in GitHub
leonardoaraujosantos/seg_atrous
pytorch
Mentioned in GitHub
naver-ai/BlendNeRF
pytorch
Mentioned in GitHub
2023-MindSpore-1/ms-code-167
mindspore
Mentioned in GitHub
heidongxianhau/deeplab2
tf
Mentioned in GitHub
leimao/DeepLab-V3
tf
Mentioned in GitHub
xahidbuffon/SVAM-Net
tf
Mentioned in GitHub
JWuzyk/CudaVisionProject
pytorch
Mentioned in GitHub
zhangzjn/emov2
pytorch
Mentioned in GitHub
KPMG-wiseuniv/AI
pytorch
Mentioned in GitHub
zxleong/GPRNet
Mentioned in GitHub
samson6460/tf2_Segmentation
tf
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
dichotomous-image-segmentation-on-dis-te1DeeplabV3+
E-measure: 0.772
HCE: 234
MAE: 0.102
S-Measure: 0.694
max F-Measure: 0.601
weighted F-measure: 0.506
dichotomous-image-segmentation-on-dis-te2DeeplabV3+
E-measure: 0.813
HCE: 516
MAE: 0.105
S-Measure: 0.729
max F-Measure: 0.681
weighted F-measure: 0.587
dichotomous-image-segmentation-on-dis-te3DeeplabV3+
E-measure: 0.833
HCE: 999
MAE: 0.102
S-Measure: 0.749
max F-Measure: 0.717
weighted F-measure: 0.623
dichotomous-image-segmentation-on-dis-te4DeeplabV3+
E-measure: 0.820
HCE: 3709
MAE: 0.111
S-Measure: 0.744
max F-Measure: 0.715
weighted F-measure: 0.621
dichotomous-image-segmentation-on-dis-vdDeeplabV3+
E-measure: 0.796
HCE: 1520
MAE: 0.114
S-Measure: 0.716
max F-Measure: 0.660
weighted F-measure: 0.568
semantic-segmentation-on-cityscapesDeepLabv3 (ResNet-101, coarse)
Mean IoU (class): 81.3%
semantic-segmentation-on-cityscapes-valDeepLabv3 (Dilated-ResNet-101)
mIoU: 78.5%
semantic-segmentation-on-pascal-voc-2012DeepLabv3-JFT
Mean IoU: 86.9%
semantic-segmentation-on-pascal-voc-2012-valDeepLabv3-JFT
mIoU: 82.7%
semantic-segmentation-on-selmaDeepLabV3
mIoU: 70.7

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp