HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

SERNet-Former: Semantic Segmentation by Efficient Residual Network with Attention-Boosting Gates and Attention-Fusion Networks

Erisen Serdar

SERNet-Former: Semantic Segmentation by Efficient Residual Network with
  Attention-Boosting Gates and Attention-Fusion Networks

Abstract

Improving the efficiency of state-of-the-art methods in semantic segmentationrequires overcoming the increasing computational cost as well as issues such asfusing semantic information from global and local contexts. Based on the recentsuccess and problems that convolutional neural networks (CNNs) encounter insemantic segmentation, this research proposes an encoder-decoder architecturewith a unique efficient residual network, Efficient-ResNet. Attention-boostinggates (AbGs) and attention-boosting modules (AbMs) are deployed by aiming tofuse the equivariant and feature-based semantic information with the equivalentsizes of the output of global context of the efficient residual network in theencoder. Respectively, the decoder network is developed with the additionalattention-fusion networks (AfNs) inspired by AbM. AfNs are designed to improvethe efficiency in the one-to-one conversion of the semantic information bydeploying additional convolution layers in the decoder part. Our network istested on the challenging CamVid and Cityscapes datasets, and the proposedmethods reveal significant improvements on the residual networks. To the bestof our knowledge, the developed network, SERNet-Former, achievesstate-of-the-art results (84.62 % mean IoU) on CamVid dataset and challengingresults (87.35 % mean IoU) on Cityscapes validation dataset.

Benchmarks

BenchmarkMethodologyMetrics
2d-semantic-segmentation-on-camvidSERNet-Former
mIoU: 84.62
2d-semantic-segmentation-on-cityscapes-valSERNet-Former
mIoU: 87.35
semantic-segmentation-on-ade20kSERNet-Former
Validation mIoU: 59.35
semantic-segmentation-on-ade20k-valSERNet-Former_v2
mIoU: 59.35
semantic-segmentation-on-bdd100k-valSERNet-Former_v2
mIoU: 67.42
semantic-segmentation-on-camvidSERNet-Former
Mean IoU: 84.62
semantic-segmentation-on-cityscapesSERNet-Former
Mean IoU (class): 84.83
semantic-segmentation-on-cityscapes-valSERNet-Former
Validation mIoU: 87.35
mIoU: 87.35

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp