HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Deep feature selection-and-fusion for RGB-D semantic segmentation

Yuejiao Su Yuan Yuan Zhiyu Jiang

Deep feature selection-and-fusion for RGB-D semantic segmentation

Abstract

Scene depth information can help visual information for more accurate semantic segmentation. However, how to effectively integrate multi-modality information into representative features is still an open problem. Most of the existing work uses DCNNs to implicitly fuse multi-modality information. But as the network deepens, some critical distinguishing features may be lost, which reduces the segmentation performance. This work proposes a unified and efficient feature selectionand-fusion network (FSFNet), which contains a symmetric cross-modality residual fusion module used for explicit fusion of multi-modality information. Besides, the network includes a detailed feature propagation module, which is used to maintain low-level detailed information during the forward process of the network. Compared with the state-of-the-art methods, experimental evaluations demonstrate that the proposed model achieves competitive performance on two public datasets.

Benchmarks

BenchmarkMethodologyMetrics
semantic-segmentation-on-nyu-depth-v2FSFNet
Mean IoU: 52.0%
semantic-segmentation-on-sun-rgbdFSFNet
Mean IoU: 50.6%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Deep feature selection-and-fusion for RGB-D semantic segmentation | Papers | HyperAI