HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Is Depth Really Necessary for Salient Object Detection?

Jiawei Zhao Yifan Zhao Jia Li Xiaowu Chen

Is Depth Really Necessary for Salient Object Detection?

Abstract

Salient object detection (SOD) is a crucial and preliminary task for many computer vision applications, which have made progress with deep CNNs. Most of the existing methods mainly rely on the RGB information to distinguish the salient objects, which faces difficulties in some complex scenarios. To solve this, many recent RGBD-based networks are proposed by adopting the depth map as an independent input and fuse the features with RGB information. Taking the advantages of RGB and RGBD methods, we propose a novel depth-aware salient object detection framework, which has following superior designs: 1) It only takes the depth information as training data while only relies on RGB information in the testing phase. 2) It comprehensively optimizes SOD features with multi-level depth-aware regularizations. 3) The depth information also serves as error-weighted map to correct the segmentation process. With these insightful designs combined, we make the first attempt in realizing an unified depth-aware framework with only RGB information as input for inference, which not only surpasses the state-of-the-art performances on five public RGB SOD benchmarks, but also surpasses the RGBD-based methods on five benchmarks by a large margin, while adopting less information and implementation light-weighted. The code and model will be publicly available.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
rgb-d-salient-object-detection-on-desDASNet
Average MAE: 0.023
S-Measure: 90.8
max F-Measure: 92.8
rgb-d-salient-object-detection-on-nju2kDASNet
Average MAE: 0.042
S-Measure: 90.2
max F-Measure: 91.1
rgb-d-salient-object-detection-on-nlprDASNet
Average MAE: 0.021
S-Measure: 92.9
max F-Measure: 92.9
rgb-d-salient-object-detection-on-ssdDASNet
Average MAE: 0.042
S-Measure: 88.5
max F-Measure: 88.1
rgb-d-salient-object-detection-on-stereDASNet
Average MAE: 0.037
S-Measure: 91.0
max F-Measure: 91.5

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Is Depth Really Necessary for Salient Object Detection? | Papers | HyperAI