Command Palette
Search for a command to run...
Co-Saliency Detection via Mask-Guided Fully Convolutional Networks With Multi-Scale Label Smoothing
{ Qingshan Liu Bo Liu Tengpeng Li Kaihua Zhang}

Abstract
In image co-saliency detection problem, one critical issue is how to model the concurrent pattern of the co-salient parts, which appears both within each image and across all the relevant images. In this paper, we propose a hierarchical image co-saliency detection framework as a coarse to fine strategy to capture this pattern. We first propose a mask-guided fully convolutional network structure to generate the initial co-saliency detection result. The mask is used for background removal and it is learned from the high-level feature response maps of the pre-trained VGG-net output. We next propose a multi-scale label smoothing model to further refine the detection result. The proposed model jointly optimizes the label smoothness of pixels and superpixels. Experiment results on three popular image co-saliency detection benchmark datasets including iCoseg, MSRC and Cosal2015 demonstrate the remarkable performance compared with the state-of-the-art methods.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| co-salient-object-detection-on-coca | CSMG | Mean F-measure: 0.390 S-measure: 0.627 max F-measure: 0.499 mean E-measure: 0.606 |
| co-salient-object-detection-on-cosal2015 | CSMG | MAE: 0.130 S-measure: 0.774 max E-measure: 0.842 max F-measure: 0.784 |
| co-salient-object-detection-on-cosod3k | CSMG | MAE: 0.157 S-measure: 0.711 max E-measure: 0.804 max F-measure: 0.709 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.