Command Palette
Search for a command to run...
Chen Xinru ; Dong Chengbo ; Ji Jiaqi ; Cao Juan ; Li Xirong

Abstract
The key challenge of image manipulation detection is how to learngeneralizable features that are sensitive to manipulations in novel data,whilst specific to prevent false alarms on authentic images. Current researchemphasizes the sensitivity, with the specificity overlooked. In this paper weaddress both aspects by multi-view feature learning and multi-scalesupervision. By exploiting noise distribution and boundary artifact surroundingtampered regions, the former aims to learn semantic-agnostic and thus moregeneralizable features. The latter allows us to learn from authentic imageswhich are nontrivial to be taken into account by current semantic segmentationnetwork based methods. Our thoughts are realized by a new network which we termMVSS-Net. Extensive experiments on five benchmark sets justify the viability ofMVSS-Net for both pixel-level and image-level manipulation detection.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| image-manipulation-detection-on-casia-v1 | MVSS-Net | AUC: .932 Balanced Accuracy: .528 |
| image-manipulation-detection-on-cocoglide | MVSS-Net | AUC: .654 Balanced Accuracy: .117 |
| image-manipulation-detection-on-columbia | MVSS-Net | AUC: .984 Balanced Accuracy: .729 |
| image-manipulation-detection-on-coverage | MVSS-Net | AUC: .733 Balanced Accuracy: .514 |
| image-manipulation-detection-on-dso-1 | MVSS-Net | AUC: .552 Balanced Accuracy: .358 |
| image-manipulation-localization-on-casia-v1 | MVSS-Net | Average Pixel F1(Fixed threshold): .528 |
| image-manipulation-localization-on-cocoglide | MVSS-Net | Average Pixel F1(Fixed threshold): .486 |
| image-manipulation-localization-on-columbia | MVSS-Net | Average Pixel F1(Fixed threshold): .729 |
| image-manipulation-localization-on-coverage | MVSS-Net | Average Pixel F1(Fixed threshold): .514 |
| image-manipulation-localization-on-dso-1 | MVSS-Net | Average Pixel F1(Fixed threshold): .358 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.