Command Palette
Search for a command to run...
Robust Image Forgery Detection Over Online Social Network Shared Images
{Jun Liu Jinyu Tian Jiantao Zhou Haiwei Wu}

Abstract
The increasing abuse of image editing softwares, such as Photoshop and Meitu, causes the authenticity of digital images questionable. Meanwhile, the widespread availability of online social networks (OSNs) makes them the dominant channels for transmitting forged images to report fake news, propagate rumors, etc. Unfortunately, various lossy operations adopted by OSNs, e.g., compression and resizing, impose great challenges for implementing the robust image forgery detection. To fight against the OSN-shared forgeries, in this work, a novel robust training scheme is proposed. We first conduct a thorough analysis of the noise introduced by OSNs, and decouple it into two parts, i.e., predictable noise and unseen noise, which are modelled separately. The former simulates the noise introduced by the disclosed (known) operations of OSNs, while the latter is designed to not only complete the previous one, but also take into account the defects of the detector itself. We then incorporate the modelled noise into a robust training framework, significantly improving the robustness of the image forgery detector. Extensive experimental results are presented to validate the superiority of the proposed scheme compared with several state-of-the-art competitors. Finally, to promote the future development of the image forgery detection, we build a public forgeries dataset based on four existing datasets and three most popular OSNs. The designed detector recently won the top ranking in a certificate forgery detection competition. The source code and dataset are available at https://github.com/HighwayWu/ImageForensicsOSN.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| image-manipulation-detection-on-casia-osn | Wu22 | AUC: 0.862 F-score: 0.462 Intersection over Union: 0.417 |
| image-manipulation-detection-on-casia-osn-1 | Wu22 | AUC: 0.833 Intersection over Union: 0.405 f-Score: 0.358 |
| image-manipulation-detection-on-casia-osn-2 | Wu22 | AUC: 0.866 Intersection over Union: 0.431 f-Score: 0.478 |
| image-manipulation-detection-on-casia-osn-3 | Wu22 | AUC: 0.858 Intersection over Union: 0.421 f-Score: 0.466 |
| image-manipulation-detection-on-columbia-osn | Wu22 | AUC: 0.883 Intersection over Union: 0.611 f-Score: 0.714 |
| image-manipulation-detection-on-columbia-osn-1 | Wu22 | AUC: 0.883 Intersection over Union: 0.631 f-Score: 0.727 |
| image-manipulation-detection-on-columbia-osn-2 | Wu22 | AUC: 0.889 Intersection over Union: 0.628 f-Score: 0.727 |
| image-manipulation-detection-on-columbia-osn-3 | Wu22 | AUC: 0.883 Intersection over Union: 0.626 f-Score: 0.724 |
| image-manipulation-detection-on-dso-osn | Wu22 | AUC: 0.859 Intersection over Union: 0.320 f-Score: 0.447 |
| image-manipulation-detection-on-dso-osn-1 | Wu22 | AUC: 0.823 Intersection over Union: 0.252 f-Score: 0.366 |
| image-manipulation-detection-on-dso-osn-2 | Wu22 | AUC: 0.839 Intersection over Union: 0.233 f-Score: 0.341 |
| image-manipulation-detection-on-dso-osn-3 | Wu22 | AUC: 0.808 Intersection over Union: 0.253 f-Score: 0.370 |
| image-manipulation-detection-on-nist-osn | Wu22 | AUC: 0.783 Intersection over Union: 0.253 f-Score: 0.329 |
| image-manipulation-detection-on-nist-osn-1 | Wu22 | AUC: 0.764 Intersection over Union: 0.214 f-Score: 0.286 |
| image-manipulation-detection-on-nist-osn-2 | Wu22 | AUC: 0.785 Intersection over Union: 0.239 f-Score: 0.313 |
| image-manipulation-detection-on-nist-osn-3 | Wu22 | AUC: 0.780 Intersection over Union: 0.219 f-Score: 0.294 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.