HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization

{Zhenheng Yang Zhihan Zhang Zhenye Jiang Xuefeng Hu Ram Nevatia Syomantak Chaudhuri}

SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization

Abstract

Tehchniques for manipulating images are advancing rapidly; while these are helpful for many useful tasks, they also pose a threat to society with their ability to create believable misinformation. We present a novel, Spatial Pyramid Attention Network (SPAN) for detection and localization of multiple types of image manipulations. The proposed architecture efficiently and effecively models the relationship between image patches at multiple scales by constructing a pyramid of local self-attention blocks. The design includes a novel position projection to encode the spatial positions of the patches. SPAN is trained on a synthetic dataset but can also be fine tuned for specific datasets; The proposed method shows significant gains in performance on standard datasets over previous state-of-art methods.

Benchmarks

BenchmarkMethodologyMetrics
image-manipulation-detection-on-casia-v1SPAN
AUC: .480
Balanced Accuracy: .112
image-manipulation-detection-on-cocoglideSPAN
AUC: .475
Balanced Accuracy: .298
image-manipulation-detection-on-coverageSPAN
AUC: .670
Balanced Accuracy: .235
image-manipulation-detection-on-dso-1SPAN
AUC: .669
Balanced Accuracy: .233
image-manipulation-localization-on-casia-v1SPAN
Average Pixel F1(Fixed threshold): .112
image-manipulation-localization-on-cocoglideSPAN
Average Pixel F1(Fixed threshold): .298
image-manipulation-localization-on-columbiaSPAN
Average Pixel F1(Fixed threshold): .759
image-manipulation-localization-on-coverageSPAN
Average Pixel F1(Fixed threshold): .235
image-manipulation-localization-on-dso-1SPAN
Average Pixel F1(Fixed threshold): .233

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization | Papers | HyperAI