HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

TransFusion -- A Transparency-Based Diffusion Model for Anomaly Detection

Matic Fučka; Vitjan Zavrtanik; Danijel Skočaj

TransFusion -- A Transparency-Based Diffusion Model for Anomaly Detection

Abstract

Surface anomaly detection is a vital component in manufacturing inspection. Current discriminative methods follow a two-stage architecture composed of a reconstructive network followed by a discriminative network that relies on the reconstruction output. Currently used reconstructive networks often produce poor reconstructions that either still contain anomalies or lack details in anomaly-free regions. Discriminative methods are robust to some reconstructive network failures, suggesting that the discriminative network learns a strong normal appearance signal that the reconstructive networks miss. We reformulate the two-stage architecture into a single-stage iterative process that allows the exchange of information between the reconstruction and localization. We propose a novel transparency-based diffusion process where the transparency of anomalous regions is progressively increased, restoring their normal appearance accurately while maintaining the appearance of anomaly-free regions using localization cues of previous steps. We implement the proposed process as TRANSparency DifFUSION (TransFusion), a novel discriminative anomaly detection method that achieves state-of-the-art performance on both the VisA and the MVTec AD datasets, with an image-level AUROC of 98.5% and 99.2%, respectively. Code: https://github.com/MaticFuc/ECCV_TransFusion

Code Repositories

maticfuc/eccv_transfusion
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
anomaly-detection-on-mvtec-adTransFusion
Detection AUROC: 99.4
Segmentation AUPRO: 95.3
anomaly-detection-on-visaTransFusion
Detection AUROC: 98.7
Segmentation AUPRO (until 30% FPR): 94.7
depth-anomaly-detection-and-segmentation-onTransFusion
Detection AUROC: 0.957
Segmentation AUPRO: 0.947
rgb-3d-anomaly-detection-and-segmentation-onTransFusion
Detection AUCROC: 0.982
Segmentation AUPRO: 0.983

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
TransFusion -- A Transparency-Based Diffusion Model for Anomaly Detection | Papers | HyperAI