Command Palette
Search for a command to run...
TransFusion -- A Transparency-Based Diffusion Model for Anomaly Detection
Matic Fučka; Vitjan Zavrtanik; Danijel Skočaj

Abstract
Surface anomaly detection is a vital component in manufacturing inspection. Current discriminative methods follow a two-stage architecture composed of a reconstructive network followed by a discriminative network that relies on the reconstruction output. Currently used reconstructive networks often produce poor reconstructions that either still contain anomalies or lack details in anomaly-free regions. Discriminative methods are robust to some reconstructive network failures, suggesting that the discriminative network learns a strong normal appearance signal that the reconstructive networks miss. We reformulate the two-stage architecture into a single-stage iterative process that allows the exchange of information between the reconstruction and localization. We propose a novel transparency-based diffusion process where the transparency of anomalous regions is progressively increased, restoring their normal appearance accurately while maintaining the appearance of anomaly-free regions using localization cues of previous steps. We implement the proposed process as TRANSparency DifFUSION (TransFusion), a novel discriminative anomaly detection method that achieves state-of-the-art performance on both the VisA and the MVTec AD datasets, with an image-level AUROC of 98.5% and 99.2%, respectively. Code: https://github.com/MaticFuc/ECCV_TransFusion
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| anomaly-detection-on-mvtec-ad | TransFusion | Detection AUROC: 99.4 Segmentation AUPRO: 95.3 |
| anomaly-detection-on-visa | TransFusion | Detection AUROC: 98.7 Segmentation AUPRO (until 30% FPR): 94.7 |
| depth-anomaly-detection-and-segmentation-on | TransFusion | Detection AUROC: 0.957 Segmentation AUPRO: 0.947 |
| rgb-3d-anomaly-detection-and-segmentation-on | TransFusion | Detection AUCROC: 0.982 Segmentation AUPRO: 0.983 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.