HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

AnomalyDINO: Boosting Patch-based Few-shot Anomaly Detection with DINOv2

Simon Damm Mike Laszkiewicz Johannes Lederer Asja Fischer

AnomalyDINO: Boosting Patch-based Few-shot Anomaly Detection with DINOv2

Abstract

Recent advances in multimodal foundation models have set new standards in few-shot anomaly detection. This paper explores whether high-quality visual features alone are sufficient to rival existing state-of-the-art vision-language models. We affirm this by adapting DINOv2 for one-shot and few-shot anomaly detection, with a focus on industrial applications. We show that this approach does not only rival existing techniques but can even outmatch them in many settings. Our proposed vision-only approach, AnomalyDINO, follows the well-established patch-level deep nearest neighbor paradigm, and enables both image-level anomaly prediction and pixel-level anomaly segmentation. The approach is methodologically simple and training-free and, thus, does not require any additional data for fine-tuning or meta-learning. The approach is methodologically simple and training-free and, thus, does not require any additional data for fine-tuning or meta-learning. Despite its simplicity, AnomalyDINO achieves state-of-the-art results in one- and few-shot anomaly detection (e.g., pushing the one-shot performance on MVTec-AD from an AUROC of 93.1% to 96.6%). The reduced overhead, coupled with its outstanding few-shot performance, makes AnomalyDINO a strong candidate for fast deployment, e.g., in industrial contexts.

Code Repositories

dammsi/AnomalyDINO
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
anomaly-detection-on-mvtec-adAnomalyDINO-S (1-shot)
Detection AUROC: 96.6
Segmentation AUPRO: 92.7
Segmentation AUROC: 96.8
anomaly-detection-on-mvtec-adAnomalyDINO-S (4-shot)
Detection AUROC: 97.7
Segmentation AUPRO: 93.4
Segmentation AUROC: 97.2
anomaly-detection-on-mvtec-adAnomalyDINO-S (full-shot)
Detection AUROC: 99.5
Segmentation AUPRO: 95
Segmentation AUROC: 98.2
anomaly-detection-on-mvtec-adAnomalyDINO-S (2-shot)
Detection AUROC: 96.9
Segmentation AUPRO: 93.1
Segmentation AUROC: 97.0
anomaly-detection-on-visaAnomalyDINO-S (full-shot)
Detection AUROC: 97.6
Segmentation AUPRO (until 30% FPR): 96.1
Segmentation AUROC: 98.8
anomaly-detection-on-visaAnomalyDINO-S (4-shot)
Detection AUROC: 92.6
Segmentation AUPRO (until 30% FPR): 94.1
Segmentation AUROC: 98.2
anomaly-detection-on-visaAnomalyDINO-S (2-shot)
Detection AUROC: 89.7
Segmentation AUPRO (until 30% FPR): 93.4
Segmentation AUROC: 98
anomaly-detection-on-visaAnomalyDINO-S (1-shot)
Detection AUROC: 87.4
Segmentation AUPRO (until 30% FPR): 92.5
Segmentation AUROC: 97.8

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
AnomalyDINO: Boosting Patch-based Few-shot Anomaly Detection with DINOv2 | Papers | HyperAI