HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization

Paul Bergmann; Xin Jin; David Sattlegger; Carsten Steger

The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization

Abstract

We introduce the first comprehensive 3D dataset for the task of unsupervised anomaly detection and localization. It is inspired by real-world visual inspection scenarios in which a model has to detect various types of defects on manufactured products, even if it is trained only on anomaly-free data. There are defects that manifest themselves as anomalies in the geometric structure of an object. These cause significant deviations in a 3D representation of the data. We employed a high-resolution industrial 3D sensor to acquire depth scans of 10 different object categories. For all object categories, we present a training and validation set, each of which solely consists of scans of anomaly-free samples. The corresponding test sets contain samples showing various defects such as scratches, dents, holes, contaminations, or deformations. Precise ground-truth annotations are provided for every anomalous test sample. An initial benchmark of 3D anomaly detection methods on our dataset indicates a considerable room for improvement.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
3d-anomaly-detection-and-segmentation-onVoxel GAN
Detection AUROC: 0.537
Segmentation AUPRO: 0.583
3d-anomaly-detection-and-segmentation-onVoxel VM
Detection AUROC: 0.571
Segmentation AUPRO: 0.492
3d-anomaly-detection-and-segmentation-onVoxel AE
Detection AUROC: 0.699
Segmentation AUPRO: 0.348
depth-anomaly-detection-and-segmentation-onDepth VM
Detection AUROC: 0.546
Segmentation AUPRO: 0.374
depth-anomaly-detection-and-segmentation-onDepth GAN
Detection AUROC: 0.523
Segmentation AUPRO: 0.143
depth-anomaly-detection-and-segmentation-onDepth AE
Detection AUROC: 0.546
Segmentation AUPRO: 0.203
rgb-3d-anomaly-detection-and-segmentation-onVoxel GAN
Detection AUCROC: 0.517
Segmentation AUPRO: 0.639
rgb-3d-anomaly-detection-and-segmentation-onVoxel AE
Detection AUCROC: 0.538
Segmentation AUPRO: 0.564
rgb-3d-anomaly-detection-and-segmentation-onVoxel VM
Detection AUCROC: 0.609
Segmentation AUPRO: 0.471

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization | Papers | HyperAI