Command Palette
Search for a command to run...
The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization
Paul Bergmann; Xin Jin; David Sattlegger; Carsten Steger

Abstract
We introduce the first comprehensive 3D dataset for the task of unsupervised anomaly detection and localization. It is inspired by real-world visual inspection scenarios in which a model has to detect various types of defects on manufactured products, even if it is trained only on anomaly-free data. There are defects that manifest themselves as anomalies in the geometric structure of an object. These cause significant deviations in a 3D representation of the data. We employed a high-resolution industrial 3D sensor to acquire depth scans of 10 different object categories. For all object categories, we present a training and validation set, each of which solely consists of scans of anomaly-free samples. The corresponding test sets contain samples showing various defects such as scratches, dents, holes, contaminations, or deformations. Precise ground-truth annotations are provided for every anomalous test sample. An initial benchmark of 3D anomaly detection methods on our dataset indicates a considerable room for improvement.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| 3d-anomaly-detection-and-segmentation-on | Voxel GAN | Detection AUROC: 0.537 Segmentation AUPRO: 0.583 |
| 3d-anomaly-detection-and-segmentation-on | Voxel VM | Detection AUROC: 0.571 Segmentation AUPRO: 0.492 |
| 3d-anomaly-detection-and-segmentation-on | Voxel AE | Detection AUROC: 0.699 Segmentation AUPRO: 0.348 |
| depth-anomaly-detection-and-segmentation-on | Depth VM | Detection AUROC: 0.546 Segmentation AUPRO: 0.374 |
| depth-anomaly-detection-and-segmentation-on | Depth GAN | Detection AUROC: 0.523 Segmentation AUPRO: 0.143 |
| depth-anomaly-detection-and-segmentation-on | Depth AE | Detection AUROC: 0.546 Segmentation AUPRO: 0.203 |
| rgb-3d-anomaly-detection-and-segmentation-on | Voxel GAN | Detection AUCROC: 0.517 Segmentation AUPRO: 0.639 |
| rgb-3d-anomaly-detection-and-segmentation-on | Voxel AE | Detection AUCROC: 0.538 Segmentation AUPRO: 0.564 |
| rgb-3d-anomaly-detection-and-segmentation-on | Voxel VM | Detection AUCROC: 0.609 Segmentation AUPRO: 0.471 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.