Command Palette
Search for a command to run...
Niv Cohen; Ron Abutbul; Yedid Hoshen

Abstract
Out-of-distribution detection seeks to identify novelties, samples that deviate from the norm. The task has been found to be quite challenging, particularly in the case where the normal data distribution consists of multiple semantic classes (e.g., multiple object categories). To overcome this challenge, current approaches require manual labeling of the normal images provided during training. In this work, we tackle multi-class novelty detection without class labels. Our simple but effective solution consists of two stages: we first discover "pseudo-class" labels using unsupervised clustering. Then using these pseudo-class labels, we are able to use standard supervised out-of-distribution detection methods. We verify the performance of our method by a favorable comparison to the state-of-the-art, and provide extensive analysis and ablations.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| anomaly-detection-on-anomaly-detection-on | SCAN Features | Network: ResNet-18 ROC-AUC: 90.2 |
| anomaly-detection-on-anomaly-detection-on | PsudoLabels ResNet-152 | Network: ResNet-152 ROC-AUC: 95.7 |
| anomaly-detection-on-anomaly-detection-on | PsudoLabels ViT | Network: ViT ROC-AUC: 99.1 |
| anomaly-detection-on-anomaly-detection-on | PsudoLabels ResNet-18 | Network: ResNet-18 ROC-AUC: 94.3 |
| anomaly-detection-on-anomaly-detection-on-1 | PsudoLabels CLIP ViT | Network: ViT ROC-AUC: 99.4 |
| anomaly-detection-on-anomaly-detection-on-2 | PsudoLabels CLIP ViT | Network: ViT ROC-AUC: 98.3 |
| anomaly-detection-on-unlabeled-cifar-10-vs | PsudoLabels ResNet-18 | AUROC: 90.8 Network: ResNet-18 |
| anomaly-detection-on-unlabeled-cifar-10-vs | PsudoLabels ViT | AUROC: 96.7 Network: ViT |
| anomaly-detection-on-unlabeled-cifar-10-vs | PsudoLabels ResNet-152 | AUROC: 93.3 Network: ResNet-152 |
| anomaly-detection-on-unlabeled-cifar-10-vs | SCAN Features | AUROC: 90.2 Network: ResNet-18 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.