HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Out-of-Distribution Detection Without Class Labels

Niv Cohen; Ron Abutbul; Yedid Hoshen

Out-of-Distribution Detection Without Class Labels

Abstract

Out-of-distribution detection seeks to identify novelties, samples that deviate from the norm. The task has been found to be quite challenging, particularly in the case where the normal data distribution consists of multiple semantic classes (e.g., multiple object categories). To overcome this challenge, current approaches require manual labeling of the normal images provided during training. In this work, we tackle multi-class novelty detection without class labels. Our simple but effective solution consists of two stages: we first discover "pseudo-class" labels using unsupervised clustering. Then using these pseudo-class labels, we are able to use standard supervised out-of-distribution detection methods. We verify the performance of our method by a favorable comparison to the state-of-the-art, and provide extensive analysis and ablations.

Benchmarks

BenchmarkMethodologyMetrics
anomaly-detection-on-anomaly-detection-onSCAN Features
Network: ResNet-18
ROC-AUC: 90.2
anomaly-detection-on-anomaly-detection-onPsudoLabels ResNet-152
Network: ResNet-152
ROC-AUC: 95.7
anomaly-detection-on-anomaly-detection-onPsudoLabels ViT
Network: ViT
ROC-AUC: 99.1
anomaly-detection-on-anomaly-detection-onPsudoLabels ResNet-18
Network: ResNet-18
ROC-AUC: 94.3
anomaly-detection-on-anomaly-detection-on-1PsudoLabels CLIP ViT
Network: ViT
ROC-AUC: 99.4
anomaly-detection-on-anomaly-detection-on-2PsudoLabels CLIP ViT
Network: ViT
ROC-AUC: 98.3
anomaly-detection-on-unlabeled-cifar-10-vsPsudoLabels ResNet-18
AUROC: 90.8
Network: ResNet-18
anomaly-detection-on-unlabeled-cifar-10-vsPsudoLabels ViT
AUROC: 96.7
Network: ViT
anomaly-detection-on-unlabeled-cifar-10-vsPsudoLabels ResNet-152
AUROC: 93.3
Network: ResNet-152
anomaly-detection-on-unlabeled-cifar-10-vsSCAN Features
AUROC: 90.2
Network: ResNet-18

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Out-of-Distribution Detection Without Class Labels | Papers | HyperAI