HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

PSSCL: A progressive sample selection framework with contrastive loss designed for noisy labels

{Qiu Chen Filipe R. Cordeiro Yi Zhu Qian Zhang}

Abstract

Large-scale image datasets frequently contain unavoidable noisy labels, resulting in overfitting in deep neural networks and declining performance. Most existing methods for learning from noisy labels operate as one-stage frameworks, where training data division and semi-supervised learning (SSL) are intertwined for optimization. Accordingly, their effectiveness is significantly influenced by the precision of the separated clean set, prior knowledge of noise, and the robustness of SSL. In this paper, we propose a progressive sample selection framework with contrastive loss for noisy labels named PSSCL. This framework operates in two stages, using robust and contrastive losses to augment the robustness of the model. Stage I focuses on identifying a small clean set through a long-term confidence detection strategy, while stage II aims to enhance performance by expanding this clean set. PSSCL demonstrates significant improvement across various benchmarks when compared with state-of-the-art methods. The code is available at https://github.com/LanXiaoPang613/PSSCL.

Benchmarks

BenchmarkMethodologyMetrics
image-classification-on-mini-webvision-1-0PSSCL (130 epochs)
ImageNet Top-1 Accuracy: 79.68
ImageNet Top-5 Accuracy: 95.16
Top-1 Accuracy: 79.56
Top-5 Accuracy: 94.84
image-classification-on-mini-webvision-1-0PSSCL (120 epochs)
ImageNet Top-1 Accuracy: 79.40
ImageNet Top-5 Accuracy: 94.84
Top-1 Accuracy: 78.52
Top-5 Accuracy: 93.80
learning-with-noisy-labels-on-animalPSSCL
Accuracy: 88.74
ImageNet Pretrained: NO
Network: Vgg19-BN
learning-with-noisy-labels-on-cifar-100nPSSCL
Accuracy (mean): 72.00
learning-with-noisy-labels-on-cifar-10nPSSCL
Accuracy (mean): 96.41
learning-with-noisy-labels-on-cifar-10n-1PSSCL
Accuracy (mean): 96.17
learning-with-noisy-labels-on-cifar-10n-2PSSCL
Accuracy (mean): 96.21
learning-with-noisy-labels-on-cifar-10n-3PSSCL
Accuracy (mean): 96.49
learning-with-noisy-labels-on-cifar-10n-worstPSSCL
Accuracy (mean): 95.12
learning-with-noisy-labels-on-food-101PSSCL
Accuracy (% ): 86.41

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
PSSCL: A progressive sample selection framework with contrastive loss designed for noisy labels | Papers | HyperAI