HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Boosting Few-Shot Learning With Adaptive Margin Loss

Aoxue Li Weiran Huang Xu Lan Jiashi Feng Zhenguo Li Liwei Wang

Boosting Few-Shot Learning With Adaptive Margin Loss

Abstract

Few-shot learning (FSL) has attracted increasing attention in recent years but remains challenging, due to the intrinsic difficulty in learning to generalize from a few examples. This paper proposes an adaptive margin principle to improve the generalization ability of metric-based meta-learning approaches for few-shot learning problems. Specifically, we first develop a class-relevant additive margin loss, where semantic similarity between each pair of classes is considered to separate samples in the feature embedding space from similar classes. Further, we incorporate the semantic context among all classes in a sampled training task and develop a task-relevant additive margin loss to better distinguish samples from different classes. Our adaptive margin method can be easily extended to a more realistic generalized FSL setting. Extensive experiments demonstrate that the proposed method can boost the performance of current metric-based meta-learning approaches, under both the standard FSL and generalized FSL settings.

Benchmarks

BenchmarkMethodologyMetrics
few-shot-image-classification-on-imagenet-1TRAML
Top-5 Accuracy: 59.2
few-shot-image-classification-on-mini-2TRAML
Accuracy: 67.10
few-shot-image-classification-on-mini-3TRAML
Accuracy: 79.54

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Boosting Few-Shot Learning With Adaptive Margin Loss | Papers | HyperAI