HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Squeezing Backbone Feature Distributions to the Max for Efficient Few-Shot Learning

Yuqing Hu Vincent Gripon Stéphane Pateux

Squeezing Backbone Feature Distributions to the Max for Efficient Few-Shot Learning

Abstract

Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed with the common aim of transferring knowledge acquired on a previously solved task, what is often achieved by using a pretrained feature extractor. Following this vein, in this paper we propose a novel transfer-based method which aims at processing the feature vectors so that they become closer to Gaussian-like distributions, resulting in increased accuracy. In the case of transductive few-shot learning where unlabelled test samples are available during training, we also introduce an optimal-transport inspired algorithm to boost even further the achieved performance. Using standardized vision benchmarks, we show the ability of the proposed methodology to achieve state-of-the-art accuracy with various datasets, backbone architectures and few-shot settings.

Code Repositories

yhu01/bms
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
few-shot-image-classification-on-cifar-fs-5PEMnE-BMS*
Accuracy: 88.44
few-shot-image-classification-on-cifar-fs-5-1PEMnE-BMS*
Accuracy: 91.86
few-shot-image-classification-on-cub-200-5PEMnE-BMS*
Accuracy: 96.43
few-shot-image-classification-on-cub-200-5-1PEMnE-BMS*
Accuracy: 94.78
few-shot-image-classification-on-mini-2PEMbE-NCM (inductive)
Accuracy: 68.43
few-shot-image-classification-on-mini-2PEMnE-BMS* (transductive)
Accuracy: 85.54
few-shot-image-classification-on-mini-3PEMbE-NCM (inductive)
Accuracy: 84.67
few-shot-image-classification-on-mini-3PEMnE-BMS*(transductive)
Accuracy: 91.53
few-shot-image-classification-on-mini-5PEMnE-BMS*
Accuracy: 63.90
few-shot-image-classification-on-mini-6PEMnE-BMS
Accuracy: 79.15
few-shot-image-classification-on-tieredPEMnE-BMS*
Accuracy: 86.07
few-shot-image-classification-on-tiered-1PEMnE-BMS*
Accuracy: 91.09

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Squeezing Backbone Feature Distributions to the Max for Efficient Few-Shot Learning | Papers | HyperAI