HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Synthetic Sample Selection for Generalized Zero-Shot Learning

Shreyank N Gowda

Synthetic Sample Selection for Generalized Zero-Shot Learning

Abstract

Generalized Zero-Shot Learning (GZSL) has emerged as a pivotal research domain in computer vision, owing to its capability to recognize objects that have not been seen during training. Despite the significant progress achieved by generative techniques in converting traditional GZSL to fully supervised learning, they tend to generate a large number of synthetic features that are often redundant, thereby increasing training time and decreasing accuracy. To address this issue, this paper proposes a novel approach for synthetic feature selection using reinforcement learning. In particular, we propose a transformer-based selector that is trained through proximal policy optimization (PPO) to select synthetic features based on the validation classification accuracy of the seen classes, which serves as a reward. The proposed method is model-agnostic and data-agnostic, making it applicable to both images and videos and versatile for diverse applications. Our experimental results demonstrate the superiority of our approach over existing feature-generating methods, yielding improved overall performance on multiple benchmarks.

Benchmarks

BenchmarkMethodologyMetrics
generalized-zero-shot-learning-on-cub-200SPOT (DAA)
Harmonic mean: 67.0
generalized-zero-shot-learning-on-oxford-102-1SPOT (FREE)
Harmonic mean: 75.9
generalized-zero-shot-learning-on-sunSPOT (CMC-GAN)
Harmonic mean: 46.4
zero-shot-action-recognition-on-hmdb51SPOT
Top-1 Accuracy: 35.9
zero-shot-action-recognition-on-olympicsSPOT
Top-1 Accuracy: 68.7
zero-shot-action-recognition-on-ucf101SPOT
Top-1 Accuracy: 40.9
zero-shot-learning-on-cub-200-2011SPOT
average top-1 classification accuracy: 62.9
zero-shot-learning-on-oxford-102-flowerSPOT
average top-1 classification accuracy: 71.9
zero-shot-learning-on-sun-attributeSPOT (VAEGAN)
average top-1 classification accuracy: 66.04

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Synthetic Sample Selection for Generalized Zero-Shot Learning | Papers | HyperAI