HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Exploring StyleGAN Latent Space for Face Alignment with Limited Training Data

{Bertrand Coüasnon Yann Ricquebourg Christian Raymond Philippe-Henri Gosselin Martin Dornier}

Exploring StyleGAN Latent Space for Face Alignment with Limited Training Data

Abstract

With deep learning models growing in size over the years, sometimes exceeding a billion parameters now, the need for large, annotated training datasets grows too. To alleviate this problem, the interest in self-supervised learning is also increasing. In this domain, with the rise of Generative Adversarial Networks (GANs) and particularly StyleGAN, the quality of image generation is significantly improving. In this paper, we propose to use StyleGAN to perform face alignment with limited training data instead of image generation. Our proposed framework Face Alignment using StyleGAN Embeddings (FASE) projects real images into StyleGAN latent space and then predicts facial landmarks from the latent vectors. Our method achieves state-of-the-art on multiple face alignment datasets in the few-shot setting.

Benchmarks

BenchmarkMethodologyMetrics
face-alignment-on-300wFASE
NME_inter-ocular (%, Challenge): 5.30
NME_inter-ocular (%, Common): 2.97
NME_inter-ocular (%, Full): 3.42
face-alignment-on-aflw-19FASE
AUC_box@0.07 (%, Full): 79.1
NME_box (%, Full): 1.45
NME_diag (%, Frontal): 0.90
NME_diag (%, Full): 1.02
face-alignment-on-wflwFASE
NME (inter-ocular): 4.62

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Exploring StyleGAN Latent Space for Face Alignment with Limited Training Data | Papers | HyperAI