Command Palette
Search for a command to run...
Exploring StyleGAN Latent Space for Face Alignment with Limited Training Data
{Bertrand Coüasnon Yann Ricquebourg Christian Raymond Philippe-Henri Gosselin Martin Dornier}

Abstract
With deep learning models growing in size over the years, sometimes exceeding a billion parameters now, the need for large, annotated training datasets grows too. To alleviate this problem, the interest in self-supervised learning is also increasing. In this domain, with the rise of Generative Adversarial Networks (GANs) and particularly StyleGAN, the quality of image generation is significantly improving. In this paper, we propose to use StyleGAN to perform face alignment with limited training data instead of image generation. Our proposed framework Face Alignment using StyleGAN Embeddings (FASE) projects real images into StyleGAN latent space and then predicts facial landmarks from the latent vectors. Our method achieves state-of-the-art on multiple face alignment datasets in the few-shot setting.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| face-alignment-on-300w | FASE | NME_inter-ocular (%, Challenge): 5.30 NME_inter-ocular (%, Common): 2.97 NME_inter-ocular (%, Full): 3.42 |
| face-alignment-on-aflw-19 | FASE | AUC_box@0.07 (%, Full): 79.1 NME_box (%, Full): 1.45 NME_diag (%, Frontal): 0.90 NME_diag (%, Full): 1.02 |
| face-alignment-on-wflw | FASE | NME (inter-ocular): 4.62 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.