Command Palette
Search for a command to run...
SCAF: Skip-Connections in Auto-encoder for Face alignment with few annotated data
{Bertrand Coüasnon Yann Ricquebourg Christian Raymond Philippe-Henri Gosselin Martin Dornier}

Abstract
Supervised face alignment methods need large amounts of training data to achieve good performance in terms of accuracy and generalization. However face alignment datasets rarely exceed a few thousand samples making these methods prone to overfitting on the specific training dataset. Semi-supervised methods like TS3 or 3FabRec have emerged to alleviate this issue by using labeled and unlabeled data during the training. In this paper we propose Skip-Connections in Auto-encoder for Face alignment (SCAF), we build on 3FabRec by adding skip-connections between the encoder and the decoder. These skip-connections lead to better landmark predictions, especially on challenging examples. We also apply for the first time active learning to the face alignment task and introduce a new acquisition function, the Negative Neighborhood Magnitude, specially designed to assess the quality of heatmaps. These two proposals show their effectiveness on several face alignment datasets when training with limited data.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| face-alignment-on-300w | SCAF | NME_inter-ocular (%, Challenge): 5.83 NME_inter-ocular (%, Common): 3.48 NME_inter-ocular (%, Full): 3.95 |
| face-alignment-on-wflw | SCAF | NME (inter-ocular): 5.50 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.