Command Palette
Search for a command to run...
On the representation and methodology for wide and short range head pose estimation
Cobo Alejandro ; Valle Roberto ; Buenaposada José M. ; Baumela Luis

Abstract
Head pose estimation (HPE) is a problem of interest in computer vision toimprove the performance of face processing tasks in semi-frontal or profilesettings. Recent applications require the analysis of faces in the full360{\deg} rotation range. Traditional approaches to solve the semi-frontal andprofile cases are not directly amenable for the full rotation case. In thispaper we analyze the methodology for short- and wide-range HPE and discusswhich representations and metrics are adequate for each case. We show that thepopular Euler angles representation is a good choice for short-range HPE, butnot at extreme rotations. However, the Euler angles' gimbal lock problemprevents them from being used as a valid metric in any setting. We also revisitthe current cross-data set evaluation methodology and note that the lack ofalignment between the reference systems of the training and test data setsnegatively biases the results of all articles in the literature. We introduce aprocedure to quantify this misalignment and a new methodology for cross-dataset HPE that establishes new, more accurate, SOTA for the 300W-LP|Biwibenchmark. We also propose a generalization of the geodesic angular distancemetric that enables the construction of a loss that controls the contributionof each training sample to the optimization of the model. Finally, we introducea wide range HPE benchmark based on the CMU Panoptic data set.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| head-pose-estimation-on-aflw2000 | SRHP-6D | Geodesic Error (GE): 5.37 MAE: 3.49 |
| head-pose-estimation-on-aflw2000 | SRHP-Euler | Geodesic Error (GE): 5.29 MAE: 3.25 |
| head-pose-estimation-on-biwi | SRHP-Euler | Geodesic Error (GE): 7.49 Geodesic Error - aligned (GE): 5.42 MAE (trained with other data): 4.13 MAE-aligned (trained with other data): 3.16 |
| head-pose-estimation-on-biwi | SRHP-6D | Geodesic Error (GE): 7.30 Geodesic Error - aligned (GE): 5.48 MAE (trained with other data): 3.98 MAE-aligned (trained with other data): 3.21 |
| head-pose-estimation-on-panoptic | WRHP-Quaternion | Geodesic Error (GE): 9.32 |
| head-pose-estimation-on-panoptic | WRHP-6D | Geodesic Error (GE): 7.70 |
| head-pose-estimation-on-panoptic | WRHP-6D-Opal | Geodesic Error (GE): 7.45 |
| head-pose-estimation-on-panoptic | WRHP-Euler | Geodesic Error (GE): 10.47 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.