Robust Facial Landmark Detection via Occlusion-Adaptive Deep Networks

Meilu Zhu, Daming Shi, Mingjie Zheng, Muhammad Sadiq; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 3486-3496


In this paper, we present a simple and effective framework called Occlusion-adaptive Deep Networks (ODN) with the purpose of solving the occlusion problem for facial landmark detection. In this model, the occlusion probability of each position in high-level features are inferred by a distillation module that can be learnt automatically in the process of estimating the relationship between facial appearance and facial shape. The occlusion probability serves as the adaptive weight on high-level features to reduce the impact of occlusion and obtain clean feature representation. Nevertheless, the clean feature representation cannot represent the holistic face due to the missing semantic features. To obtain exhaustive and complete feature representation, it is vital that we leverage a low-rank learning module to recover lost features. Considering that facial geometric characteristics are conducive to the low-rank module to recover lost features, we propose a geometry-aware module to excavate geometric relationships between different facial components. Depending on the synergistic effect of three modules, the proposed network achieves better performance in comparison to state-of-the-art methods on challenging benchmark datasets.

Related Material

author = {Zhu, Meilu and Shi, Daming and Zheng, Mingjie and Sadiq, Muhammad},
title = {Robust Facial Landmark Detection via Occlusion-Adaptive Deep Networks},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}