Semantic Component Decomposition for Face Attribute Manipulation

Ying-Cong Chen, Xiaohui Shen, Zhe Lin, Xin Lu, I-Ming Pao, Jiaya Jia; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 9859-9867


Deep neural network-based methods were proposed for face attribute manipulation. There still exist, however, two major issues, i.e., insufficient visual quality (or resolution) of the results and lack of user control. They limit the applicability of existing methods since users may have different editing preference on facial attributes. In this paper, we address these issues by proposing a semantic component model. The model decomposes a facial attribute into multiple semantic components, each corresponds to a specific face region. This not only allows for user control of edit strength on different parts based on their preference, but also makes it effective to remove unwanted edit effect. Further, each semantic component is composed of two fundamental elements, which determine the edit effect and region respectively. This property provides fine interactive control. As shown in experiments, our model not only produces high-quality results, but also allows effective user interaction.

Related Material

[pdf] [supp]
author = {Chen, Ying-Cong and Shen, Xiaohui and Lin, Zhe and Lu, Xin and Pao, I-Ming and Jia, Jiaya},
title = {Semantic Component Decomposition for Face Attribute Manipulation},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}