EyeGAN: Gaze-Preserving, Mask-Mediated Eye Image Synthesis

Harsimran Kaur, Roberto Manduchi; The IEEE Winter Conference on Applications of Computer Vision (WACV), 2020, pp. 310-319


Automatic synthesis of realistic eye images with prescribed gaze direction is important for multiple application domains. We introduce EyeGAN, an algorithm to generate eye images in the style of a desired target domain, that inherit annotations available in images from a source domain. EyeGAN takes in input ternary masks, which are used as domain-independent proxies for gaze direction. We evaluate EyeGAN against competing eye image synthesis algorithms by measuring a specific gaze consistency index. In addition, we present results from multiple experiments (involving eye region segmentation, pupil localization, and gaze direction estimation) showing that the use of EyeGAN generated images with inherited annotations for network training leads to superior performances compared to other domain transfer algorithms.

Related Material

author = {Kaur, Harsimran and Manduchi, Roberto},
title = {EyeGAN: Gaze-Preserving, Mask-Mediated Eye Image Synthesis},
booktitle = {The IEEE Winter Conference on Applications of Computer Vision (WACV)},
month = {March},
year = {2020}