EyeGAN: Gaze-Preserving, Mask-Mediated Eye Image Synthesis

Harsimran Kaur, Roberto Manduchi; Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2020, pp. 310-319

Abstract


Automatic synthesis of realistic eye images with prescribed gaze direction is important for multiple application domains. We introduce EyeGAN, an algorithm to generate eye images in the style of a desired target domain, that inherit annotations available in images from a source domain. EyeGAN takes in input ternary masks, which are used as domain-independent proxies for gaze direction. We evaluate EyeGAN against competing eye image synthesis algorithms by measuring a specific gaze consistency index. In addition, we present results from multiple experiments (involving eye region segmentation, pupil localization, and gaze direction estimation) showing that the use of EyeGAN generated images with inherited annotations for network training leads to superior performances compared to other domain transfer algorithms.

Related Material


[pdf] [video]
[bibtex]
@InProceedings{Kaur_2020_WACV,
author = {Kaur, Harsimran and Manduchi, Roberto},
title = {EyeGAN: Gaze-Preserving, Mask-Mediated Eye Image Synthesis},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {March},
year = {2020}
}