CollaGAN: Collaborative GAN for Missing Image Data Imputation

Dongwook Lee, Junyoung Kim, Won-Jin Moon, Jong Chul Ye; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 2487-2496

Abstract


In many applications requiring multiple inputs to obtain a desired output, if any of the input data is missing, it often introduces large amounts of bias. Although many techniques have been developed for imputing missing data, the image imputation is still difficult due to complicated nature of natural images. To address this problem, here we proposed a novel framework for missing image data imputation, called Collaborative Generative Adversarial Network (CollaGAN). CollaGAN convert the image imputation problem to a multi-domain images-to-image translation task so that a single generator and discriminator network can successfully estimate the missing data using the remaining clean data set. We demonstrate that CollaGAN produces the images with a higher visual quality compared to the existing competing approaches in various image imputation tasks.

Related Material


[pdf] [supp] [video]
[bibtex]
@InProceedings{Lee_2019_CVPR,
author = {Lee, Dongwook and Kim, Junyoung and Moon, Won-Jin and Ye, Jong Chul},
title = {CollaGAN: Collaborative GAN for Missing Image Data Imputation},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}
}