Diverse Image Synthesis From Semantic Layouts via Conditional IMLE

Ke Li, Tianhao Zhang, Jitendra Malik; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 4220-4229

Abstract


Most existing methods for conditional image synthesis are only able to generate a single plausible image for any given input, or at best a fixed number of plausible images. In this paper, we focus on the problem of generating images from semantic segmentation maps and present a simple new method that can generate an arbitrary number of images with diverse appearance for the same semantic layout. Unlike most existing approaches which adopt the GAN framework, our method is based on the recently introduced Implicit Maximum Likelihood Estimation (IMLE) framework. Compared to the leading approach, our method is able to generate more diverse images while producing fewer artifacts despite using the same architecture. The learned latent space also has sensible structure despite the lack of supervision that encourages such behaviour.

Related Material


[pdf] [supp]
[bibtex]
@InProceedings{Li_2019_ICCV,
author = {Li, Ke and Zhang, Tianhao and Malik, Jitendra},
title = {Diverse Image Synthesis From Semantic Layouts via Conditional IMLE},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2019}
}