What was Monet seeing while painting? Translating artworks to photo-realistic images

Matteo Tomei, Lorenzo Baraldi, Marcella Cornia, Rita Cucchiara; Proceedings of the European Conference on Computer Vision (ECCV) Workshops, 2018, pp. 0-0

Abstract


State of the art Computer Vision techniques exploit the availability of large-scale datasets, most of which consist of images captured from the world as it is. This brings to an incompatibility between such methods and digital data from the artistic domain, on which current techniques under-perform. A possible solution is to reduce the domain shift at the pixel level, thus translating artistic images to realistic copies. In this paper, we present a model capable of translating paintings to photo-realistic images, trained without paired examples. The idea is to enforce a patch level similarity between real and generated images, aiming to reproduce photo-realistic details from a memory bank of real images. This is subsequently adopted in the context of an unpaired image-to-image translation framework, mapping each image from one distribution to a new one belonging to the other distribution. Qualitative and quantitative results are presented on Monet, Cezanne and Van Gogh paintings translation tasks, showing that our approach increases the realism of generated images with respect to the CycleGAN approach.

Related Material


[pdf]
[bibtex]
@InProceedings{Tomei_2018_ECCV_Workshops,
author = {Tomei, Matteo and Baraldi, Lorenzo and Cornia, Marcella and Cucchiara, Rita},
title = {What was Monet seeing while painting? Translating artworks to photo-realistic images},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV) Workshops},
month = {September},
year = {2018}
}