Single Image Reflection Separation With Perceptual Losses

Xuaner Zhang, Ren Ng, Qifeng Chen; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 4786-4794

Abstract


We present an approach to separating reflection from a single image. The approach uses a fully convolutional network trained end-to-end with losses that exploit low-level and high-level image information. Our loss function includes two perceptual losses: a feature loss from a visual perception network, and an adversarial loss that encodes characteristics of images in the transmission layers. We also propose a novel exclusion loss that enforces pixel-level layer separation. We create a dataset of real-world images with reflection and corresponding ground-truth transmission layers for quantitative evaluation and model training. We validate our method through comprehensive quantitative experiments and show that our approach outperforms state-of-the-art reflection removal methods in PSNR, SSIM, and perceptual user study. We also extend our method to two other image enhancement tasks to demonstrate the generality of our approach.

Related Material


[pdf] [arXiv]
[bibtex]
@InProceedings{Zhang_2018_CVPR,
author = {Zhang, Xuaner and Ng, Ren and Chen, Qifeng},
title = {Single Image Reflection Separation With Perceptual Losses},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
}