Normalizing Flow as a Flexible Fidelity Objective for Photo-Realistic Super-Resolution

Andreas Lugmayr, Martin Danelljan, Fisher Yu, Luc Van Gool, Radu Timofte; Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022, pp. 1756-1765

Abstract


Super-resolution is an ill-posed problem, where a ground-truth high-resolution image represents only one possibility in the space of plausible solutions. Yet, the dominant paradigm is to employ pixel-wise losses, such as L_1, which drive the prediction towards a blurry average. This leads to fundamentally conflicting objectives when combined with adversarial losses, which degrades the final quality. We address this issue by revisiting the L_1 loss and show that it corresponds to a one-layer conditional flow. Inspired by this relation, we explore general flows as a fidelity-based alternative to the L_1 objective. We demonstrate that the flexibility of deeper flows leads to better visual quality and consistency when combined with adversarial losses. We conduct extensive user studies for three datasets and scale factors, where our approach is shown to outperform state-of-the-art methods for photo-realistic super-resolution.

Related Material


[pdf] [supp] [arXiv]
[bibtex]
@InProceedings{Lugmayr_2022_WACV, author = {Lugmayr, Andreas and Danelljan, Martin and Yu, Fisher and Van Gool, Luc and Timofte, Radu}, title = {Normalizing Flow as a Flexible Fidelity Objective for Photo-Realistic Super-Resolution}, booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)}, month = {January}, year = {2022}, pages = {1756-1765} }