Zero-Shot Noise2Noise: Efficient Image Denoising Without Any Data

Youssef Mansour, Reinhard Heckel; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 14018-14027

Abstract


Recently, self-supervised neural networks have shown excellent image denoising performance. However, current dataset free methods are either computationally expensive, require a noise model, or have inadequate image quality. In this work we show that a simple 2-layer network, without any training data or knowledge of the noise distribution, can enable high-quality image denoising at low computational cost. Our approach is motivated by Noise2Noise and Neighbor2Neighbor and works well for denoising pixel-wise independent noise. Our experiments on artificial, real-world camera, and microscope noise show that our method termed ZS-N2N (Zero Shot Noise2Noise) often outperforms existing dataset-free methods at a reduced cost, making it suitable for use cases with scarce data availability and limited compute.

Related Material


[pdf] [supp] [arXiv]
[bibtex]
@InProceedings{Mansour_2023_CVPR, author = {Mansour, Youssef and Heckel, Reinhard}, title = {Zero-Shot Noise2Noise: Efficient Image Denoising Without Any Data}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, month = {June}, year = {2023}, pages = {14018-14027} }