NTIRE 2022 Spectral Demosaicing Challenge and Data Set

Boaz Arad, Radu Timofte, Rony Yahel, Nimrod Morag, Amir Bernat, Yaqi Wu, Xun Wu, Zhihao Fan, Chenjie Xia, Feng Zhang, Shuai Liu, Yongqiang Li, Chaoyu Feng, Lei Lei, Mingwei Zhang, Kai Feng, Xun Zhang, Jiaxin Yao, Yongqiang Zhao, Suina Ma, Fan He, Yangyang Dong, Shufang Yu, Difa Qiu, Jinhui Liu, Mengzhao Bi, Beibei Song, WenFang Sun, Jiesi Zheng, Bowen Zhao, Yanpeng Cao, Jiangxin Yang, Yanlong Cao, Xiangyu Kong, Jingbo Yu, Yuanyang Xue, Zheng Xie; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2022, pp. 882-896

Abstract

This paper presents the first challenge on demosaicing of natural spectral images for snapshot hyperspectral imaging systems (HIS) which utilize a multi-spectral filer array (MSFA), i.e., the recovery of whole-scene hyperspectral information from spatially sub-sampled hyperspectral information. This challenge expands the ARAD_1K data set to a first-of-its-kind large-scale data set for multi-spectral filter array demosaicing of natural scenes containing 1,000 images. Challenge participants were required to recover hyperspectral information from synthetically generated MSFA images simulating capture by a known calibrated snapshot mosaic hyperspectral camera. The challenge was attended by 157 teams, with 29 teams competing in the final testing phase, 7 of which provided detailed descriptions of their methodology which are included in this report. The performance of these submissions is reviewed and provided here as a gauge for the current state-of-the-art in multi-spectral filter array demosaicing of natural images.

Related Material

[pdf]
[bibtex]
@InProceedings{Arad_2022_CVPR, author = {Arad, Boaz and Timofte, Radu and Yahel, Rony and Morag, Nimrod and Bernat, Amir and Wu, Yaqi and Wu, Xun and Fan, Zhihao and Xia, Chenjie and Zhang, Feng and Liu, Shuai and Li, Yongqiang and Feng, Chaoyu and Lei, Lei and Zhang, Mingwei and Feng, Kai and Zhang, Xun and Yao, Jiaxin and Zhao, Yongqiang and Ma, Suina and He, Fan and Dong, Yangyang and Yu, Shufang and Qiu, Difa and Liu, Jinhui and Bi, Mengzhao and Song, Beibei and Sun, WenFang and Zheng, Jiesi and Zhao, Bowen and Cao, Yanpeng and Yang, Jiangxin and Cao, Yanlong and Kong, Xiangyu and Yu, Jingbo and Xue, Yuanyang and Xie, Zheng}, title = {NTIRE 2022 Spectral Demosaicing Challenge and Data Set}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops}, month = {June}, year = {2022}, pages = {882-896} }