Real-Time 4K Super-Resolution of Compressed AVIF Images. AIS 2024 Challenge Survey

Conde, Marcos V.; Lei, Zhijun; Li, Wen; Katsavounidis, Ioannis; Timofte, Radu; Yan, Min; Liu, Xin; Wang, Qian; Ye, Xiaoqian; Du, Zhan; Zhang, Tiansen; Li, Zhiyuan; Wei, Hao; Ge, Chenyang; Lv, Jiangtao; Sun, Long; Pan, Jinshan; Dong, Jiangxin; Tang, Jinhui; Zhou, Menghan; Yan, Yiqiang; Yoon, Kihwan; Gankhuyag, Ganzorig; Lee, Jae-Hyeon; Choi, Ui-Jin; Moon, Hyeon-Cheol; Jeong, Tae-Hyun; Yang, Yoonmo; Kim, Jae-Gon; Jeong, Jinwoo; Kim, Sunjei; Qiu, Xintao; Zhou, Yuanbo; Wu, Kongxian; Dai, Xinwei; Tang, Hui; Deng, Wei; Gao, Qingquan; Tong, Tong; Peng, Long; Guo, Jiaming; Di, Xin; Liao, Bohao; Du, Zhibo; Xia, Peize; Pei, Renjing; Wang, Yang; Cao, Yang; Zha, Zhengjun; Han, Bingnan; Yu, Hongyuan; Wu, Zhuoyuan; Wan, Cheng; Liu, Yuqing; Yu, Haodong; Li, Jizhe; Huang, Zhijuan; Huang, Yuan; Zou, Yajun; Guan, Xianyu; Jia, Qi; Zhang, Heng; Yin, Xuanwu; Zuo, Kunlong; Zhang, Dongyang; Liu, Tianle; Chen, Huaian; Jin, Yi

Marcos V. Conde, Zhijun Lei, Wen Li, Ioannis Katsavounidis, Radu Timofte, Min Yan, Xin Liu, Qian Wang, Xiaoqian Ye, Zhan Du, Tiansen Zhang, Zhiyuan Li, Hao Wei, Chenyang Ge, Jiangtao Lv, Long Sun, Jinshan Pan, Jiangxin Dong, Jinhui Tang, Menghan Zhou, Yiqiang Yan, Kihwan Yoon, Ganzorig Gankhuyag, Jae-Hyeon Lee, Ui-Jin Choi, Hyeon-Cheol Moon, Tae-Hyun Jeong, Yoonmo Yang, Jae-Gon Kim, Jinwoo Jeong, Sunjei Kim, Xintao Qiu, Yuanbo Zhou, Kongxian Wu, Xinwei Dai, Hui Tang, Wei Deng, Qingquan Gao, Tong Tong, Long Peng, Jiaming Guo, Xin Di, Bohao Liao, Zhibo Du, Peize Xia, Renjing Pei, Yang Wang, Yang Cao, Zhengjun Zha, Bingnan Han, Hongyuan Yu, Zhuoyuan Wu, Cheng Wan, Yuqing Liu, Haodong Yu, Jizhe Li, Zhijuan Huang, Yuan Huang, Yajun Zou, Xianyu Guan, Qi Jia, Heng Zhang, Xuanwu Yin, Kunlong Zuo, Dongyang Zhang, Tianle Liu, Huaian Chen, Yi Jin; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024, pp. 5838-5856

Abstract

This paper introduces a novel benchmark for efficient image upscaling as part of the AIS 2024 Real-Time Image Super-Resolution (RTSR) Challenge which aims to upscale compressed images from 540p to native 4K resolution (4x factor) in real-time on commercial GPUs. For this we use a diverse test set containing diverse 4K images ranging from digital art to gaming and photography. The images are compressed using the modern AVIF codec instead of JPEG. All the proposed methods improve PSNR fidelity over Lanczos interpolation and process images under 30ms. Out of the 160 participants 25 teams submitted their code. This survey considers only the most novel solutions models making it the most comprehensive benchmark on real-time SR of compressed images using modern codecs.

Related Material

[pdf] [arXiv]

[bibtex]

@InProceedings{Conde_2024_CVPR, author = {Conde, Marcos V. and Lei, Zhijun and Li, Wen and Katsavounidis, Ioannis and Timofte, Radu and Yan, Min and Liu, Xin and Wang, Qian and Ye, Xiaoqian and Du, Zhan and Zhang, Tiansen and Li, Zhiyuan and Wei, Hao and Ge, Chenyang and Lv, Jiangtao and Sun, Long and Pan, Jinshan and Dong, Jiangxin and Tang, Jinhui and Zhou, Menghan and Yan, Yiqiang and Yoon, Kihwan and Gankhuyag, Ganzorig and Lee, Jae-Hyeon and Choi, Ui-Jin and Moon, Hyeon-Cheol and Jeong, Tae-Hyun and Yang, Yoonmo and Kim, Jae-Gon and Jeong, Jinwoo and Kim, Sunjei and Qiu, Xintao and Zhou, Yuanbo and Wu, Kongxian and Dai, Xinwei and Tang, Hui and Deng, Wei and Gao, Qingquan and Tong, Tong and Peng, Long and Guo, Jiaming and Di, Xin and Liao, Bohao and Du, Zhibo and Xia, Peize and Pei, Renjing and Wang, Yang and Cao, Yang and Zha, Zhengjun and Han, Bingnan and Yu, Hongyuan and Wu, Zhuoyuan and Wan, Cheng and Liu, Yuqing and Yu, Haodong and Li, Jizhe and Huang, Zhijuan and Huang, Yuan and Zou, Yajun and Guan, Xianyu and Jia, Qi and Zhang, Heng and Yin, Xuanwu and Zuo, Kunlong and Zhang, Dongyang and Liu, Tianle and Chen, Huaian and Jin, Yi}, title = {Real-Time 4K Super-Resolution of Compressed AVIF Images. AIS 2024 Challenge Survey}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops}, month = {June}, year = {2024}, pages = {5838-5856} }