MIPI 2023 Challenge on RGB+ToF Depth Completion: Methods and Results

Qingpeng Zhu, Wenxiu Sun, Yuekun Dai, Chongyi Li, Shangchen Zhou, Ruicheng Feng, Qianhui Sun, Chen Change Loy, Jinwei Gu, Yi Yu, Yangke Huang, Kang Zhang, Meiya Chen, Yu Wang, Yongchao Li, Hao Jiang, Amrit Kumar Muduli, Vikash Kumar, Kunal Swami, Pankaj Kumar Bajpai, Yunchao Ma, Jiajun Xiao, Zhi Ling; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2023, pp. 2864-2870


Depth completion from RGB images and sparse Time-of-Flight (ToF) measurements is an important problem in computer vision and robotics. While traditional methods for depth completion have relied on stereo vision or structured light techniques, recent advances in deep learning have enabled more accurate and efficient completion of depth maps from RGB images and sparse ToF measurements. To evaluate the performance of different depth completion methods, we organized an RGB+sparse ToF depth completion competition. The competition aimed to encourage research in this area by providing a standardized dataset and evaluation metrics to compare the accuracy of different approaches. In this report, we present the results of the competition and analyze the strengths and weaknesses of the top-performing methods. We also discuss the implications of our findings for future research in RGB+sparse ToF depth completion. We hope that this competition and report will help to advance the state-of-the-art in this important area of research. More details of this challenge and the link to the dataset can be found at https://mipi-challenge.org/MIPI2023/.

Related Material

@InProceedings{Zhu_2023_CVPR, author = {Zhu, Qingpeng and Sun, Wenxiu and Dai, Yuekun and Li, Chongyi and Zhou, Shangchen and Feng, Ruicheng and Sun, Qianhui and Loy, Chen Change and Gu, Jinwei and Yu, Yi and Huang, Yangke and Zhang, Kang and Chen, Meiya and Wang, Yu and Li, Yongchao and Jiang, Hao and Muduli, Amrit Kumar and Kumar, Vikash and Swami, Kunal and Bajpai, Pankaj Kumar and Ma, Yunchao and Xiao, Jiajun and Ling, Zhi}, title = {MIPI 2023 Challenge on RGB+ToF Depth Completion: Methods and Results}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops}, month = {June}, year = {2023}, pages = {2864-2870} }