Deep Octree-Based CNNs With Output-Guided Skip Connections for 3D Shape and Scene Completion

Peng-Shuai Wang, Yang Liu, Xin Tong; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2020, pp. 266-267

Abstract


Acquiring complete and clean 3D shape and scene data is challenging due to geometric occlusion and insufficient views during 3D capturing. We present a simple yet effective deep learning approach for completing the input noisy and incomplete shapes or scenes. Our network is built upon the octree-based CNNs (O-CNN) with U-Net like structures, which enjoys high computational and memory efficiency and supports to construct a very deep network structure for 3D CNNs. A novel output-guided skip-connection is introduced to the network structure for better preserving the input geometry and learning geometry prior from data effectively. We show that with these simple adaptions --- output-guided skip-connection and deeper O-CNN (up to 70 layers), our network achieves state-of-the-art results in 3D shape completion and semantic scene computation.

Related Material


[pdf] [supp]
[bibtex]
@InProceedings{Wang_2020_CVPR_Workshops,
author = {Wang, Peng-Shuai and Liu, Yang and Tong, Xin},
title = {Deep Octree-Based CNNs With Output-Guided Skip Connections for 3D Shape and Scene Completion},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2020}
}