Depth Interpolation via Smooth Surface Segmentation Using Tangent Planes Based on the Superpixels of a Color Image

Kiyoshi Matsuo, Yoshimitsu Aoki; Proceedings of the IEEE International Conference on Computer Vision (ICCV) Workshops, 2013, pp. 29-36

This paper describes a method for accurately interpolating a low-resolution depth image using a high-resolution color image. In our method, first, tangent planes on each superpixel are estimated from the sparse depth information and dense color information. Then, the neighboring superpixels that have smooth-connectable tangent planes are connected, and the image segmentation to smooth surfaces are achieved. Finally, the low-resolution depth image is interpolated using this smooth surface segmentation. In experiments with images from the Middlebury stereo datasets, our method interpolates each image at a high rate, and achieves the lowest error when compared to existing techniques.