3DCapture: 3D Reconstruction for a Smartphone

Oleg Muratov, Yury Slynko, Vitaly Chernov, Maria Lyubimtseva, Artem Shamsuarov, Victor Bucha; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2016, pp. 75-82


We propose a method of reconstruction of 3D representation (a mesh with a texture) of an object on a smartphone with a monocular camera. The reconstruction consists of two parts - real-time scanning around the object and post processing. At the scanning stage IMU sensors data are acquired along with tracks of features in video. A special care is taken to comply with 360 scan requirement. All these data are used to build a camera trajectory at offline stage using bundle adjustment techniques. This trajectory is used in calculation of depth maps, which are used to construct a polygonal mesh with overlaid textures. The proposed method allows online tracking at 30 fps on a modern smartphone while the offline part is completed within 1 minute using an OpenCL compatible mobile GPU. In addition, we show that with a few modifications this algorithm can be adopted for human face reconstruction.

Related Material

author = {Muratov, Oleg and Slynko, Yury and Chernov, Vitaly and Lyubimtseva, Maria and Shamsuarov, Artem and Bucha, Victor},
title = {3DCapture: 3D Reconstruction for a Smartphone},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2016}