Dense Image Registration and Deformable Surface Reconstruction in Presence of Occlusions and Minimal Texture

Dat Tien Ngo, Sanghyuk Park, Anne Jorstad, Alberto Crivellaro, Chang D. Yoo, Pascal Fua; The IEEE International Conference on Computer Vision (ICCV), 2015, pp. 2273-2281

Abstract


Deformable surface tracking from monocular images is well-known to be under-constrained. Occlusions often make the task even more challenging, and can result in failure if the surface is not sufficiently textured. In this work, we explicitly address the problem of 3D reconstruction of poorly textured, occluded surfaces, proposing a framework based on a template-matching approach that scales dense robust features by a relevancy score. Our approach is extensively compared to current methods employing both local feature matching and dense template alignment. We test on standard datasets as well as on a new dataset (that will be made publicly available) of a sparsely textured, occluded surface. Our framework achieves state-of-the-art results for both well and poorly textured, occluded surfaces.

Related Material


[pdf]
[bibtex]
@InProceedings{Ngo_2015_ICCV,
author = {Tien Ngo, Dat and Park, Sanghyuk and Jorstad, Anne and Crivellaro, Alberto and Yoo, Chang D. and Fua, Pascal},
title = {Dense Image Registration and Deformable Surface Reconstruction in Presence of Occlusions and Minimal Texture},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {December},
year = {2015}
}