Local Non-Rigid Structure-From-Motion From Diffeomorphic Mappings

Shaifali Parashar, Mathieu Salzmann, Pascal Fua; The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 2059-2067


We propose a new formulation to non-rigid structure-from-motion that only requires the deforming surface to preserve its differential structure. This is a much weaker assumption than the traditional ones of isometry or conformality. We show that it is nevertheless sufficient to establish local correspondences between the surface in two different images and therefore to perform point-wise reconstruction using only first-order derivatives. To this end, we formulate differential constraints and solve them algebraically using the theory of resultants. We will demonstrate that our approach is more widely applicable, more stable in noisy and sparse imaging conditions and much faster than earlier ones, while delivering similar accuracy. The code is available at https://github.com/cvlab-epfl/diff-nrsfm/.

Related Material

[pdf] [supp]
author = {Parashar, Shaifali and Salzmann, Mathieu and Fua, Pascal},
title = {Local Non-Rigid Structure-From-Motion From Diffeomorphic Mappings},
booktitle = {The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2020}