Polarimetric Helmholtz Stereopsis

Yuqi Ding, Yu Ji, Mingyuan Zhou, Sing Bing Kang, Jinwei Ye; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 5037-5046


Helmholtz stereopsis (HS) exploits the reciprocity principle of light propagation (i.e., the Helmholtz reciprocity) for 3D reconstruction of surfaces with arbitrary reflectance. In this paper, we present the polarimetric Helmholtz stereopsis (polar-HS), which extends the classical HS by considering the polarization state of light in the reciprocal paths. With the additional phase information from polarization, polar-HS requires only one reciprocal image pair. We formulate new reciprocity and diffuse/specular polarimetric constraints to recover surface depths and normals using an optimization framework. Using a hardware prototype, we show that our approach produces high-quality 3D reconstruction for different types of surfaces, ranging from diffuse to highly specular.

Related Material

[pdf] [supp]
@InProceedings{Ding_2021_ICCV, author = {Ding, Yuqi and Ji, Yu and Zhou, Mingyuan and Kang, Sing Bing and Ye, Jinwei}, title = {Polarimetric Helmholtz Stereopsis}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)}, month = {October}, year = {2021}, pages = {5037-5046} }