SPLINE-Net: Sparse Photometric Stereo Through Lighting Interpolation and Normal Estimation Networks

Qian Zheng, Yiming Jia, Boxin Shi, Xudong Jiang, Ling-Yu Duan, Alex C. Kot; The IEEE International Conference on Computer Vision (ICCV), 2019, pp. 8549-8558

Abstract


This paper solves the Sparse Photometric stereo through Lighting Interpolation and Normal Estimation using a generative Network (SPLINE-Net). SPLINE-Net contains a lighting interpolation network to generate dense lighting observations given a sparse set of lights as inputs followed by a normal estimation network to estimate surface normals. Both networks are jointly constrained by the proposed symmetric and asymmetric loss functions to enforce isotropic constrain and perform outlier rejection of global illumination effects. SPLINE-Net is verified to outperform existing methods for photometric stereo of general BRDFs by using only ten images of different lights instead of using nearly one hundred images.

Related Material


[pdf]
[bibtex]
@InProceedings{Zheng_2019_ICCV,
author = {Zheng, Qian and Jia, Yiming and Shi, Boxin and Jiang, Xudong and Duan, Ling-Yu and Kot, Alex C.},
title = {SPLINE-Net: Sparse Photometric Stereo Through Lighting Interpolation and Normal Estimation Networks},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {October},
year = {2019}
}