Single Image Multi-Spectral Photometric Stereo Using a Split U-Shaped CNN

Doris Antensteiner, Svorad Stolc, Daniel Soukup; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019, pp. 0-0

Abstract


We present a system to extract surface orientation and albedos from a single shot image using three differently colored illumination sources. Photometric stereo allows one to extract local surface information such as normals or gradients. Traditionally, the local orientations and albedos are computed using serveral acquisitions of the same viewing angle and under varying illumination directions. In applications with moving objects, where the acquisition- as well as processing speed are essential, such setups are poorly suited. We propose a single shot decomposition using three differently colored light sources under defined illumination directions. To allow for a fast and regularized inference, we built a split U-shaped convolutional neural network, which takes a single shot input and estimates both the surface orientation and albedo simultaneously.

Related Material


[pdf]
[bibtex]
@InProceedings{Antensteiner_2019_CVPR_Workshops,
author = {Antensteiner, Doris and Stolc, Svorad and Soukup, Daniel},
title = {Single Image Multi-Spectral Photometric Stereo Using a Split U-Shaped CNN},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2019}
}