CSIE: Coded Strip-patterns Image Enhancement Embedded in Structured Light-based Methods

Wei Cao, Yuping Ye, Chu Shi, Zhan Song; Proceedings of the Asian Conference on Computer Vision (ACCV), 2022, pp. 2188-2203

When a coded strip-patterns image (CSI) is captured in a structured light system (SLs), it often suffers from low visibility at low exposure settings. Besides degrading the visual perception of the CSI, this poor quality also significantly affects the performance of 3D model reconstruction. Most of the existing image-enhanced methods, however, focus on processing natural images but not CSI. In this paper, we propose a novel and effective CSI enhancement (CSIE) method designed for SLs. More concretely, a bidirectional perceptual consistency (BPC) criterion, including relative grayscale (RG), exposure, and texture level priors, is first introduced to ensure visual consistency before and after enhancement. Then, constrained by BPC, the optimization function estimates solutions of illumination with piecewise smoothness and reflectance with detail preservation. With well-refined solutions, CSIE results can be achieved accordingly and further improve the details performance of 3D model reconstruction. Experiments on multiple sets of challenging CSI sequences show that our CSIE outperforms the existing used for natural image-enhanced methods in terms of 2D enhancement, point clouds extraction (at least 17 % improvement), and 3D model reconstruction.