PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface Reconstruction

Mingzhi Pei, Xu Cao, Xiangyi Wang, Heng Guo, Zhanyu Ma; Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR), 2025, pp. 26834-26843

Abstract


Reflective and textureless surfaces remain a challenge in multi-view 3D reconstruction. Both camera pose calibration and shape reconstruction often fail due to insufficient or unreliable cross-view visual features. To address these issues, we present PMNI (Pose-free Multi-view Normal Integration), a neural surface reconstruction method that incorporates rich geometric information by leveraging surface normal maps instead of RGB images. By enforcing geometric constraints from surface normals and multi-view shape consistency within a neural signed distance function (SDF) optimization framework, PMNI simultaneously recovers accurate camera poses and high-fidelity surface geometry. Experimental results on synthetic and real-world datasets show that our method achieves state-of-the-art performance in the reconstruction of reflective surfaces, even without reliable initial camera poses.

Related Material


[pdf] [supp] [arXiv]
[bibtex]
@InProceedings{Pei_2025_CVPR, author = {Pei, Mingzhi and Cao, Xu and Wang, Xiangyi and Guo, Heng and Ma, Zhanyu}, title = {PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface Reconstruction}, booktitle = {Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR)}, month = {June}, year = {2025}, pages = {26834-26843} }