uLayout: Unified Room Layout Estimation for Perspective and Panoramic Images

Jonathan Lee, Bolivar E Solarte, Chin-Hsuan Wu, Jin-Cheng Jhang, Fu-En Wang, Yi-Hsuan Tsai, Min Sun; Proceedings of the Winter Conference on Applications of Computer Vision (WACV), 2025, pp. 8399-8408

Abstract


We present uLayout a unified model for estimating room layout geometries from both perspective and panoramic images whereas traditional solutions require different model designs for each image type. The key idea of our solution is to unify both domains into the equirectangular projection particularly allocating perspective images into the most suitable latitude coordinate to effectively exploit both domains seamlessly. To address the Field-of-View (FoV) difference between the input domains we design uLayout with a shared feature extractor with an extra 1D-Convolution layer to condition each domain input differently. This conditioning allows us to efficiently formulate a column-wise feature regression problem regardless of the FoV input. This simple yet effective approach achieves competitive performance with current state-of-the-art solutions and shows for the first time a single end-to-end model for both domains. Extensive experiments in the real-world datasets LSUN Matterport3D PanoContext and Stanford 2D-3D evidence the contribution of our approach. Code is available at https://github.com/JonathanLee112/uLayout

Related Material


[pdf] [supp]
[bibtex]
@InProceedings{Lee_2025_WACV, author = {Lee, Jonathan and E Solarte, Bolivar and Wu, Chin-Hsuan and Jhang, Jin-Cheng and Wang, Fu-En and Tsai, Yi-Hsuan and Sun, Min}, title = {uLayout: Unified Room Layout Estimation for Perspective and Panoramic Images}, booktitle = {Proceedings of the Winter Conference on Applications of Computer Vision (WACV)}, month = {February}, year = {2025}, pages = {8399-8408} }