Generalized Foggy-Scene Semantic Segmentation by Frequency Decoupling

Qi Bi, Shaodi You, Theo Gevers; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024, pp. 1389-1399

Foggy-scene semantic segmentation (FSSS) is highly challenging due to the diverse effects of fog on scene properties and the limited training data. Existing research has mainly focused on domain adaptation for FSSS which has practical limitations when dealing with new scenes. In our paper we introduce domain-generalized FSSS which can work effectively on unknown distributions without extensive training. To address domain gaps we propose a frequency decoupling (FreD) approach that separates fog-related effects (amplitude) from scene semantics (phase) in feature representations. Our method is compatible with both CNN and Vision Transformer backbones and outperforms existing approaches in various scenarios.