Semi-Supervised Semantic Segmentation With Pixel-Level Contrastive Learning From a Class-Wise Memory Bank

Inigo Alonso, Alberto Sabater, David Ferstl, Luis Montesano, Ana C. Murillo; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 8219-8228

Abstract


This work presents a novel approach for semi-supervised semantic segmentation. The key element of this approach is our contrastive learning module that enforces the segmentation network to yield similar pixel-level feature representations for same-class samples across the whole dataset. To achieve this, we maintain a memory bank which is continuously updated with relevant and high-quality feature vectors from labeled data. In an end-to-end training, the features from both labeled and unlabeled data are optimized to be similar to same-class samples from the memory bank. Our approach not only outperforms the current state-of-the-art for semi-supervised semantic segmentation but also for semi-supervised domain adaptation on well-known public benchmarks, with larger improvements on the most challenging scenarios, i.e., less available labeled data. Code is available at https://github.com/Shathe/SemiSeg-Contrastive

Related Material


[pdf] [supp] [arXiv]
[bibtex]
@InProceedings{Alonso_2021_ICCV, author = {Alonso, Inigo and Sabater, Alberto and Ferstl, David and Montesano, Luis and Murillo, Ana C.}, title = {Semi-Supervised Semantic Segmentation With Pixel-Level Contrastive Learning From a Class-Wise Memory Bank}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)}, month = {October}, year = {2021}, pages = {8219-8228} }