Cross-Grained Contrastive Representation for Unsupervised Lesion Segmentation in Medical Images

Ziqi Yu, Botao Zhao, Yipin Zhang, Shengjie Zhang, Xiang Chen, Haibo Yang, Tingying Peng, Xiao-Yong Zhang; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, 2023, pp. 2347-2354

Automatic segmentation of lesions in medical images plays a crucial role in the quantitative assessment of disease progression. While supervised deep learning-based methods have been successful in numerous segmentation tasks, they rely on a large number of labelled images for training, which can be expensive and time-consuming to acquire. Although unsupervised learning shows potentials in addressing this challenge, the performance of current unsupervised algorithms is mostly unsatisfactory. To overcome this issue, we propose a new unsupervised framework for medical lesion segmentation using a novel cross-granularity contrastive (CGC) module. Our module contains coarse-grained and fine-grained discrimination paths that enable the network to capture the distinctions between lesions and normal tissues at different levels of context. We evaluate our method on two large public datasets of CT/MRI scans and demonstrate that our approach improves a Gaussian mixture model-based segmentation by up to 9%, which surpasses all other unsupervised segmentation methods by a large margin. Additionally, our module can also be integrated with other existing unsupervised segmentation methods to further enhance their performance. Therefore, our framework shows great potential for use in medical image applications with limited labelled data availability. The code of this work will be released via https://github.com/yu02019.