Pose-Guided Knowledge Transfer for Object Part Segmentation

Shujon Naha, Qingyang Xiao, Prianka Banik, Md Alimoor Reza, David J. Crandall; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2020, pp. 906-907

Object part segmentation is an important problem for many applications, but generating the annotations to train a part segmentation model is typically quite labor-intensive.Recently, Fang et al. [6] augmented object part segmentation datasets by using keypoint locations as weak supervision to transfer a source object instance's part annotations to an unlabeled target object. We show that while their approach works well when the source and target objects have clearly visible keypoints, it often fails for severely articulated poses. Also, their model does not generalize well across multiple object classes, even if they are very similar. In this paper, we propose and evaluate a new model for transferring part segmentations using keypoints, even for complex object poses and across different object classes.