Adaptive Binarization for Weakly Supervised Affordance Segmentation

Johann Sawatzky, Jurgen Gall; Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017, pp. 1383-1391

The concept of affordance is important to understand the relevance of object parts for a certain functional interac- tion. Affordance types generalize across object categories and are not mutually exclusive. This makes the segmenta- tion of affordance regions of objects in images a difficult task. In this work, we build on an iterative approach that learns a convolutional neural network for affordance seg- mentation from sparse keypoints. During this process, the predictions of the network need to be binarized. To this end, we propose an adaptive approach for binarization and estimate the parameters for initialization by approximated cross validation. We evaluate our approach on two affor- dance datasets where our approach outperforms the state- of-the-art for weakly supervised affordance segmentation.