Track and Segment: An Iterative Unsupervised Approach for Video Object Proposals

Fanyi Xiao, Yong Jae Lee; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 933-942

Abstract


We present an unsupervised approach that generates a diverse, ranked set of bounding box and segmentation video object proposals---spatio-temporal tubes that localize the foreground objects---in an unannotated video. In contrast to previous unsupervised methods that either track regions initialized in an arbitrary frame or train a fixed model over a cluster of regions, we instead discover a set of easy-to-group instances of an object and then iteratively update its appearance model to gradually detect harder instances in temporally-adjacent frames. Our method first generates a set of spatio-temporal bounding box proposals, and then refines them to obtain pixel-wise segmentation proposals. Through extensive experiments, we demonstrate state-of-the-art segmentation results on the SegTrack v2 dataset, and bounding box tracking results that perform competitively to state-of-the-art supervised tracking methods.

Related Material


[pdf]
[bibtex]
@InProceedings{Xiao_2016_CVPR,
author = {Xiao, Fanyi and Jae Lee, Yong},
title = {Track and Segment: An Iterative Unsupervised Approach for Video Object Proposals},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2016}
}