Simultaneous Clustering and Tracklet Linking for Multi-face Tracking in Videos

Baoyuan Wu, Siwei Lyu, Bao-Gang Hu, Qiang Ji; The IEEE International Conference on Computer Vision (ICCV), 2013, pp. 2856-2863

Abstract


We describe a novel method that simultaneously clusters and associates short sequences of detected faces (termed as face tracklets) in videos. The rationale of our method is that face tracklet clustering and linking are related problems that can benefit from the solutions of each other. Our method is based on a hidden Markov random field model that represents the joint dependencies of cluster labels and tracklet linking associations . We provide an efficient algorithm based on constrained clustering and optimal matching for the simultaneous inference of cluster labels and tracklet associations. We demonstrate significant improvements on the state-of-the-art results in face tracking and clustering performances on several video datasets.

Related Material


[pdf]
[bibtex]
@InProceedings{Wu_2013_ICCV,
author = {Wu, Baoyuan and Lyu, Siwei and Hu, Bao-Gang and Ji, Qiang},
title = {Simultaneous Clustering and Tracklet Linking for Multi-face Tracking in Videos},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {December},
year = {2013}
}