Thematic Saliency Detection Using Spatial-Temporal Context

Ye Luo, Gangqiang Zhao, Junsong Yuan; Proceedings of the IEEE International Conference on Computer Vision (ICCV) Workshops, 2013, pp. 347-353


We propose a new measurement of video saliency termed thematic video saliency. Video saliency is detected in terms of finding the thematic objects that frequently appear at the salient positions in the video scenes. By representing all image segments in the video as the spatial-temporal context, we build an affinity graph among them, and formulate the thematic object discovery as a novel cohesive sub-graph mining problem. A trust region algorithm is also proposed to solve the challenging optimization problem. Unlike individual image saliency or co-saliency analysis, our proposed video saliency fully incorporates the whole spatialtemporal video context. Experiments on our newly developed eye tracking dataset as well as other two datasets further validate the effectiveness of our method on video saliency detection.

Related Material

author = {Ye Luo and Gangqiang Zhao and Junsong Yuan},
title = {Thematic Saliency Detection Using Spatial-Temporal Context},
booktitle = {Proceedings of the IEEE International Conference on Computer Vision (ICCV) Workshops},
month = {June},
year = {2013}