From Ego to Nos-vision: Detecting Social Relationships in First-Person Views

Stefano Alletto, Giuseppe Serra, Simone Calderara, Francesco Solera, Rita Cucchiara; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2014, pp. 580-585

Abstract


In this paper we present a novel approach to detect groups in ego-vision scenarios. People in the scene are tracked through the video sequence and their head pose and 3D location are estimated. Based on the concept of f-formation, we define with the orientation and distance an inherently social pairwise feature that describes the affinity of a pair of people in the scene. We apply a correlation clustering algorithm that merges pairs of people into socially related groups. Due to the very shifting nature of social interactions and the different meanings that orientations and distances can assume in different contexts, we learn the weight vector of the correlation clustering using Structural SVMs. We extensively test our approach on two publicly available datasets showing encouraging results when detecting groups from first-person camera views.

Related Material


[pdf]
[bibtex]
@InProceedings{Alletto_2014_CVPR_Workshops,
author = {Alletto, Stefano and Serra, Giuseppe and Calderara, Simone and Solera, Francesco and Cucchiara, Rita},
title = {From Ego to Nos-vision: Detecting Social Relationships in First-Person Views},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2014}
}