Convolutional Relational Machine for Group Activity Recognition

Sina Mokhtarzadeh Azar, Mina Ghadimi Atigh, Ahmad Nickabadi, Alexandre Alahi; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 7892-7901

Abstract


We present an end-to-end deep Convolutional Neural Network called Convolutional Relational Machine (CRM) for recognizing group activities that utilizes the information in spatial relations between individual persons in image or video. It learns to produce an intermediate spatial representation (activity map) based on individual and group activities. A multi-stage refinement component is responsible for decreasing the incorrect predictions in the activity map. Finally, an aggregation component uses the refined information to recognize group activities. Experimental results demonstrate the constructive contribution of the information extracted and represented in the form of the activity map. CRM shows advantages over state-of-the-art models on Volleyball and Collective Activity datasets.

Related Material


[pdf] [supp]
[bibtex]
@InProceedings{Azar_2019_CVPR,
author = {Azar, Sina Mokhtarzadeh and Atigh, Mina Ghadimi and Nickabadi, Ahmad and Alahi, Alexandre},
title = {Convolutional Relational Machine for Group Activity Recognition},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}
}