Multi-agent Event Detection: Localization and Role Assignment

Suha Kwak, Bohyung Han, Joon Hee Han; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, pp. 2682-2689

Abstract


We present a joint estimation technique of event localization and role assignment when the target video event is described by a scenario. Specifically, to detect multi-agent events from video, our algorithm identifies agents involved in an event and assigns roles to the participating agents. Instead of iterating through all possible agent-role combinations, we formulate the joint optimization problem as two efficient subproblems--quadratic programming for role assignment followed by linear programming for event localization. Additionally, we reduce the computational complexity significantly by applying role-specific event detectors to each agent independently. We test the performance of our algorithm in natural videos, which contain multiple target events and nonparticipating agents.

Related Material


[pdf]
[bibtex]
@InProceedings{Kwak_2013_CVPR,
author = {Kwak, Suha and Han, Bohyung and Hee Han, Joon},
title = {Multi-agent Event Detection: Localization and Role Assignment},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2013}
}