PI-Net: Pose Interacting Network for Multi-Person Monocular 3D Pose Estimation

Wen Guo, Enric Corona, Francesc Moreno-Noguer, Xavier Alameda-Pineda; Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2021, pp. 2796-2806

Abstract


Recent literature addressed the monocular 3D pose estimation task very satisfactorily. In these studies, different persons are usually treated as independent pose instances to estimate. However, in many every-day situations, people are interacting, and the pose of an individual depends on the pose of his/her interactees. In this paper, we investigate how to exploit these dependency to enhance current, and possibly future, deep networks for 3D monocular pose estimation. Our pose interacting network, or PI-Net, inputs the initial pose estimates of a variable number of interactees into a recurrent network used to refine the pose of the person-of-interest. Evaluating such a method is challenging due to the limited availability of public annotated multi-person 3D human pose datasets. We demonstrate the effectiveness of our method in the MuPoTS dataset, setting the new state-of-the-art on it. Qualitative results on other multi-person datasets (for which 3D pose ground-truth is not available) showcase the proposed PI-Net.

Related Material


[pdf]
[bibtex]
@InProceedings{Guo_2021_WACV, author = {Guo, Wen and Corona, Enric and Moreno-Noguer, Francesc and Alameda-Pineda, Xavier}, title = {PI-Net: Pose Interacting Network for Multi-Person Monocular 3D Pose Estimation}, booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)}, month = {January}, year = {2021}, pages = {2796-2806} }