Multi-Scale Patch Aggregation (MPA) for Simultaneous Detection and Segmentation

Shu Liu, Xiaojuan Qi, Jianping Shi, Hong Zhang, Jiaya Jia; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 3141-3149

Abstract


Aiming at simultaneous detection and segmentation (SDS), we propose a proposal-free framework, which detect and segment object instances via mid-level patches. We design a unified trainable network on patches, which is followed by a fast and effective patch aggregation algorithm to infer object instances. Our method benefits from end-to-end training. Without object proposal generation, computation time can also be reduced. In experiments, our method yields results 62.1% and 61.8% in terms of mAPr on VOC2012 segmentation val and VOC2012 SDS val, which are state-of-the-art at the time of submission. We also report results on Microsoft COCO test-std/test-dev dataset in this paper.

Related Material


[pdf] [video]
[bibtex]
@InProceedings{Liu_2016_CVPR,
author = {Liu, Shu and Qi, Xiaojuan and Shi, Jianping and Zhang, Hong and Jia, Jiaya},
title = {Multi-Scale Patch Aggregation (MPA) for Simultaneous Detection and Segmentation},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2016}
}