HistoNet: Predicting size histograms of object instances

Kishan Sharma, Moritz Gold, Christian Zurbruegg, Laura Leal-Taixe, Jan Dirk Wegner; Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2020, pp. 3637-3645

Abstract


We propose to predict histograms of object sizes in crowded scenes directly without any explicit object instance segmentation. What makes this task challenging is the high density of objects (of the same category), which makes instance identification hard. Instead of explicitly segmenting object instances, we show that directly learning histograms of object sizes improves accuracy while using drastically less parameters. This is very useful for application scenarios where explicit, pixel-accurate instance segmentation is not needed, but their lies interest in the overall distribution of instance sizes. Our core applications are in biology, where we estimate the size distribution of soldier fly larvae, and medicine, where we estimate the size distribution of cancer cells as an intermediate step to calculate tumor cellularity score. Given an image with hundreds of small object instances, we output the total count and the size histogram. We also provide a new data set for this task, the FlyLarvae data set, which consists of 11,000 larvae instances labeled pixel-wise. Our method results in an overall improvement in the count and size distribution prediction as compared to state-of-the-art instance segmentation method Mask R-CNN.

Related Material


[pdf] [video]
[bibtex]
@InProceedings{Sharma_2020_WACV,
author = {Sharma, Kishan and Gold, Moritz and Zurbruegg, Christian and Leal-Taixe, Laura and Wegner, Jan Dirk},
title = {HistoNet: Predicting size histograms of object instances},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {March},
year = {2020}
}