-
[pdf]
[bibtex]@InProceedings{Miller_2022_CVPR, author = {Miller, Dimity and Goode, Georgia and Bennie, Callum and Moghadam, Peyman and Jurdak, Raja}, title = {Why Object Detectors Fail: Investigating the Influence of the Dataset}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops}, month = {June}, year = {2022}, pages = {4823-4830} }
Why Object Detectors Fail: Investigating the Influence of the Dataset
Abstract
A false negative in object detection describes an object that was not correctly localised and classified by a detector. In concurrent work, we introduced five 'false negative mechanisms' that identify the specific component inside the detector architecture that failed to detect the object. Using these mechanisms, we explore how different computer vision datasets and their inherent characteristics can influence object detector failures. Specifically, we investigate the false negative mechanisms of Faster R-CNN and RetinaNet across five computer vision datasets, namely Microsoft COCO, Pascal VOC, ExDark, ObjectNet, and COD10K. Our results show that object size and class influence the false negative mechanisms of object detectors. We also show that comparing the false negative mechanisms of a single object class across different datasets can highlight potentially unknown biases in datasets.
Related Material