Complexer YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Clouds

Martin Simon, Karl Amende, Andrea Kraus, Jens Honer, Timo Saemann, Hauke Kaulbersch, Stefan Milz, Horst-Michael Gross; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019, pp. 1-10

Abstract


Accurate detection of 3D objects is a fundamental problem in computer vision and has an enormous impact on autonomous cars, augmented/virtual reality and many applications in robotics. In this work we present a novel fusion of neural network based state-of-the-art 3D detector and visual semantic segmentation in the context of autonomous driving. Additionally, we introduce Scale-Rotation-Translation score (SRTs), a fast and highly parameterizable evaluation metric for comparison of object detections, which speeds up our inference time up to 20% and halves training time. On top, we apply state-of-the-art online multi target feature tracking on the object measurements to further increase accuracy and robustness utilizing temporal information. Our experiments on KITTI show that we achieve same results as state-of-the-art in all related categories, while maintaining the performance and accuracy trade-off and still run in real-time. Furthermore, our model is the first one that fuses visual semantic with 3D object detection.

Related Material


[pdf]
[bibtex]
@InProceedings{Simon_2019_CVPR_Workshops,
author = {Simon, Martin and Amende, Karl and Kraus, Andrea and Honer, Jens and Saemann, Timo and Kaulbersch, Hauke and Milz, Stefan and Gross, Horst-Michael},
title = {Complexer YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Clouds},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2019}
}