Multi-Bracket High Dynamic Range Imaging With Event Cameras

Nico Messikommer, Stamatios Georgoulis, Daniel Gehrig, Stepan Tulyakov, Julius Erbach, Alfredo Bochicchio, Yuanyou Li, Davide Scaramuzza; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2022, pp. 547-557

Abstract

Modern high dynamic range (HDR) imaging pipelines align and fuse multiple low dynamic range (LDR) images captured at different exposure times. While these methods work well in static scenes, dynamic scenes remain a challenge since the LDR images still suffer from saturation and noise. In such scenarios, event cameras would be a valid complement, thanks to their higher temporal resolution and dynamic range. In this paper, we propose the first multibracket HDR pipeline combining a standard camera with an event camera. Our results show better overall robustness when using events, with improvements in PSNR by up to 5dB on synthetic data and up to 0.7dB on real-world data. We also introduce a new dataset containing bracketed LDR images with aligned events and HDR ground truth.

Related Material

[pdf] [supp] [arXiv]
[bibtex]
@InProceedings{Messikommer_2022_CVPR, author = {Messikommer, Nico and Georgoulis, Stamatios and Gehrig, Daniel and Tulyakov, Stepan and Erbach, Julius and Bochicchio, Alfredo and Li, Yuanyou and Scaramuzza, Davide}, title = {Multi-Bracket High Dynamic Range Imaging With Event Cameras}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops}, month = {June}, year = {2022}, pages = {547-557} }