Fast Image Reconstruction with an Event Camera

Cedric Scheerlinck, Henri Rebecq, Daniel Gehrig, Nick Barnes, Robert Mahony, Davide Scaramuzza; The IEEE Winter Conference on Applications of Computer Vision (WACV), 2020, pp. 156-163

Abstract


Event cameras are powerful new sensors able to capture high dynamic range with microsecond temporal resolution and no motion blur. Their strength is detecting brightness changes (called events) rather than capturing direct brightness images; however, algorithms can be used to convert events into usable image representations for applications such as classification. Previous works rely on hand-crafted spatial and temporal smoothing techniques to reconstruct images from events. State-of-the-art video reconstruction has recently been achieved using neural networks that are large (10M parameters) and computationally expensive, requiring 30ms for a forward-pass at 640 x 480 resolution on a modern GPU. We propose a novel neural network architecture for video reconstruction from events that is smaller (38k vs. 10M parameters) and faster (10ms vs. 30ms) than state-of-the-art with minimal impact to performance. Videos and Datasets: https://cedric-scheerlinck.github.io/firenet

Related Material


[pdf]
[bibtex]
@InProceedings{Scheerlinck_2020_WACV,
author = {Scheerlinck, Cedric and Rebecq, Henri and Gehrig, Daniel and Barnes, Nick and Mahony, Robert and Scaramuzza, Davide},
title = {Fast Image Reconstruction with an Event Camera},
booktitle = {The IEEE Winter Conference on Applications of Computer Vision (WACV)},
month = {March},
year = {2020}
}