R-SLAM: Optimizing Eye Tracking From Rolling Shutter Video of the Retina

Jay Shenoy, James Fong, Jeffrey Tan, Austin Roorda, Ren Ng; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 4852-4861

Abstract

We present a method for optimization-based recovery of eye motion from rolling shutter video of the retina. Our approach formulates eye tracking as an optimization problem that jointly estimates the retina's motion and appearance using convex optimization and a constrained version of gradient descent. By incorporating the rolling shutter imaging model into the formulation of our joint optimization, we achieve state-of-the-art accuracy both offline and in real-time. We apply our method to retina video captured with an adaptive optics scanning laser ophthalmoscope (AOSLO), demonstrating eye tracking at 1 kHz with accuracies below one arcminute -- over an order of magnitude higher than conventional eye tracking systems.

Related Material

[pdf] [supp]
[bibtex]
@InProceedings{Shenoy_2021_ICCV, author = {Shenoy, Jay and Fong, James and Tan, Jeffrey and Roorda, Austin and Ng, Ren}, title = {R-SLAM: Optimizing Eye Tracking From Rolling Shutter Video of the Retina}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)}, month = {October}, year = {2021}, pages = {4852-4861} }