Dense Pixel-wise Micro-motion Estimation of Object Surface by using Low Dimensional Embedding of Laser Speckle Pattern

Ryusuke Sagawa, Yusuke Higuchi, Hiroshi Kawasaki, Ryo Furukawa, Takahiro Ito; Proceedings of the Asian Conference on Computer Vision (ACCV), 2020

This paper proposes a method of estimating micro-motion of an object at eachpixel that is too small to detect under a common setup of camera andillumination. The method introduces an active-lighting approach to make themotion visually detectable. The approach is based on speckle pattern, which isproduced by the mutual interference of laser light on object's surface andcontinuously changes its appearance according to the out-of-plane motion of thesurface. In addition, speckle pattern becomes uncorrelated with large motion. Tocompensate such micro- and large motion, the method estimates the motionparameters up to scale at each pixel by nonlinear embedding of the specklepattern into low-dimensional space. The out-of-plane motion is calculated bymaking the motion parameters spatially consistent across the image. In theexperiments, the proposed method is compared with other measuring devices toprove the effectiveness of the method.