-
[pdf]
[bibtex]@InProceedings{Feng_2023_ICCV, author = {Feng, Brandon Y. and Alzayer, Hadi and Rubinstein, Michael and Freeman, William T. and Huang, Jia-bin}, title = {3D Motion Magnification: Visualizing Subtle Motions from Time-Varying Radiance Fields}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)}, month = {October}, year = {2023}, pages = {9837-9846} }
3D Motion Magnification: Visualizing Subtle Motions from Time-Varying Radiance Fields
Abstract
Motion magnification helps us visualize subtle, imperceptible motion. However, prior methods only work for 2D videos captured with a fixed camera. We present a 3D motion magnification method that can magnify subtle motions from scenes captured by a moving camera, while supporting novel view rendering. We represent the scene with time-varying radiance fields and leverage the Eulerian principle for motion magnification to extract and amplify the variation of the embedding of a fixed point over time. We study and validate our proposed principle for 3D motion magnification using both implicit and tri-plane-based radiance fields as our underlying 3D scene representation. We evaluate the effectiveness of our method on both synthetic and real-world scenes captured under various camera setups.
Related Material