-
Inverting Audio-Visual Simulation for Shape and Material Perception
AbstractHumans perceive objects through both their visual appearance and the sounds they make. Given a short audio clip of objects interacting, humans can recover rich information about the materials, surface smoothness, and the quantity of objects involved. Although visual information provides cues for some of these questions, others can only be assessed with sound. For example, objects with different masses and Young's moduli may have almost identical appearance, but they make different sounds when impacted, and vice versa.
Related Material
[pdf][bibtex]@InProceedings{Zhang_2018_CVPR_Workshops,
author = {Zhang, Zhoutong and Wu, Jiajun and Li, Qiujia and Huang, Zhengjia and Tenenbaum, Joshua B. and Freeman, William T.},
title = {Inverting Audio-Visual Simulation for Shape and Material Perception},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2018}
}
These CVPR 2018 workshop papers are the Open Access versions, provided by the Computer Vision Foundation.
Except for the watermark, they are identical to the accepted versions; the final published version of the proceedings is available on IEEE Xplore.
Except for the watermark, they are identical to the accepted versions; the final published version of the proceedings is available on IEEE Xplore.
This material is presented to ensure timely dissemination of scholarly and technical work.
Copyright and all rights therein are retained by authors or by other copyright holders.
All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright.