What Makes Tom Hanks Look Like Tom Hanks

Supasorn Suwajanakorn, Steven M. Seitz, Ira Kemelmacher-Shlizerman; Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2015, pp. 3952-3960

Abstract

We reconstruct a controllable model of a person from a large photo collection that captures his or her persona, i.e., physical appearance and behavior. The ability to operate on unstructured photo collections enables modeling a huge number of people, including celebrities and other well photographed people without requiring them to be scanned. Moreover, we show the ability to drive or puppeteer the captured person B using any other video of a different person A. In this scenario, B acts out the role of person A, but retains his/her own personality and character. Our system is based on a novel combination of 3D face reconstruction, tracking, alignment, and multi-texture modeling, applied to the puppeteering problem. We demonstrate convincing results on a large variety of celebrities derived from Internet imagery and video.

Related Material

[pdf]
[bibtex]
@InProceedings{Suwajanakorn_2015_ICCV,
author = {Suwajanakorn, Supasorn and Seitz, Steven M. and Kemelmacher-Shlizerman, Ira},
title = {What Makes Tom Hanks Look Like Tom Hanks},
booktitle = {Proceedings of the IEEE International Conference on Computer Vision (ICCV)},
month = {December},
year = {2015}
}