By going beyond mimicking facial expressions, the program makes fake footage lifelike
H. Kim et al/ACM Transactions on Graphics 2018
“The camera never lies” is a thing of the past.
A new computer program can manipulate a video such that the person on-screen mirrors the movements and expressions of someone in a different video. Unlike other film-fudging software, this program can tamper with far more than facial expressions. The algorithm, to be presented August 16 at the 2018 SIGGRAPH meeting in Vancouver, also tweaks head and torso poses, eye movements and background details to create more lifelike fakes.
These video forgeries are “astonishingly realistic,” says Adam Finkelstein, a computer scientist at Princeton University not involved in the work. This system could help produce dubbed films where the actors’ lip movements match the voiceover, or even movies that star dead actors reanimated through old footage, he says. But giving internet users the power to create ultrarealistic phony