Computer Scientists Demonstrate The Potential For Faking Video | KUOW News and Information

Computer Scientists Demonstrate The Potential For Faking Video

Jul 14, 2017
Originally published on July 21, 2017 1:45 pm

An update from the Wild Wild West of fake news technologies: A team of computer scientists have figured out how to make words come out of the mouth of former President Barack Obama — on video — by using artificial intelligence.

If you've been on the Internet at any point in the last year, there's a good chance you've come across fake news articles. Soon we may see a wellspring of fake news videos.

As a team out of the University of Washington explains in a new paper titled "Synthesizing Obama: Learning Lip Sync from Audio," they've made several fake videos of Obama.

Take for example, a time that he discussed the Pulse nightclub shooter and said "the investigation is ongoing, but we know that the killer was an angry and disturbed individual who took in extremist information and propaganda over the Internet."

Obama did in fact say these words. But the computer scientists were able to make it look like he said them in places different from where he actually did — in this instance, in a different room at the White House. Audio and video images could be manipulated to make it look like he said them at a different time — say as a much younger Obama.

Multiple illustrations of the technology are in this video:

The researchers accomplished this feat not by cutting and pasting his body into different scenes — but by having a computer system called a neural network study hours and hours of video footage, to see how Obama's mouth moves. Computers could then manipulate his lips and contort them to have any word come out.

In this experiment, the researchers did not make up things for him to say. But they did manipulate his mouth to seamlessly cut out entire sentences from speeches he'd given on camera, and even to change the order of sentences.

For example, the demo shows Obama talking about health care and saying: "Enrollment is open right now, but only until January 31st. Go to Healthcare.gov."

In that speech, as Obama originally gave it, those two sentences were in reverse order — and there were many other words in between.

Researchers chose Obama because there's so much high definition video available of him to study. In principle, the artificial intelligence that studied him could be used to make others lip sync too.

Copyright 2017 NPR. To see more, visit http://www.npr.org/.

DAVID GREENE, HOST:

We have an update now from the wild, Wild West of fake news technology. This is a little scary. A team of computer scientists figured out how to make words come out of the mouth of former President Barack Obama on video by using artificial intelligence. NPR's Aarti Shahani explains.

AARTI SHAHANI, BYLINE: If you've been on the internet at any point in the last year, there's a good chance you've come across fake news articles. Well, soon enough we may see a wellspring of fake news videos. As a team out of the University of Washington explains in a new paper, they've made several fake videos of President Obama.

(SOUNDBITE OF YOUTUBE VIDEO, "SYNTHESIZING OBAMA: LEARNING LIP SYNC FROM AUDIO")

BARACK OBAMA: The investigation is ongoing. But we know that the killer was an angry and disturbed individual who took in extremist information and propaganda over the internet.

SHAHANI: Obama did, in fact, say these words about the Pulse nightclub shooter. But the computer scientists could make it look like he said them in places different from where he actually did - could be a room at the White House or during a visit to the Vatican.

It could also look like he said them at a different time - say as a much younger Obama.

(SOUNDBITE OF YOUTUBE VIDEO, "SYNTHESIZING OBAMA: LEARNING LIP SYNC FROM AUDIO")

OBAMA: We are and we will keep doing everything in our power to stop these kinds of attacks.

SHAHANI: The researchers did this not by cutting and pasting his body into different scenes, but by having a neural net, a computer system, study hours and hours of video footage to see how Obama's mouth moves so that computers could then manipulate his lips, contort them to have any word come out. In this experiment, they didn't make up things for him to say. But they did manipulate his mouth to seamlessly cut out entire sentences from speeches he'd given on camera and even to change the order of sentences.

(SOUNDBITE OF YOUTUBE VIDEO, "SYNTHESIZING OBAMA: LEARNING LIP SYNC FROM AUDIO")

OBAMA: Enrollment is open right now but only until January 31. Go to healthcare.gov.

SHAHANI: In that speech as Obama originally gave it, those two sentences were in reverse order, and there were many other words in between. Researchers chose Obama because there's so much high-definition video available of him to study. In principle, the artificial intelligence that studied him could be used to make others lip sync, too. Aarti Shahani, NPR News. Transcript provided by NPR, Copyright NPR.