Feijóo, Belén Esteban and El Fary speak in perfect English: automatic video dubbing is already devastating and confusing

This article is a part of the weekly Technology newsletter, which is sent every Friday. If you want to sign up to receive it in its entirety, with similar but more varied and brief topics, You can do it at this link.

This week It is the work of the growing popularization of apps that squeeze artificial intelligence. This week’s explosion is due to the release last Friday of the new video translation application of a startup called HeyGen.

The dubbing of Feijóo, the leader of the PP known for not being fluent in English, has caused some, like the journalist Isabel San Sebastián, to fall into deception. After applauding “the excellent diction and very well chosen words” by the candidate for the presidency of the Spanish Government in a tweet on Thursday, has acknowledged his frustration an hour later.

“They tell me that this video is the work of artificial intelligence. The voice is the same, the verisimilitude, absolute. Depending on what it is used for, this tool contains an enormous danger, because it is impossible to distinguish it from reality,” the opinion member has lucidly warned.

The video of Leo Messi in English by Argentine content creator Javi Fernández went viral on Monday. Shortly after, American user Jon Finger recorded himself in English and within 10 minutes he had his own tone of voice dubbed into French and German with his lips slightly adapted to the new language. It went viral and in a couple of days in Spain the North Korean account saw that video, posted it and started posting other examples with another app (HeyGen was overloaded with work), which seems to fit the lips worse.

Belén Esteban and El Fary began to appear in videos speaking excellent English, with a tone that seems to recall Donald Trump’s accent. The waiting times in the app They went from a few minutes to a day. On Wednesday there were more than 120,000 users waiting for HeyGen’s servers to do their job. Although there are also applications that manage to do it in real time.

Here is the youtuber technology Marques Brownlee speaking in Latin Spanish. It’s not perfect, but it’s very fine. “Since we launched the video translation app last week, we have received a lot of interest from the community,” wrote in X Joshua Xu, founder of HeyGen. Xu sees the best application of the tool from him on YouTube and in courses online of Education. Today the main ones are in English. If they can be translated into all languages ​​effortlessly, their impact will be greater. For now, what works and is impressive is monetizing translated implausible content in X:

EL PAÍS already explained more than a year ago the risk that AI implied for the dubbing sector, with lost jobs and union manifestos among organizations in several countries to defend themselves from the avalanche. Now, come the apps that popularize a technology that until recently was only in the hands of companies.

It is likely that most of the impact of a app like HeyGen’s, be it in videos that would never have hired a voice actor. Or at least not all. Mr Beast, the youtuber most popular in the world, has channels in other languages ​​that do just that: dub their videos into other languages. Now it will be easier and cheaper, as long as the machine is capable of catching the speech turns.

In addition to the economic or educational impact of dubbing, there are other possible consequences in these videos. One of the easiest to foresee is the confusion and misinformation that seeing celebrities speaking in other languages ​​and saying anything can cause on social networks. The case of Feijóo cheating on Isabel San Sebastián is very clear, perhaps only the first step. As with the deepfakes, the real problem remains to be discovered: perhaps also audio messages with threats or lies? Or fake calls? Or videos where a politician says something in one language and is translated saying something else with fake subtitles? It’s all to be seen.

There is, however, more and more prevention. This week a tiktok by Argentine comedian Jero Freixas was released. He was commenting on an interview with Messi where he said that he likes paddle tennis. Freixas joked that Messi can only like football: “This is crazy,” he said, and added: “They created it with artificial intelligence.” There will necessarily be more people with the easy or artificial resource of saying that “this is a lie.”

The increase in fake videos raises people’s caution. This week, the youtuber Carles Tamayo published an experiment on his channel. He created a hoax about him where an alleged employee accused him of labor exploitation. He created a setup with messages, fake X accounts, paid bots and even bought a misleading article on a news website with the headline “The fallen YouTuber.”

The initial reaction on the internet was variants of phrases like “no wonder” and “he deserves it for being a liberal liar.” But within a few hours, more and more people discovered the weaknesses of the story and quickly began sharing videos explaining that everything was a bait orchestrated by Tamayo. He youtuber He was right about people’s prejudices and their speed in judging him. But beyond the paid article, there was hardly any media coverage. And between the reaction of users who were suspicious and the media that did not increase the false trend in X, there is some hope with the skepticism of society when it sees something that seems too good to be true.

You can follow EL PAÍS Technology in Facebook y Twitter or sign up here to receive our newsletter semanal.