This new AI tool from HeyGen dubs your voice in seven languages

0 12

By Matthew Griffin Intelligence and the Senses 3rd January 2024

WHY THIS MATTERS IN BRIEF

The ability to translate your voice and videos into different languages easily is now as easy as pressing a button.

Love the Exponential Future? Join our XPotential Community, future proof yourself with courses from XPotential University, read about exponential tech and trends, connect, watch a keynote, or browse my blog.

How many languages do you speak? Thanks to Artificial Intelligence (AI), that number could be as many as seven. Los Angeles-based AI video platform HeyGen has launched a new tool that clones your voice from a video and dubs and translates what you’re saying into seven different languages. If that wasn’t enough, it also syncs your lips to your new voice so the final clip looks – and sounds – as realistic as possible.

This company just appointed a robot as its new interim CEO

Called Video Translate, the tool allows you to upload a video of yourself speaking in English, Spanish, French, Chinese, German, Italian, Portuguese, Dutch, Hindi or Japanese. The requirements are pretty basic so you don’t need any fancy cameras, microphones or software. The clip has to be at least 30 seconds long and should ideally feature just one person. But other than that, you just upload your video and in a single click HeyGen can translate what you’re saying. And you can choose whether you want the output to be in Spanish, French, Hindi, Italian, German, Polish, Portuguese or English.

See it in action

Twitter user Jon Finger uploaded a video he made speaking English with translations in both French and German. The results were stunning and the video has since racked up more than 6 million views. French and German speakers have confirmed that the AI tool did a pretty accurate job. Finger also asked some people he knew for their thoughts and they told him the results were “just a little robotic but pretty incredible.”

Edtech company Udacity uses deepfake tech to create educational videos automatically

Following its September 7 launch, HeyGen’s AI tool has since gone viral and Jon Finger’s video added fuel to the raging fire.

I wanted to try the tool for ourselves but our 30-second test clip ended up at the back of a queue that was – deep breath – over 141,000 videos long! One Twitter user said when they uploaded their video they were in the 95,000th spot. After 18 hours of waiting they ended up even further back than their original starting spot and found themselves behind 122,000 other eager users.

A convincing DeepFake Elon Musk just Zoom-bombed a video call

Finger replied saying that his video took 10 minutes to process because “there was basically no line” when he tested it out just a few days ago. He said it currently seems impossible to test the free version.

HeyGen said that they are trying to scale up their GPU capacity as fast as possible to accommodate the increased demand. It also added that paid users get to skip the line and get their videos within 10 minutes. The cheapest paid option currently costs $29 per month with an annual subscription slashing 20% off with support for even more languages is also expected by the end of this month.

Matthew Griffin / About Author

Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working across the next 50 years, and is an award winning futurist, and author of “Codex of the Future” series.

Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future.

A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries.

Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.