ElevenLabs, a US-based software company focused on developing natural speech technology through AI and deep learning, has launched a fully automated AI dubbing and video translation tool called “AI Dubbing & Video Translator” that can translate your provided videos into 29 languages. YouTube, TikTok, Twitter (now X), and other URLs can all be translated for you—you only need to wait a few dozen seconds to a few minutes to get your video.
Super convenient! Fully automated AI dubbing and video translation tool – AI Dubbing & Video Translator
ElevenLabs has launched “AI Dubbing & Video Translator,” a tool that uses speech-to-speech translation, speech recognition, and voice dubbing to translate your content into 29 languages in just a few minutes.
Want to experience AI Dubbing & Video Translator? Click here!
AI Video Translation and Dubbing
AI Dubbing & Video Translator can convert the audio in your videos from one language to another while preserving the voice characteristics. It’s easy to use—just “upload the video you want to translate” and “select the target language”, and the AI will automatically handle the rest of the translation and dubbing work.
This way, whether you come across videos on YouTube, TikTok, Twitter (now X), or any other platform that you don’t understand, you can use AI Dubbing to help translate them. Here’s a clip of using AI Dubbing to automatically translate a YouTube video of the Apple Vision Pro guided tour.
We use Apple’s Vision Pro video as an example — it was originally entirely in English.
This is the result of uploading a video to “AI Dubbing & Video Translator” and translating English to Chinese. The free version doesn’t have enough credits, so I used one minute as a demo here. The translation quality is pretty good.
We also tested it by using our own video with the AI Dubbing & Video Translator. Original video:
The translation quality and conversion speed of AI Dubbing & Video Translator are quite fast. For Chinese to English translation, the content recognition isn’t as accurate as it is for English (plus there’s no way to edit the content). Also, in the free version, I feel the voice doesn’t sound much like the original person.
If you subscribe to the $11 USD Creator plan, you’ll get content proofreading features, and the voice will also mimic the original tone:
ElevenLabs Text-to-Speech Tool
ElevenLabs is a US-based software company focused on developing natural voice synthesis and text-to-speech using AI and deep learning technologies. Their website also provides text-to-speech tools, and here’s a text-to-speech example with the text: “Computer King Ada mainly shares tech news, 3C product unboxing reviews, app sharing and other content. Please like and favorite to stay updated with the latest information.” ElevenLabs also has many other tools available, so feel free to explore and try them out. Those who want to experience it can click here!hereVisit the ElevenLabs website!
You can try playing the example below, it’s pretty interesting:
I also tried using one of my recordings and inputting text for AI to mimic. You can listen to it—I think the results are pretty good.
Of course you can also read it in my tone in English:
When using it, keep in mind that AI Dubbing & Video Translator has free usage limits—if you exceed them, you’ll need to wait 30 days before using it for free again. Alternatively, you can opt to pay $1/$11 per month for more access. The price is quite affordable, though do note that this is the first month’s rate.
For serious users, you can choose $99/month or $330/month to unlock more privileges.
The AI virtual streamer we previously covered that creates its own appearance, with support for multi-language translation HeyGen the technology is also provided by ElevenLabs
We also tested dubbing the same video using HeyGen, and honestly, the results were significantly better, with accurate lip sync too.
Overall, AI Dubbing & Video Translator performs well in voice cloning and script reading. For video translation, foreign-to-Chinese translation is excellent, but its Chinese-to-English translation isn’t as good as HeyGen’s (though HeyGen also uses this service, it has stronger Chinese speech recognition). However, the advantage is that AI Dubbing & Video Translator is much cheaper than HeyGen, and the free credits can also produce a few short videos. For general voice cloning or short video production, AI Dubbing & Video Translator is a solid choice.
For those who want to experience AI Dubbing & Video Translator, please click here.
Source: KOCPC Chinese