ElevenLabs is an AI voice platform (with a free tier) that offers cutting-edge AI voice synthesis technology to easily create realistic and expressive AI voices. It supports multiple languages, voice cloning, and real-time voice generation. They claim to be the best in the AI voice field. Whether that's true or not, it has a free tier, so you can try it out.
Registration and Login
First, open your browser and visit the ElevenLabs official website.
On the homepage, click the LOG IN or GO TO APP button in the upper right corner to go to the registration page.
If you already have an account or a Google/GitHub account, you can click to log in above. If not, click Sign up below to register.
Get API Key
After registering and logging in, open this address to create an API KEY
: https://elevenlabs.io/app/settings/api-keys
Then the automatically created key will be displayed. Please copy and save it carefully. It will only be displayed once and will not be displayed again later.
Using it in translation software
Open the video translation software, Menu - TTS Settings - Elevenlabs.io - fill in the apikey copied in the previous step, and then click Test. If it prompts "ok", save it.
After saving, return to the main interface of the software and select Elevenlabs.io in the dubbing channel, and select the role you want to use in the role list.
Note that free accounts have frequency limits. To avoid errors due to exceeding the frequency, please modify the concurrency and pause duration after each dubbing, as shown in the figure below.
Choosing the voice you want to use
elevenlabs has thousands of voices, with about a dozen available for free by default. You can also create your own voices.
https://elevenlabs.io/app/voice-lab
On this page, you can select the voice you want to use, and then click +Add to add it to your voice list. Note that free accounts can only add up to 3. After adding, update the roles in the TTS settings of the video translation software.
Creating a new custom role
If you don't have the role you want, you can also customize a new role.
As shown above, clicking this will pop up a custom box. Fill in the voice requirements in the box above and the reading text below.
Cloning Voice
Select "clone" in the voice role, which means using the original video's voice for dubbing. However, this function requires a paid membership of elevenlabs.io, otherwise, do not use it, as it will inevitably cause errors.
If you want to use it, you can upgrade your account here: https://elevenlabs.io/app/subscription
You can also try this feature on their website (uploading a video), which is free, but the generated results will have a watermark.
Address: https://elevenlabs.io/app/dubbing
Updating the role list in the video translation software
After adding or deleting roles in elevenlabs.io, you need to update the role list in the video translation.
- Open Menu - TTS Settings - Elevenlabs.io, click Test and Update Roles, wait and save if there are no errors.
- In the main interface of the software, if the current dubbing channel is not
Elevenlabs.io
, directly switch toElevenlabs.io
. If it is already, switch to another channel first and then switch back.