DubLipz

DubLipz is an automated dubbing system. User need only to provide input video. The system automatically translates the audio of the video into the target language & Lipsync this audio with the original video. Output video will be in the original voice of the speaker as well as correctly lipsync.

Project Title

DubLipz

Project Area of Specialization

Artificial Intelligence

Project Summary

Project Objectives

To provide service to a large number of audience to dub videos in a small period of time.
To guarantee that dubbed videos are similar to videos produced by a custom dubbing system without any error.
To keep way the user from the complex process of dubbing.
To lessen the chances of error (e.g out-of-sync video).

Project Implementation Method

Google colab GPU(For training models)
Google colab Notebook (For writing & executing the code)
visual studio code (Front-end Framework)
Bootstrap (CSS Framework)
Google Cloud (speech-to-text API to convert audio into text)
Google Cloud (Text-to-text API for text translation)
Google Cloud (Text-to-speech API to convert text into audio)

Benefits of the Project

Dub video by layman on one click.
fast the dubbing process to save time as well as money.
Keep the original voice of the speaker in dubbed video which is not in the custom dubbing system.

Technical Details of Final Deliverable

The final model of DubLipz is voice translation & lipsyncing. which required huge resources in sense of GPU for processing. DubLipz System will be useless without these functionalities.