DubLipz

Project Title

DubLipz

Project Area of Specialization Artificial IntelligenceProject Summary

DubLipz is an automated dubbing system. User need only to provide input video. The system automatically translates the audio of the video into the target language & Lipsync this audio with the original video. Output video will be in the original voice of the speaker as well as correctly lipsync.

Project Objectives

• To provide service to a large number of audience to dub videos in a small period of time.
• To guarantee that dubbed videos are similar to videos produced by a custom dubbing system without any error.
• To keep way the user from the complex process of dubbing.
• To lessen the chances of error (e.g out-of-sync video).

Project Implementation Method

• Google colab GPU(For training models)
• Google colab Notebook (For writing & executing the code)
• visual studio code (Front-end Framework)
•  Bootstrap (CSS Framework)
•  Google Cloud (speech-to-text API to convert audio into text)
• Google Cloud (Text-to-text API for text translation)
• Google Cloud (Text-to-speech API to convert text into audio)

Benefits of the Project

• Dub video by layman on one click.
• fast the dubbing process to save time as well as money.
• Keep the original voice of the speaker in dubbed video which is not in the custom dubbing system.

Technical Details of Final Deliverable

The final model of DubLipz is voice translation & lipsyncing. which required huge resources in sense of GPU for processing. DubLipz System will be useless without these functionalities.

Final Deliverable of the Project Software SystemCore Industry ITOther Industries Education , Media Core Technology Artificial Intelligence(AI)Other Technologies OthersSustainable Development Goals Quality EducationRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	60000
AMD RX480/580 Radeon series 8GB GPU Sapphire Nitro Edition	Equipment	1	60000	60000