Audio to Sign Language Translator

Sign language is a visual language that is used by the deaf and hard hearing people as their mother tongue. Sign language uses body language and manual communication to fluidly convey the thoughts of the person. As a fact, there is s major difference between oral and sign language and there are comm

Project Title

Audio to Sign Language Translator

Project Area of Specialization

Artificial Intelligence

Project Summary

Sign language is a visual language that is used by the deaf and hard hearing people as their mother tongue. Sign language uses body language and manual communication to fluidly convey the thoughts of the person. As a fact, there is s major difference between oral and sign language and there are communication barriers between the normal person and the deaf person. So to

overcome this problem we imposed a solution that is audio to sign language translator. This translator will work as the interpreter between the normal and a deaf person. This translator will take audio as an input and then convert this audio to text then using artificial intelligence the translator will make the connection between the words and display the converted text using an Signing Avatar.

Project Objectives

This project target the deaf and hard hearing peoples they face difficulties in normal life. This project will lessen their difficulties in a way that they can easily interact with the normal person in daily life. This project will also be learning aid for those who want to learn Sign language and if this project is implemented in special education schools this will also help them to learn sign language fast.

Project Implementation Method

1. Audio input on a Personal Digital Assistant(PDA) using python PyAudio module.
2. Conversion of audio to text using Google Speech API.
3. Dependency parser for analysing the grammatical structure of the sentence and establishing relationship between words.
4. ASL Generator: ASL of input sentence using ASL grammar rules.
5. Generation of Sign language with signing Avatar.

Benefits of the Project

1.  Since deaf people are usually deprived of normal communication with other people, they have to rely on an interpreter or some visual communication. Now the interpreter can not be available always, so this project can help eliminate the dependency on the interpreter.
2. This will help in the education system where we had to hire an interpreter as a teacher and they are highly paid for this. This will be a benefit for the government so there will be less need for the most payable teachers.
3.  

Technical Details of Final Deliverable

Complete working project with documentation

Final Deliverable of the Project

Software System

Core Industry

Education

Other Industries

IT

Core Technology

Artificial Intelligence(AI)

Other Technologies

Augmented & Virtual Reality, Others

Sustainable Development Goals

Quality Education, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com