Real time Sign Language to Text and Text to sign Language Interpreter

According to the World Health Organization there are about 466 million people in the world that are deaf or suffer from disabling hearing loss. Deaf people can communicate with sign language and normal people do not understand the sign language. We are proposing a system to facilitate the interactio

Project Title

Real time Sign Language to Text and Text to sign Language Interpreter

Project Area of Specialization

Artificial Intelligence

Project Summary

According to the World Health Organization there are about 466 million people in the world that are deaf or suffer from disabling hearing loss. Deaf people can communicate with sign language and normal people do not understand the sign language. We are proposing a system to facilitate the interaction among deaf people’s and normal people. The main objective is to increase the awareness towards hearing impaired people that can facilitate the community. We are proposing a system (mobile application) that will convert sign language to text (English) and text (English) to sign language.

Project Objectives

To develop a system that can facilitate basic human interactions of impaired people. Creating more facilities towards special education. Making it easy to learn sign language.

Project Implementation Method

We will be using an incremental development model for our project because  “Due to iterative effort in testing and fine-tuning, the software will have minimal defects.  Thanks to the transparent development model, there is better clarity between team members during development.  Changes in project requirements can be easily addressed and rectified with little or no impact on the timeline and will be incorporated with coming increments. Provides an overall improvement on the final quality of the custom software development.”

Benefits of the Project

To benefit the deaf community so that they can interact with normal people and can participate in the nation’s development.

Technical Details of Final Deliverable

We will develop an android application that will convert signs to text in real-time and text to signs of (ASL) sign language.

Sign Language Conversion:

Building an AI model through machine learning that can convert the user’s sign input to text and likewise other user’s text input to visualized sign language on the mobile screen, all in real-time.

Text to Speech:

Using TensorFlow libraries to use the Sign Converted text by converting it to Speech output and then playing the Audio on Phone Speakers for the continual and barrier-less communication from the Deaf/Mute to the other person.

Speech to Text:

Similarly converting the normal user’s Speech to Text for the Sign Language input so they can easily communicate rather than typing the text this module converts their speech to text for the input of sign language which will convert it into visual signs for the deaf.

This will ensure fluent communication between both The Deaf & Normal users.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Health

Other Industries

IT

Core Technology

Artificial Intelligence(AI)

Other Technologies

Others, Big Data

Sustainable Development Goals

Good Health and Well-Being for People, Quality Education, Industry, Innovation and Infrastructure, Sustainable Cities and Communities

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com