Gesture Control Language Translator

In our country around 2.78% of people are not able to speak or hear. The communication with others is only made by using the motion by their hands and expressions and there are perhaps around 200 sign languages in use around the world today. Some people can easily understand the information from the

Project Title

Gesture Control Language Translator

Project Area of Specialization

Electrical/Electronic Engineering

Project Summary

In our country around 2.78% of people are not able to speak or hear. The communication with others is only made by using the motion by their hands and expressions and there are perhaps around 200 sign languages in use around the world today. Some people can easily understand the information from their motion, but the remaining can not understand it. In order to overcome the complexity, the artificial speech system is introduced. This system will be very helpful for them to convey their thoughts to others. The system is based on motion sensors. According to dumb people, for every motion there is a separate meaning, whose message templates will be taken and kept in the database. In real time, the template database is fed into the microcontroller and the flexible/motion sensors are fixed on their hands. For every action the motion sensors get accelerated and passes the signal to the microcontroller. The microcontroller matches the motion sensor signal with the database and produces the speech output in the speaker. By properly updating the database the dumb will speak like a normal person using the artificial mouth.

Project Objectives

• To investigate the audio-visual features for assistance of handicap people.
• Create a data set and associated audio clip.
• An intelligent system using human gestures.

Project Implementation Method

We will use following sensors:

• Flex sensor
• Microcontroller
• Design embedded system

The glove uses flex sensor to gather data on each finger’s position and the hand’s motion to differentiate the letters. The output of sensors is given to the microcontroller. The translation is transmitted to the LCD and Speakers to display as well as pronounce the letters respectively.

fig: (1) shows the methodology that how our project will work...

                                              fig: (1)

Benefits of the Project

Benefits of our project are the following.

• It will fill the gap between impaired and normal people, by facilitating the communication between impaired and normal people.
• It wil increase independence and self-confidence of the deaf and dumb person.
• It will increase opportunities for advancement and success in education, employment and public access venues.
• It will improve quality of life.

Technical Details of Final Deliverable

• All audio and video clip relevant to the specific gesture or sign will be save in the database of microcontroller (arduino).
• Arduino works as brain of our project which take data from the flex sensors attach in the fingers.
• Flex sensors will be attached in all ten fingers.
• Flex sensors works as, when we bend the finger it also bends flex sensor which increase its resistance and its resistanse value will be matched with the saved value in database, then teh equivalent output will displayed.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Telecommunication

Other Industries

Education , IT , Medical , Health , Security

Core Technology

Wearables and Implantables

Other Technologies

Others, Big Data

Sustainable Development Goals

Good Health and Well-Being for People, Quality Education, Gender Equality, Decent Work and Economic Growth, Reduced Inequality, Partnerships to achieve the Goal

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com