Gesture Control Language Translator

Project Title

Gesture Control Language Translator

Project Area of Specialization Electrical/Electronic EngineeringProject Summary

In our country around 2.78% of people are not able to speak or hear. The communication with others is only made by using the motion by their hands and expressions and there are perhaps around 200 sign languages in use around the world today. Some people can easily understand the information from their motion, but the remaining can not understand it. In order to overcome the complexity, the artificial speech system is introduced. This system will be very helpful for them to convey their thoughts to others. The system is based on motion sensors. According to dumb people, for every motion there is a separate meaning, whose message templates will be taken and kept in the database. In real time, the template database is fed into the microcontroller and the flexible/motion sensors are fixed on their hands. For every action the motion sensors get accelerated and passes the signal to the microcontroller. The microcontroller matches the motion sensor signal with the database and produces the speech output in the speaker. By properly updating the database the dumb will speak like a normal person using the artificial mouth.

Project Objectives

• To investigate the audio-visual features for assistance of handicap people.
• Create a data set and associated audio clip.
• An intelligent system using human gestures.

Project Implementation Method

We will use following sensors:

• Flex sensor
• Microcontroller
• Design embedded system

The glove uses flex sensor to gather data on each finger’s position and the hand’s motion to differentiate the letters. The output of sensors is given to the microcontroller. The translation is transmitted to the LCD and Speakers to display as well as pronounce the letters respectively.

fig: (1) shows the methodology that how our project will work...

                                              fig: (1)

Benefits of the Project

Benefits of our project are the following.

• It will fill the gap between impaired and normal people, by facilitating the communication between impaired and normal people.
• It wil increase independence and self-confidence of the deaf and dumb person.
• It will increase opportunities for advancement and success in education, employment and public access venues.
• It will improve quality of life.

Technical Details of Final Deliverable

• All audio and video clip relevant to the specific gesture or sign will be save in the database of microcontroller (arduino).
• Arduino works as brain of our project which take data from the flex sensors attach in the fingers.
• Flex sensors will be attached in all ten fingers.
• Flex sensors works as, when we bend the finger it also bends flex sensor which increase its resistance and its resistanse value will be matched with the saved value in database, then teh equivalent output will displayed.

Final Deliverable of the Project HW/SW integrated systemCore Industry TelecommunicationOther Industries Education , IT , Medical , Health , Security Core Technology Wearables and ImplantablesOther Technologies Others, Big DataSustainable Development Goals Good Health and Well-Being for People, Quality Education, Gender Equality, Decent Work and Economic Growth, Reduced Inequality, Partnerships to achieve the GoalRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	30070
Arduino Nano	Equipment	1	450	450
Flex sensor	Equipment	10	2500	25000
HC-05	Equipment	1	500	500
LCD 16*2	Equipment	1	250	250
Resistors	Equipment	30	1	30
Arduino Cable	Equipment	1	100	100
Jumper wires	Equipment	20	5	100
Headers	Equipment	2	20	40
A-4 pages	Miscellaneous	350	5	1750
Binding	Miscellaneous	5	250	1250
Fares	Miscellaneous	3	200	600