Any one can talk(Automated tool for two way sign language and audio translation)

Project Title

Any one can talk(Automated tool for two way sign language and audio translation)

Project Area of Specialization RoboticsProject Summary

Sign language is a natural way for communication between normal and the deaf and dumb people, but often they find difficulty in communicating with normal people as they don’t understand their sign language.

Therefore, there always exists a language barrier. To overcome this barrier, we propose a device which can convert their hand gestures into voice which a normal person can understand. It will also help out the deaf and dumb people to understand what a normal person is saying by watching their sign language on a screen.

This device consists of a Wireless Glove, consisting of flex sensors and accelerometer. These sensors sense the movement of hands and fingers.

This system consists of a two way speech synthesizer software which converts these movements of hand into real time speech output and a display will give the text for the corresponding gesture.

While on the other hand it will convert the speech of the healthy person into sign language so that the patient can understand.

Project Objectives

This system will be useful for dumb and deaf  people to communicate with blind and normal people.

This system will convert the sign language into voice and text which is easily understandable by blind and normal people. The sign language is translated into some text form, to facilitate the deaf people as well.

This system will work for both platforms i.e. PCs and Android to make it portable for people

This text will be displayed on LCD on PC and on mobile screens while using android app. In order to improve and facilitate the more gesture recognition, motion processing unit like wireless gloves can be installed which comprises of accelerometer as well and with the help sensor fusion technique, we can accommodate a number of other gestures as well for better and efficient communication.

Project Implementation Method

The dictionary for hand gestures and their corresponding words in english will be compiled by studying different disabled subjects. The dictionary will initally be made in English, covering all the basic hand gestures. Advanced vocabulary will not be included.

This project will include fifty basic words for the language of gestures. It will also include all the 26 alphabets and numbers from 0-9.

skills required are

• API integration for voice synthesis.
• Socket programming.
• Basic electrical engineering to design and implement wireless gloves.
• Arduino programming

Benefits of the Project

This system will be useful for dumb and deaf  people to communicate with blind and normal people.

This system will convert the sign language into voice and text which is easily understandable by blind and normal people. The sign language is translated into some text form, to facilitate the deaf people as well.

This system will work for both platforms i.e. PCs and Android to make it portable for people

This text will be displayed on LCD on PC and on mobile screens while using android app. In order to improve and facilitate the more gesture recognition, motion processing unit like wireless gloves can be installed which comprises of accelerometer as well and with the help sensor fusion technique, we can accommodate a number of other gestures as well for better and efficient communication.

Technical Details of Final Deliverable

Making smart glove using flex sensors, aurdino, accelerometer, microphones and speakers.

Final Deliverable of the Project Hardware SystemCore Industry ITOther Industries Education , Medical Core Technology RoboticsOther Technologies Artificial Intelligence(AI)Sustainable Development Goals Good Health and Well-Being for People, Quality Education, Reduced InequalityRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	65700
Flex sensors	Equipment	19	3000	57000
arduino	Equipment	1	8000	8000
accelerometer	Equipment	2	350	700