Deaf-Dumb Communication Interrupter Using Hand Gestures

Project Title

Deaf-Dumb Communication Interrupter Using Hand Gestures

Project Area of Specialization Electrical/Electronic EngineeringProject Summary

Digital vocalizer is a project for social purpose, in which we are trying to implement a system which makes a communication gap between mute and abled people as less as possible. Deaf and mute people make use of sign language or gestures to make understand what he/she trying to say but it is impossible to understand by the abled people. Hence, making use of arduino UNO Board as Atmega 328 Controller board to interface all of the sensors and actuators. Basically, an Artificial Neural Network is the concept of our prototype. The flex sensors are placed on the hand of deaf people which converts the parameter like finger bend hand position angle into electrical signal and provide it to Atmega 328controller and controller take action according to the sign and convert into text and speech format. This Gesture to Speech Conversion is a tool for converting gestures of the differently abled people of the world to speech i.e converting gestures input to speech output. Proposed system is portable and focuses on two-way communication. Main goal of the system is to convert hand gestures to auditory speech for communication between mute/deaf and normal people. Hence, we make a simple prototype by taking some of those gestures and convert it into an audio and visual form so that the normal people can understand the mute and deaf easily.

Project Objectives

Gesture to Speech Conversion is a tool for converting gestures of the differently abled people of the world to speech i.e converting gestures input to speech output. Proposed system is portable and focuses on two-way communication. Main goal of the system is to convert hand gestures to auditory speech for communication between mute and normal people.

Project Implementation Method

There are 5 flex sensors and accelerometers that will be used as a data glove. Each flex sensor will be connected to different pins of Arduino UNO which is key element and display the output in LCD display and convert the text output into speech output via Speaker. the controlling unit. The flex sensors will give the data input to the controlling glove which can give a speech output from gestures input will help a lot of people communicating at public places which was a bit difficult earlier for differently abled people like if we say if they required to buy a coffee and for this they had to make the vendor understand via their gestures what they actually want; it was a very difficult and time consuming task which will be easily sorted out if that person is using this device while asking for a coffee now because with the possession of this glove, his or her gestures will now be converted to speech and the vendor will come to know that the customer is asking for a coffee and so on for other commodities as well. The system overcomes the necessary time difficulties of dumb people and improves their manner. Compared with existing system the projected arrangement is compact and is possible to carry to any places. This system converts the language in associate passing voice that is well explicable by such people.

Benefits of the Project

1. In homes offices and more, gesture remembrance can be greatly used to increase usability and reduce the resources necessary to create primary or secondary input systems like remote controls or car entertainment systems with buttons.

2. Designing of a whole jacket which will be capable enough to read and vocalize the movements of animals and displaying the same on LCD for deaf people

3. Virtual reality application e.g., replacing the conventional input devices like joy sticks in videogames with the data glove.

4. Gesture remembrance along with facial remembrance, lip movement remembrance, and eye tracking can be combined to create something called perpetual user interface to interact with computer systems which will improve creativity by leaps and bounds.

Technical Details of Final Deliverable

Generally mute people use sign language for communication but they find difficulty in communicating with others who do not understand sign language. This project aims to lower this barrier in communication. It is based on the need of developing an electronic device that can translate sign language into speech in order to make the communication take place between the mute communities with the general public possible. Gesture to Speech Conversion is a tool for converting gestures of the differently abled people of the world to speech i.e converting gestures input to speech output.

The hand gesture recognition system and voice conversion can overcome the necessary time difficulties of mute people and improves their manner. Compared with existing system the projected arrangement is compact and is possible to carry to any places. This system converts the language in associate passing voice that is well explicable by such people. The module description includes the Block Diagram, System Flow Chart and working of the system.

Final Deliverable of the Project HW/SW integrated systemCore Industry EducationOther Industries Others Core Technology Wearables and ImplantablesOther Technologies Internet of Things (IoT)Sustainable Development Goals Quality EducationRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	40160
Flex Sensor	Equipment	4	3000	12000
Arduino	Equipment	1	2500	2500
Glove	Equipment	1	10000	10000
Accelerometer	Equipment	1	500	500
12x Resistors + 1x Transistor	Equipment	13	10	130
Battery	Equipment	1	5000	5000
IC LM-386	Equipment	1	30	30
Miscellaneous	Miscellaneous	1	10000	10000