Hand Gesture Based Sign language Development And Home Automation For Disable Person

we have collected information from different researching and surveys that ratio of disabled people is increasing day to day in the world and they are facing different types of difficulties in their lives .they are not able to do work for themselves whoever they want to fulfill their needs in daily l

Project Title

Hand Gesture Based Sign language Development And Home Automation For Disable Person

Project Area of Specialization

Wearables and Implantable

Project Summary

we have collected information from different researching and surveys that ratio of disabled people is increasing day to day in the world and they are facing different types of difficulties in their lives .they are not able to do work for themselves whoever they want to fulfill their needs in daily life but they can't. by this way their health care increase cost. so we have worked for those people who can't speak and they are also paralysis. by paralysis, we mean that they are not able to walk however their hands are working properly. we have designed a wearable grove which detects different gestures of the hand.corresponding to each gesture we have set a complete sentence. the hardware is able to show this sentence on the LCD and it has also the ability to speak out this sentence in hearable form. by this way, we are going to decrease the communication gap between dump person and normal person. 

the second feature of this hardware is to get the patient able to control different appliances of the room by simple hand gesture.

Project Objectives

Paralysis and speaking disorder can greatly reduce the quality of life of a patient while increasing the cost of home healthcare. The main objective of this project is to design an
embedded system that facilitates a disabled person who can’t able to walk and speak. A wearable Glove fitted with five flex sensors which are using to detect the movement of five fingers of the right hand. These physical movements of fingers are converted to voltage signals which are then given to Arduino for different instructions. The system will also show these instructions on LCD in the form of text. This text is further sent to Raspberry Pi (Rpi) board for text to speech conversion (TTS), in result we will get hearable output. Four instructions are used for controlling home appliances. We are controlling the appliances through Voice Recognition. For this purpose, we again use the Raspberry Pi (Rpi) board, to recognize the voice properly with 75% efficiency. After voice recognition, the Rpi generates different types of signals which
are then given to Arduino to operate the home appliances.

Project Implementation Method

the project which we have designed is the embedded system project. the integrated project includes both the software and hardware. the major portion of our project is software basis(coding in C language and python language).

in the first phase, we bought flex sensors from the market and we started working on flex sensors to read flex sensors variation in a different time under different condition through ARDUINO.

in the second phase, we have worked on TTS(text to speech conversion) through different ways including MATLAB, ARDUINO and RASPBERRY PI. finally we choosed TTS by raspberry pi because it's quality was best among the others.

in the third phase, we started working on the hardware that which components will be we use in our project.

finally, in the last phase, we are shifted to the final integration of the project we gave the final shape to our final year project.

Benefits of the Project

use of the project is easy everyone can use it by simply wearing the glove the remaining hardware may be kept aside the patient.

a dumb person can use it to fulfill his needs by giving simple gesture from the hand.

it doesn't need any internet services for it's working.

a paralyzed person can get benefits from it, by controlling different domestic electrical appliances by using simple hand gestures. 

the hardware is reprogrammable we can customize it for different patients.

Technical Details of Final Deliverable

the main technology used in this project is TTS(text to speech conversion).

the second technology we have used is text recognition and text matching in phyton language.

others hardware components are ARDUINO, Raspberry Pi, switching relays, H bridge, power supply, and flex sensors.   

Final Deliverable of the Project

Hardware System

Type of Industry

Medical , Health

Technologies

Wearables and Implantables

Sustainable Development Goals

Good Health and Well-Being for People, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com