Wireless Gesture Communication System To Make Ease in Life of Disable Person

As engineers, we decided to make a project that can ease the life of disable persons .The work presented in this document is a communication bridge between normal and dumb people. The product ?Wireless Gesture Communication System? can be used as an interpreter between  normal and dumb persons.

Project Title

Wireless Gesture Communication System To Make Ease in Life of Disable Person

Project Area of Specialization

Internet of Things

Project Summary

As engineers, we decided to make a project that can ease the life of disable persons .The work presented in this document is a communication bridge between normal and dumb people. The product “Wireless Gesture Communication System” can be used as an interpreter between  normal and dumb persons. The Wireless Gesture Communication System is based on Pakistan Sign Language (PSL), which is a standard language used by dumb persons in Pakistan. Using gesture talk PSL can translate into voice, which can be understood by a normal person.

To make our product efficient, several gesture patterns will be recorded by number of individuals. The application contains gestures of characters, words and small sentences to translate into voice (-audio file). We are using an electrical sensor that will collect the data by detecting electrical pulses that will be sent to the microcomputer (raspberry pi 3) where the data will be processed and sent to the speaker from which voice will generate.

Project Objectives

• This project helps deaf and dumb people to communicate easily.
• They can carry this product anywhere anytime easily.
• They can use it without plugging it.
• The person does not have to learn anything additional to use this product.

Project Implementation Method

The MYO Armband is a Gesture Recognition device manufactured by Thalmic Labs (Canada) . The MYO enables the user to control technology wirelessly using various hand motions. It uses a set of Electromyography (EMG).

Sensors that sense electrical activity in the forearm muscles, combined with a gyroscope, accelerometer and magnetometer to recognize gestures .

First trend MYO response to create PSL based alphabets and basic word gestures.

Each gestures will be assigned a function with pose and edge as an argument.

Function onPoseEdge(pose, edge).

Pose can have following values wave left, wave right, fingers spreads and fist

Raspberry is the operating system that can be used in our project with the help of pyo connect software in Raspberry Pi the hand gestures covert into voice

Benefits of the Project

• Our project is stable or easy to carry anywhere
• Our wireless communication system will be able to use anytime
• Our system is based on portable armband raspberry pi and speakers
• The hardware which should be use in our project is light weight and placed in a little hand carry bag

Technical Details of Final Deliverable

SYSTEM ARCHITECTURE:

Fig 1: System Architecture.

In Fig 1: WGCS is the wireless gesture communication system which hand muscle gestures are recorded through arm band using sensor that transfer the signals to the embedded system via Bluetooth the processing engine of the embedded system generates the result in voice with the help of speakers through this process the hand gestures can be converted in voice.

System Working Mechanism:

Activity -I

The MYO armband placed on the arm is responsible for detecting the electrical signals from the muscles for every performed gesture

Activity -II

Then it transmits these signals wirelessly to the software. In the ”Wireless Gesture Communication System”.

Activity -III

The data base requires the implementation and frequent update of the Python scripts using the pycharm or visual studio software.

Activity -1V

Then these data is being translated by the Raspberry Pi 3, and results in an audible sound respective to the performed gesture

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Health

Core Technology

Internet of Things (IoT)

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Good Health and Well-Being for People

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com