Deaf-Talk using MYO Armband

Project Title

Deaf-Talk using MYO Armband

Project Area of Specialization Artificial IntelligenceProject Summary

The work presented in this document is the communication link between the normal person and hearing-impaired person. Our application or product named as “DEAF-TALK using MYO Armband”. It provides hearing impaired person, an easy way to engage with the rest of the world. The concept we present in our product is that, we used a Pakistan Sign language (PSL) and translate the gestures into the text and voice and the output is generated on the Android Mobile. To develop this application our first need is the database in which multiple samples of gestures will store. The application contains gestures of characters, words and small sentences to translate into voice (audio file) & text. The device through which gestures can be generated by a hearing-impaired person is known as “MYO Armband”. Due to this the people who can’t understand each other in real life scenario can easily be linked by our product and an easy communication can be established.

Project Objectives

• To develop an Android application, which can reduce the communication gap between normal and hearing-impaired persons
• To develope a two-way communication between a normal and hearing-impaired person
• To develop application using MYO Armband sensor, which is latest technology and can be interface with Android phones as well
• To develop application using the standard database of Pakistan Sign Language (PSL) 

Project Implementation Method

The concept used to solve this large communication gap is the conversion of Pakistan Sign Language into text and voice on android phone. The solution which overcomes the above problem by our application is described. This application includes a sensor that detects hand gestures of a person. The sensor that we will use in this will be “MYO Gesture Control Armband”. This sensor is used to detect the movement of arm and Fingers. Moreover, the signals received from this sensor than transmitted to an Android device wirelessly or via Bluetooth. Android device has linked with a database where the combinations of gestures are stored based on PSL. Both the gestures process for matching the same gesture, and then Android device, where the signals was converted to voice and text using algorithms and coding. Output is generated in the form of Text and Voice as well. It is a dual mode application, which can convert hand gestures into text/voice and on the other hand text/voice is converted into hand gestures. 

Benefits of the Project

Foolowing are the Key benifits of this project:

1. Using this application we are trying to overcome the communication gap between a normal and hearing-impaired person.
2. PSL database will be mapped with MYO Armband and can further use in other application based on MYO sensor.
3. It is an android application and can be easy to deploy in all the cities aof Pakistan specially in deaf institutions.
4. Proper user manual along with the learning tutorials will be the part of our project.
5. Once completed this project cab solve the issues of deaf persons to generate communication with normal hearing persons in a more convenient and easy mode.    

Technical Details of Final Deliverable

1.   The Myo armband lets you use the electrical activity in your muscles to wirelessly control your computer, phone, and other favourite digital technologies. With the wave of your hand, it will transform how you interact with your digital world and we’re excited to show you how!

         First, let's review the items you should have received:

• The Myo armband
• One Standard Micro-USB Cable for charging your Myo armband
• One Bluetooth USB Adapter
• Myo Sizing Clips

2.    Put Myo on your arm, you may experience a "warm up" period that can last up to 5 minutes, sometimes longer depending on skin and weather conditions. During this time Myo is forming a strong electrical connection with the muscles in your forearm. The effect varies per person and region based on humidity. If you attempt to use Myo during the warm up period, you may notice the following changes in performance:

Gestures (including the sync gesture) may require multiple attempts before they are recognized

Gestures may be misinterpreted as others

• Connect the  standard micro USB cable with your MYO armband ,after connection the device is on (blue light blinks)

3.   The page launch after the splash screen. You have to enter fixed ID and password Or you can click here button to continue.

4.   This screen is launched after sign in intent. Top corner button is for scanning of Bluetooth.It shows the connectivity of Bluetooth. When the Bluetooth is connected the live emg rays of your hand movements are shown. As MYO armband has 8 sensors so the gui of that is seen here in different sensors colors.

The bottom left button (waves sign) is used for ping the MYO, which shows it is connected with device or not.

5.   After connecting MYO with android application, this intent is shown where we have to train the gestures and the live output of convertible gestures into text and voice is seen .

Final Deliverable of the Project HW/SW integrated systemType of Industry IT , Health Technologies Artificial Intelligence(AI)Sustainable Development Goals Industry, Innovation and Infrastructure, Sustainable Cities and CommunitiesRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	80000
MYO Armband Sensor	Equipment	2	35000	70000
Mic for Android/2TB USB 3.0 Portable Hard Drive	Miscellaneous	1	10000	10000