Symbol to Speech for Mute

If a person by means of any reason is not able to speak through the natural way and got mute, Our Project Symbol to Speech for Mute will help them to communicate and speak the needs to their relative or the person taking care of them. How? By using hand gestures. Our Project will recognize those han

Project Title

Symbol to Speech for Mute

Project Area of Specialization

Internet of Things

Project Summary

If a person by means of any reason is not able to speak through the natural way and got mute, Our Project Symbol to Speech for Mute will help them to communicate and speak the needs to their relative or the person taking care of them. How? By using hand gestures. Our Project will recognize those hand gestures and through Bluetooth it will be played as a voice to the connected mobile device by using Android Application. The working of our project is based on the IOT (Internet of things), flex sensors will be deployed on the hand gloves and needed to be wearied by the person and will be connected to the microcontroller (Arduino) along with Bluetooth device that will transmit the data. We will use minimum 8 flex sensors that mean 32 OR 256 symbolic signs can be made and on each sign a voice command can be embedded (Text to Speech). For example if a person make four fingers like 1 0 1 1 as in Binary combination a Bluetooth attached device will play the audio, and a person having that device can know what mute person wants. Similarly, the person who receive the command on his/her phone by that gesture made using glove, the person can also reply back like a chat in multiple forms such as Text, Sign Image or voice message. Thanks to the IOT Mute people can convey their message easily and our project will be one of the reasons they can convey message to their family/relative or person taking care of them.

Project Objectives

This project is basically focused on the main aim that deaf and dumb people should be capable of playing a vital role in the society. Imagine if speaking to a mute person is as easy as speaking to a normal person, in this regard considering this goal in our mind we are developing this technology, a combination of Arduino based hardware and android app.

Our project will mainly focus on the following objectives:

1. Developing an Arduino based system that will incorporate the symbols in the form of binary language.
2. Gloves will have been created that will contain flex sensors mounted on them. We’ll make symbols through that glove.
3. Creating an android application that will be installed in the receiver (smartphone), it will play the audio based on those symbols.
4. Bluetooth module will be used to connect the hardware and receiver, symbols made through gloves containing the sensors will be detected through this module.
5. To use Internet of Things efficiently in a better way to solve a basic society problem.
6. Dual communication like a chat with mute person that means a reply can be given back to mute person

Project Implementation Method

The implementation will be done by making physical gloves that can be weared on hands and using flex sensors on fingers to get their position of bending, based on that we will make different symbols that will be recognized by Arduino microcontroller and then transmit to the Android Smartphone via bluetooth and according to each symbol a command (Sentences) will be played. For that purpose Android Application is created.

Dual communication will also be done via bluetooth between two smartphones in three different ways (Text, Symbol, Audio) by receiver and will be transmitted to the mute person who will also have smartphone/tablet or screen displayed nearby.

Benefits of the Project

This project will act like a bridge and fill the gap between normal and special/mute people. This will be an immense contribution for the society as by using this we will be able to easily communicate with the dumb and deaf persons.

Technical Details of Final Deliverable

Arduino Microcontroller based Hardware along with Gloves to be weared on both hands which contains sensors.

Android Application to communicated with hardware and for dual communication purpose and other controls.

The Data will be transmitted to devices via Bluetooth.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Medical

Other Industries

Core Technology

Internet of Things (IoT)

Other Technologies

Sustainable Development Goals

Good Health and Well-Being for People, Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com