Glove which converts sign language to speech

Hearing impaired persons often face the communications issue with people who don?t know the sign language so the Go-Glove will convert the sign language to speech so that the hearing impaired person can communicate with others. The main concern is the language and Go-Glove will support multi languag

Project Title

Glove which converts sign language to speech

Project Area of Specialization

Wearables and Implantable

Project Summary

Hearing impaired persons often face the communications issue with people who don’t know the sign language so the Go-Glove will convert the sign language to speech so that the hearing impaired person can communicate with others. The main concern is the language and Go-Glove will support multi language using google translate Api. Flex sensor are used to detect bend of fingers and such sensors are available in market but very expensive so we have designed our own flex sensor which will be almost thrice less expensive as flex sensors. Our flex sensors will be as accurate as one available in market but with the trade off of size. Go-Glove will be wirelessly connected to the mobile phone and the phone will be connected to the server, that server is based on Django framework and all the computation necessary will occur in server that is sign language to text algorithm. the result processed in server will be sent to mobile device which will be output from speakers using text to speech algorithm. Glove will also take mic input and display to phone using speech to text algorithm.

Project Objectives

• Sign language to Speech conversion

• Multi-language using Google translate Api

• Cost Effective using New Flex sensor Design

Project Implementation Method

Data will be collected using Go-Glove for each symbol and accumulated in server. Whenever the sign will be perform the sensor data will be send to server then server will perform computation based on the language selected which will then pass on to the phone. the equivalent text will be converted to speech. Also the 2nd person speech will be input to phone then the speech will be converted to text then it will be display on phone screen.

Benefits of the Project

Wireless

Cost effective

Multilanguage

Portable

Technical Details of Final Deliverable

Detection of finger bend and hand orientation in 3D space Transfer data from glove to phone wirelessly through Bluetooth Server based on Django which will take data from phone and return the processed result The phone will display the text that is converted from audio from surroundings

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Media

Other Industries

IT

Core Technology

Artificial Intelligence(AI)

Other Technologies

3D/4D Printing, Wearables and Implantables

Sustainable Development Goals

Good Health and Well-Being for People, Industry, Innovation and Infrastructure, Life on Land

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com