Glove which converts sign language to speech

Project Title

Glove which converts sign language to speech

Project Area of Specialization Wearables and ImplantableProject Summary

Hearing impaired persons often face the communications issue with people who don’t know the sign language so the Go-Glove will convert the sign language to speech so that the hearing impaired person can communicate with others. The main concern is the language and Go-Glove will support multi language using google translate Api. Flex sensor are used to detect bend of fingers and such sensors are available in market but very expensive so we have designed our own flex sensor which will be almost thrice less expensive as flex sensors. Our flex sensors will be as accurate as one available in market but with the trade off of size. Go-Glove will be wirelessly connected to the mobile phone and the phone will be connected to the server, that server is based on Django framework and all the computation necessary will occur in server that is sign language to text algorithm. the result processed in server will be sent to mobile device which will be output from speakers using text to speech algorithm. Glove will also take mic input and display to phone using speech to text algorithm.

Project Objectives

• Sign language to Speech conversion

• Multi-language using Google translate Api

• Cost Effective using New Flex sensor Design

Project Implementation Method

Data will be collected using Go-Glove for each symbol and accumulated in server. Whenever the sign will be perform the sensor data will be send to server then server will perform computation based on the language selected which will then pass on to the phone. the equivalent text will be converted to speech. Also the 2nd person speech will be input to phone then the speech will be converted to text then it will be display on phone screen.

Benefits of the Project

Wireless

Cost effective

Multilanguage

Portable

Technical Details of Final Deliverable

Detection of finger bend and hand orientation in 3D space Transfer data from glove to phone wirelessly through Bluetooth Server based on Django which will take data from phone and return the processed result The phone will display the text that is converted from audio from surroundings

Final Deliverable of the Project HW/SW integrated systemCore Industry MediaOther Industries IT Core Technology Artificial Intelligence(AI)Other Technologies 3D/4D Printing, Wearables and ImplantablesSustainable Development Goals Good Health and Well-Being for People, Industry, Innovation and Infrastructure, Life on LandRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	66000
ESP 32	Equipment	4	4000	16000
Gyroscope and Accelerometer (GY-521)	Equipment	2	5000	10000
Li-po battery 1100 mAh x2	Equipment	4	1500	6000
Charging protection circuit	Equipment	4	500	2000
3d printed parts (main body)	Equipment	6	1000	6000
3D printed filament	Equipment	1	5500	5500
3d printed guided nodes	Equipment	1	5000	5000
linear pot	Equipment	20	100	2000
vero board	Equipment	2	1000	2000
rubber glove	Equipment	2	250	500
connecting wires, soldering wire and soldering station	Equipment	1	1000	1000
ESP 32	Equipment	0	800	0
Gyroscope and Accelerometer (GY-521)	Equipment	0	400	0
Li-po battery 1100 mAh x2	Equipment	0	800	0
Charging protection circuit	Equipment	0	250	0
3d printed parts (main body)	Equipment	0	2000	0
3D printed filament	Equipment	0	5500	0
3d printed guided nodes	Equipment	0	150	0
linear pot	Equipment	0	50	0
vero board	Equipment	0	500	0
rubber glove	Equipment	0	500	0
Miscellaneous	Miscellaneous	1	10000	10000