Computer Vision Based Communication Assistance For Audibly Impaired
A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.
Project Title
Computer Vision Based Communication Assistance For Audibly Impaired
Project Area of Specialization
Project Summary
A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.
Project Objectives
Our aim is to create a wearable, portable yet affordable solution that will allow sign to voice communication. We are targetting American Sign Language due to it's popularity as well as cater to any unique signs that are present in local communities to help deaf people as much as we can.
Project Implementation Method
Our solution utilizes a Raspberry Pi with a camera module that captures the sign being performed and speaks the word associated with it. This is done by sending by the video to a server running a deep learning network that sends back the prediction to the Pi, which outputs by speaking the word via a speaker connecting to the Pi.
Benefits of the Project
- Helping anyone who cannot talk
- Affordable
- Portable
- Easy to use.
- Caters to custom gestures.
Technical Details of Final Deliverable
We chose a Raspberry Pi as it has the specifications as it can easily run Python code, has its own camera module for easy interfacing, can be powered by a power bank to make it portable and has network capability which allows us to communicate with a server running a very accurate deep learning network for robust predictions.
Currently our model is achieving a 99.6% accuracy with 30% data used for validation, on the ASL Kaggle dataset, using transfer learning on ResNet50.
Final Deliverable of the Project
Type of Industry
Technologies
Sustainable Development Goals
Required Resources
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Raspberry Pi | Equipment | 2 | 5950 | 11900 |
| Rapberry Pi camera module V2 | Equipment | 1 | 3495 | 3495 |
| Pi case | Equipment | 1 | 450 | 450 |
| Power Adapter | Equipment | 1 | 760 | 760 |
| Shipping Cost | Miscellaneous | 2 | 250 | 500 |
| Power Bank | Equipment | 1 | 2000 | 2000 |
| Memory Card | Equipment | 1 | 500 | 500 |
| 5 inch touch screen hdmi lcd for raspberry pi | Equipment | 1 | 3800 | 3800 |
| self adhesive pure copper heat sink for raspberry pi | Equipment | 1 | 300 | 300 |
| Mini Beauty Speaker With Selfie Spotlight For Mobile Phone - Golden | Equipment | 1 | 449 | 449 |
| Mini Pillow Speaker Earphone Headphone- White | Equipment | 1 | 270 | 270 |
| Total in (Rs) | 24424 |
If you need this project, please contact me on contact@adikhanofficial.com
Autonomous UAV based power line inspection
The inspection of power lines is the most important task, which enhances the confidence of...
Access Control System
Our project is based on IOT based technology to acheive portable solution for vehical/driv...
Designing of regenerative braking system for electric vehicle
The increased concerns over the impact of conventional (fossil fuel-based) cars on the env...
Peer
Entrepreneurship is a process in which people tend to take risks to grow their business. T...
Prototype Development of Wireless Haptic Glove for hand interface with...
In this project a Haptic glove will be developed and interfaced with a VR headset. Through...