Computer Vision Based Communication Assistance For Audibly Impaired
A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.
Project Title
Computer Vision Based Communication Assistance For Audibly Impaired
Project Area of Specialization
Project Summary
A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.
Project Objectives
Our aim is to create a wearable, portable yet affordable solution that will allow sign to voice communication. We are targetting American Sign Language due to it's popularity as well as cater to any unique signs that are present in local communities to help deaf people as much as we can.
Project Implementation Method
Our solution utilizes a Raspberry Pi with a camera module that captures the sign being performed and speaks the word associated with it. This is done by sending by the video to a server running a deep learning network that sends back the prediction to the Pi, which outputs by speaking the word via a speaker connecting to the Pi.
Benefits of the Project
- Helping anyone who cannot talk
- Affordable
- Portable
- Easy to use.
- Caters to custom gestures.
Technical Details of Final Deliverable
We chose a Raspberry Pi as it has the specifications as it can easily run Python code, has its own camera module for easy interfacing, can be powered by a power bank to make it portable and has network capability which allows us to communicate with a server running a very accurate deep learning network for robust predictions.
Currently our model is achieving a 99.6% accuracy with 30% data used for validation, on the ASL Kaggle dataset, using transfer learning on ResNet50.
Final Deliverable of the Project
Type of Industry
Technologies
Sustainable Development Goals
Required Resources
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Raspberry Pi | Equipment | 2 | 5950 | 11900 |
| Rapberry Pi camera module V2 | Equipment | 1 | 3495 | 3495 |
| Pi case | Equipment | 1 | 450 | 450 |
| Power Adapter | Equipment | 1 | 760 | 760 |
| Shipping Cost | Miscellaneous | 2 | 250 | 500 |
| Power Bank | Equipment | 1 | 2000 | 2000 |
| Memory Card | Equipment | 1 | 500 | 500 |
| 5 inch touch screen hdmi lcd for raspberry pi | Equipment | 1 | 3800 | 3800 |
| self adhesive pure copper heat sink for raspberry pi | Equipment | 1 | 300 | 300 |
| Mini Beauty Speaker With Selfie Spotlight For Mobile Phone - Golden | Equipment | 1 | 449 | 449 |
| Mini Pillow Speaker Earphone Headphone- White | Equipment | 1 | 270 | 270 |
| Total in (Rs) | 24424 |
If you need this project, please contact me on contact@adikhanofficial.com
Safety System To Avoid Accident While Driver Is In Drowsiness
Safety is very critical in the automotive industry and it would be a vigorous proposition...
CURE ME
The goal of this project is to develop an online clinical prediction model. The system pro...
Agriculture Tech Solutions
Agriculture is taken into account the back bone of Pakistan economy, which relie...
Hazard Activator
Problems and Solutions ? Hazard Information not delivered to public and...
Cosmetics Sentiment Shop
It is a Sentiment analysis of some cosmetic products which is used to analyze raw text to...