Android application for sign language recognition
We propose a solution to the communication barrier of deaf and dumb community with society, so our idea is about developing an android application that determines the gestures and will convert that gestures into text and vice versa . The application will be based on recognizing existing gestures fro
2025-06-28 16:25:07 - Adil Khan
Android application for sign language recognition
Project Area of Specialization Artificial IntelligenceProject SummaryWe propose a solution to the communication barrier of deaf and dumb community with society, so our idea is about developing an android application that determines the gestures and will convert that gestures into text and vice versa . The application will be based on recognizing existing gestures from the dataset using image processing and machine learning algorithms.
Project Objectives- Develop a model for sign language recognition.
- Develop an android application that will be able to translate sign language to text and vice versa.
- Make a user-friendly environment for the user by providing text output for a sign gesture input or a sign language output for a text input.
- Keypoints detection
- Extract keypoint values
- Collect keypoint values for training and testing
- Preprocess data and create labels and features
- Build and train LSTM Neural network
- Make predictions
- App designing
- Deploy model
Deaf and Mute people use hand gesture sign language to communicate, hence normal people face problems in recognizing their language by signs made. Hence there is a need for systems that recognize the different signs and conveys the information to normal people so our project will help the hearing impaired people to communicate with the normal people.
Technical Details of Final Deliverable- It allows the disable people to communicate with normal people without any interpreter.
- It allows the disable person to give input in the form of signs and our android app will convert it into text and vice versa.
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 30000 | |||
| Firebase cloud storage | Miscellaneous | 15 | 400 | 6000 |
| Machine learning services | Miscellaneous | 10 | 400 | 4000 |
| Xbox 360 Kinect | Equipment | 1 | 20000 | 20000 |