Sensor Based System for Gesture Recognition of Autism Disorder
Autism, also called Autism spectrum disorder (ASD) is neurological dis-order which effects the development of communication skills and social interactions in children. People with ASD have restricted interest and repetitive behaviors. ASD hurts the person?s ability to function properly in schoo
2025-06-28 16:29:03 - Adil Khan
Sensor Based System for Gesture Recognition of Autism Disorder
Project Area of Specialization Wearables and ImplantableProject SummaryAutism, also called Autism spectrum disorder (ASD) is neurological dis-order which effects the development of communication skills and social interactions in children. People with ASD have restricted interest and repetitive behaviors. ASD hurts the person?s ability to function properly in school, work, and other areas of life.
In this project, we propose design and implemention of a gesture recognition system for deaf and dumb people that converts the sign language into verbals. This project will facilitate and improve a communication method between the verbal and nonverbal people. Many researches have been conducted to develop sign to speech translator, most of these are based on image-processing based system. The efficiency of these techniques depends on the image quality, which is significantly affected by the light intensity and situation of the implemented camera (resolution, focusing, alignment). These factors can affect the image quality and thus reduces the sys capability to recognize the gesture. In this project we will develop the following modules 1). Body-worn sensors network platform 2). Communication link between body-worn sensors network and raspberry-pi system-on-chip based processing system. 3) Signal conditioning and features extraction from sensors data to improve processing time and accuracy. 4) Classification models performance comparison for better accuracy achievement. The proposed systems will be aid-on to improve the social life of ASD, make them a good citizen, and assist them in communicating with normal people.
Project Objectives- Multi sensor fusion platform for ASD children complex sign language recognition
- Communication link for transferring body sensors data to processing system
- Performance comparison of time-domain and frequency domain signal information
extracted for better accuracy and time processing
- Collection of Dataset from ASD children
- Performance comparison of recognition algorithm such as neural networks and deep
convolutional network
- Translating the sign language to normal human understanding language
- Work as bridge for ASD children to communicate with normal people.
- Made speech impaired people independent.
- This project will enable ASD children to work like normal people.
- Remove communication barrier between ASD and normal people.
- Motion sensor MPU6050
- Three-axis accelerometer(X,Y,Z)
- Three-axis gyroscope(Z,Y,Z)
- Flex Sensors (bend in term of resist)
- Controller that will collect data from sensor and transmitt it wirelessly to the processing part.
- Raspberry-Pi based processing system that will extract various features and analyze and recognze the gesture.
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 78500 | |||
| Soldering Iron | Equipment | 2 | 4000 | 8000 |
| Arduino Nano | Equipment | 3 | 800 | 2400 |
| Flex Sensor | Equipment | 12 | 3400 | 40800 |
| TFT LCD | Equipment | 2 | 2900 | 5800 |
| Raspberry pi | Equipment | 1 | 9000 | 9000 |
| Printing Cost, Component Shipment | Miscellaneous | 5 | 2000 | 10000 |
| Bluetooth Module | Equipment | 1 | 250 | 250 |
| MPU6050 | Equipment | 5 | 450 | 2250 |