INTELLIGENT IOT BASED ASSISTIVE SYSTEM FOR SPEECH DELAYED CHILDREN
Delayed speech or language development has become one of the predominant problems in the past few decades. It is kind of a communication disorder in which the children usually rely on their parents or relevant institutes to develop their social skills. An automated intelligent system for such childr
2025-06-28 16:27:59 - Adil Khan
INTELLIGENT IOT BASED ASSISTIVE SYSTEM FOR SPEECH DELAYED CHILDREN
Project Area of Specialization Computer ScienceProject SummaryDelayed speech or language development has become one of the predominant problems in the past few decades. It is kind of a communication disorder in which the children usually rely on their parents or relevant institutes to develop their social skills. An automated intelligent system for such children may prove to be helpful in growing their day-to-day communication skills and also help the parents on cutting down on their therapy expenses and save their time. Our objective is to develop an IOT based assistive system that can identify objects using computer vision, notifying the user about the detected objects with an audio message in a friendly manner. The said project includes both software and hardware. The software consists of backend and an user interface while the hardware will include Raspberry pi, a camera and a speaker.
Project ObjectivesOur objective is to develop an IOT based assistive system that can identify objects using computer vision, notifying the user about the detected objects with an audio message in a friendly manner. The said project includes both software and hardware. The goal of the proposed system is to develop a system that could help children with speech or language delays learn pronunciations and meanings of new words. The complexity of the teaching process stems from the fact that it must be carried out in a systematic, loving, and patient manner over several days. Hence, such system will not only help the child but also their parents to save their time and cut down on their finances. The proposed system will assist the user in recognizing several objects such as a person, chair, table, etc. which the children with speech delay cannot identify generally. Furthermore, the proposed system will be created on a low budget and simple to use, allowing users to go about their everyday tasks without interruption.
Project Implementation MethodFor the project implemetation, we will be using the softwares Anaconda , MySql and flutter. For the hardware part, we will be needing Raspberry pi, a camera and a speaker. The machine that the software will be developed on is a Core i7, 64-bit. The object detection system is designed in Anaconda’s Python development IDE Spyder, with Python 3.8. The database is compatible with MySQL, but can be modified to be fit for any other database system. The application has been developed in Flutter, so it is compatible for both desktop and mobile platforms. The server is a service of AWS, Amazon Web Services.
Benefits of the ProjectThis product’s prime usage is for children who are delayed in their understanding or speaking of regular everyday words. When a child's grasp of speech and language is restricted, it affects not just their capacity to convey their feelings to others, but also their ability to interpret them inwardly. To help such children cope with these developmental deficiencies, this product will encourage them to learn new words with the correct pronunciation, so they do not end up becoming shy and restricted in their social lives.
The second module of this product, the software application, is designed to be of aid to the parents/guardians of the children using the device. The app will first allow the parents to configure the device, and then after the child starts using it, the app will also keep the parents updated regarding the words their child has learnt over the course of his use of the device. Hence, such system will not only help the child but also their parents to save their time and cut down on their finances.
Technical Details of Final DeliverableThis product performs two basic functions:
- Interact with the child wearing the device to inform him of the objects in his vicinity
- The app will update parents/guardians regarding the status of the child’s learning progress.
System Features:
The features of the product are mentioned module-wise.
- Image Frame Capture by the Camera - The objective of this module is to capture live video frames and send them to the server for image processing.
- Image Processing on the Server - The objective of this module is object detection in the video frames sent to the server by the hardware, and then to send the names of the objects detected back to the hardware. Also, this feature stores the detected objects in the database, along with the User ID.
- Telling Object names to the Child via Speaker- The objective of this module is to speak to the child and tell him the object names that have been detected in his vicinity.
- The Application for Parents/Guardians - The objective of this module is to allow the Parents/Guardians of the child using the device to create an account on the Application, as well as get a User ID for configuring the device at boot.
- User Interface - furthermore, there is an application designed for the parents of the child using the device. This application allows parents to keep a track of the words their child is learning throughout the day during his various activities.
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 22500 | |||
| Raspberry pi Zero w | Equipment | 1 | 16000 | 16000 |
| 5MP Raspberry Pi Camera | Equipment | 1 | 3000 | 3000 |
| Bluetooth speaker | Equipment | 1 | 3500 | 3500 |