Object identification and feedback for visually impaired impared people
For the visually impaired population of the world, this project works as an assistant which detects and identifies objects in real-time, detects obstacle and provides feedback. The main purpose is to assist the visually impaired user just by receiving an audio query and giving an audio feedback. The
2025-06-28 16:34:17 - Adil Khan
Object identification and feedback for visually impaired impared people
Project Area of Specialization Artificial IntelligenceProject SummaryFor the visually impaired population of the world, this project works as an assistant which detects and identifies objects in real-time, detects obstacle and provides feedback. The main purpose is to assist the visually impaired user just by receiving an audio query and giving an audio feedback. The system consists of a microcomputer attached with a depth sensing camera and an audio I/O device.
First, the visually impaired user sends audio query, like "find me a Chair". The system then processes the query via speech-to-text and compares the keyword i.e. Chair. After this, if the requested object is identified in the surrounding then the system will provide audio feedback i.e. "Chair is 2 meter away. Turn right (according to obstacle-avoidance)". If the object is not identified, then system replies "Object not found. Change your direction please".
Project ObjectivesFollowing objectives are listed below to fulfill the completion of this project:
- Detect and Identify Objects in real-time
- Detect Obstacle
- Measure Distance & Direction of Object from visually impaired user
- Give Voice Feedback i.e. Distance & Direction of object from visually impaired user and also the name of object
- Provide Obstacle-free path via audio
Whole system is embedded in Nvidia Jetson Nano (microcomputer), attached with Depth sensing camera and an audio IO device (headset). To power the microcomputer, a 20,000 Mah power bank is fixed with it. Keeping the camera at sight level, the objectives will be fulfilled as follows:
- Objects will be detected and identified in real-time
- Objects' distance and direction will be calculated
- Once the user sends audio query about an object, the system will give its distance and direction
- The system will detect obstacle and then provide obstacle-free path
For the purpose of project completion, the end deliverable will be in the form of project only. For transformig this project into a viable product, additional assembling, manufacturing and framing costs will be considered.
Benefits of the ProjectFollowing benefits from this project are mentioned below:
- Assistance for Visually Impaired Population via AI edge device (no need of internet)
- Easily implentable for outdoor assistance
- Can be integrated by Google Maps
- Scalable to deploy in industries, health sectors, security and military
Following are the technical details of final deliverable:
- All the system is run in Nvidia Jetson Nano
- Object detection and identification is done in 45 FPS
- Using Intel RealSense Depth Sensing Camera, distance and direction is measured (upto 10 meters)
- Also, obstacles are detected and system provides obstacle-free path
- Via headset, audio input is given and feedback is received
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 66642 | |||
| Nvidia Jetson Nano | Equipment | 1 | 22899 | 22899 |
| Intel RealSense Camera | Equipment | 1 | 32699 | 32699 |
| Baseus Power Bank 20,000 Mah | Equipment | 1 | 3700 | 3700 |
| Logitech Webcam | Equipment | 1 | 2950 | 2950 |
| A4TECH Headset | Equipment | 1 | 1350 | 1350 |
| USB to 3.5mm Jack | Equipment | 1 | 119 | 119 |
| Fuel | Miscellaneous | 25 | 117 | 2925 |