See through my eyes
Our project deals with the development of an applcation which is going to help blind people see. Basically in the world of AI and cloud computing, nothing is imposible to do, so here we came up with the idea to develop a smart app that will tell blind poeple whatever they touch or grab with their ha
2025-06-28 16:34:55 - Adil Khan
See through my eyes
Project Area of Specialization Artificial IntelligenceProject SummaryOur project deals with the development of an applcation which is going to help blind people see. Basically in the world of AI and cloud computing, nothing is imposible to do, so here we came up with the idea to develop a smart app that will tell blind poeple whatever they touch or grab with their hand, lets say the go to a grocerie shop overthere they pick up a milk bottle but they don't know what that is, so they are gonna open our app and instantly it is gonna tell them that this is a milk bottle and not only it is gonna tell them about type but also it is gonna tell them the volume and prize of the bottle so that they can easily get to know how suitable it is for them. now what about those objects which do not contain text or any labels such as fresh items include fruits and eggs etc. don't worry our app is gonna classify them as well according to their category, lets say if i touch bnana, my app is gonna tell me that this is bnana. and it is gonna tell them the current rate of bnana in the market as well. keeping them aware from every situtaion. At the end we will be working on very special feature of navigtation for blind, in this feature they would be able to detect whatever object coming in their path, so that they can avoid damage from it. moreover blind people would be able to read the text from screens as well. they simply point the camera at the screen containing text and our AI system is gonna convert the text into sound. Isn't that amazing thing. we will be lauching this app as soon as we develop this, and for that we need resources like cloud, a fast development laptop and some ML services like text recognition. We allready know how to use and integerate these services in our app, we are just looking forward to resources now, so that we can start our development as soon as possible.
Project ObjectivesOur project objective is to help blind people see through our app, Our app is gonna charge 0 rupees, it is free solution for everyone, we are gonna help blind people detect and classify objects so that they feel no more dependent to anything, they will become independent in taking decisions by simply using our app. They will detect and recognize objects which they touch and it is also gonna help them detect things comming in their pathway.
Project Implementation MethodWe are focusing on two major technologies, first one is AI and second one is fog computing, we are gonna start from designing a simple app based on flutter platform which runs on both ios and android. secondly we will integerate AI ssd mobile net model into our app which we are going to train according to our objects and things and constraints. we are not gonna use pretrained models, then we would integerate that model into our app for checking fps results, if not best then we are gonna tune it up. after that we will shift on firebase, in firebase we are gonna use text detection ml service provided by google, we are gonna integerate that service into our app however that service does not work perfectly until we don't tune it. If necessary we are gonna use google cloud ML services of text detection and recognition for custom training of objects and text according to our scenario. then we are gonna integrate both of these models into our app, and test their performance. after that we will do some app related stuff such as it's logo designing, transitioning between different screens, and using voice service to generate voice on the detection and recognition of text and objects, lastly we will do some post processing to integrate and generate some more features like what's coming in my path way? is that cleat? is there any hurdle, such like that. and in this way we are gonna sum up our features into one giant app.
Benefits of the Projectthere are uncountable benefits of our project, some of them I explained above, like a blind person would be able to see everything and even the text which we usually see on our screens, our app can help blind see the world from new eyes. which is our camera eye. the user will feel no more dependant on anything. He himself would be able to solve any problem through his camera vision.
Technical Details of Final DeliverableAs I explained above first we are going to focus on two major technologies, first one is AI and second one is fog computing, we are gonna start from designing a simple app based on flutter platform which runs on both ios and android. secondly we will integerate AI ssd mobile net model into our app which we are going to train according to our objects and things and constraints. we are not gonna use pretrained models, then we would integerate that model into our app for checking fps results, if not best then we are gonna tune it up. after that we will shift on firebase, in firebase we are gonna use text detection ml service provided by google, we are gonna integerate that service into our app however that service does not work perfectly until we don't tune it. If necessary we are gonna use google cloud ML services of text detection and recognition for custom training of objects and text according to our scenario. then we are gonna integrate both of these models into our app, and test their performance. after that we will do some app related stuff such as it's logo designing, transitioning between different screens, and using voice service to generate voice on the detection and recognition of text and objects, lastly we will do some post processing to integrate and generate some more features like what's coming in my path way? is that cleat? is there any hurdle, such like that. and in this way we are gonna sum up our features into one giant app.
Final Deliverable of the Project Software SystemCore Industry HealthOther Industries Education , IT , Security Core Technology Artificial Intelligence(AI)Other Technologies Cloud InfrastructureSustainable Development Goals Good Health and Well-Being for People, Reduced Inequality, Sustainable Cities and CommunitiesRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 75500 | |||
| logo preparation | Miscellaneous | 1 | 1000 | 1000 |
| standees | Miscellaneous | 5 | 500 | 2500 |
| document and reports | Miscellaneous | 1 | 2000 | 2000 |
| stationary | Miscellaneous | 1 | 2000 | 2000 |
| google gcp cloud | Equipment | 1 | 25000 | 25000 |
| Firebase storage | Equipment | 1 | 10000 | 10000 |
| google text to speech service | Equipment | 1 | 12000 | 12000 |
| Text recognition | Equipment | 1 | 15000 | 15000 |
| Object detection and recognition | Equipment | 1 | 6000 | 6000 |