Walk with Environment

Walk with environment application aims to facilitate blind people while they walk. Application will help blind people to walk with confidence and surety. A person always wishes to be independent so the application will be developed to help the blind people get independent, walk with new comfortabili

Project Title

Walk with Environment

Project Area of Specialization

Artificial Intelligence

Project Summary

Walk with environment application aims to facilitate blind people while they walk. Application will help blind people to walk with confidence and surety. A person always wishes to be independent so the application will be developed to help the blind people get independent, walk with new comfortability level and tries to contribute to making their life easier.

Like people with no such eyesight issue can experience the environment, the walk with environment aspires to provide similar experience to those people who cannot see. A Blind person can easily reach at place like , of by the help of Google maps etc. But What when they have entered at their desired destination, when they have entered in the particular room of the building. Countless Questions can arrive in User’s mind such as their will be a question in mind where am I, is it a lobby, studying room, computer ? How does this place look like, which Objects are present in this particular place? These things can easily be achieved by asking any person moving around like what is the place name and which objects are present in this room to get familiar with environment but every time everyone is not present. Application makes user to be more independent and helps them to get out of the emergency situations if no one is present to help. With independency it also provides pleasure experience of how it looks.

To elaborate more let’s have an example to get to know what basically a Walk with Environment application do. When a blind person is walking, he/she can use applications to find out in which place they are present, for example where at of Mehran of Engineering and Technology, Jamshoro. It is nowadays easy to figure out where are the places because of many applications. Now that blind person has arrived at premises. They can easily find out where Mehran ’s is.  But what happens after a blind person has entered the and comes in an entirely unknown place. The problem is now they do not know at which place inside the they are present. What if there is no human being present at that time and person want to know the place immediately. What if User do not like to rely on another person and wants to do their task their self. Walk with environment application will solve this problem. Person can open the application for using own voice and simply move around the camera slowly. In result Walk with Environment will generate an output with place name and objects present in that place will be provided. Like here a user can be standing at Studying room so in return the output will be It is Study room and have Bookshelf’s, Books, Tables, Chairs, Air conditioner, Paintings, Vase, Fan, Computer, Lamp etc. 

In other words, Walk with Environment goals to connect blind people with environment, enrich their experience and help them walk with self-confidence. 

Project Objectives

Objective of our application Walk with Environment is to provide little contribution in making blind people life easy. Intends to provide user with a pleasurable experience while they walk and encourages them to walk freely in and out with any questions and confusions in their mind.

Application goal is to let them feel the environment, like if they are present in a they can get to know about the environment. With providing the name of the particular place like it’s the studying room of it will also let the user know where he is standing in a building. Also Walk with environment will not only provide the place name like it is Study Room but will also let them know about the objects that are present in room. Like which objects such as Books, Bookshelf, Computers are present through voice.

 Walk with Environment will not only it will enhance Blind User’s experience of walking, but it will also assist them to link with around environment so that user can have enhanced experience.
One of the objectives of the application is to reduce the level of panic, confusion they have when they walk. Question that pops up in mind like where am I or what is around me? By answering such questions with the help of the application Walk with Environment will try to reduce such factors so that blind person can walk satisfyingly and pleasingly without worries.

Another Objective of the application Walk with Environment is to help blind people in emergency time. Emergency can occur anytime and anywhere like they are short of time or wants to do task quickly. Every time other people are not present to help and let a Blind user know which room is this and which objects are present in an environment to get familiar with environment.

While walking, a blind person can have multiple questions in mind. Questions like where they are, how does this place look like, what kind of objects are present such questions can create fuss in mind and results in lack of self-confidence, confusions. That ultimately ruins the blind person experience of Walking. To answer those multiple questions that comes in a user’s mind where they are, how does this place look like, what kind of objects are present, Walk with Environment will help the user to portray image of that place in mind by specifying the place name and objects present in that particular environment.

Application will provide confidence to those people who fears asking other people like where in the building we are present just because they cannot see. Due to that blind people gets uncomfortable and feels like they are dependent on someone else.
In result some people try to avoid in going out and do not get out of their homes. The main objective of our application Walk with Environment is to encourage Blind people to get of their , experience and get in touch with environment with depending on other people.

Project Implementation Method

The implementation details of the project are it starts with a camera functionality that will help in the storage of media. With the help of that media, we get all the data that is present in the environment. Operations are done on the media that is stored in storage. Operations such as Object Detection API that will help in detecting the objects that are present in the environment for example If media of a room of given then it will return all the objects names that are present in media. An algorithm will be implemented with returned objects name that help us to get output with the help of returned objects names. With object detection API scope of the application can extended and optimization can be improved.

While there is another way to perform the same task but with a bit limited scope of application like Bedroom, Kitchen.

It also starts with a camera functionality that will help in the storage of media. With the help of that media, we get all the data that is present in the environment. Operations are done on the media that is stored in storage. Image segmentation is performed on the media that is stored via image functionality. Before that we already have datasets that are to be collected of various objects such as chair, table, etc. Segmented data from image is compared with the datasets that are already collected. An algorithm will be implemented with returned objects name that help us to get output with the help of returned objects names.

Both in result will return the Voice output, in which the place name is mentioned, and objects names are mentioned too. For example, it’s a bedroom and it has bed, television, air conditioner, sofa set, lamp, fan, side tables etc. 

By implementing accordingly, the blind people would be able to walk freely and can get to know about its surrounding.

Benefits of the Project

“Walk with environment” might change the way the blind and impaired perceive the world and It will surely transform the lifestyle of them. The end product will be fast and simple application which will be accessible and available to everyone. Being developed on open-source platforms there will be less to no compatibility issues.

It will help the users gain sense of independence and achievement that they can go to places and do things on their own. For ease of user’s voice output can be developed in their native language too by using premium GCP APIs.

As everyone these days have a smartphone and to make it cost effective, we will be using the smartphone camera, and this will be much economical for the users as the impaired persons are mostly under the poverty line so we will be using their existing resources i.e., their smartphone’s camera (for getting input) and internet services (for transmitting data) no equipment will be needed for operation.

It will be an on-the-go application with single UI simple interface no buggy buttons and will be integrated directly with google assistant so it can start via power button and a simple voice command.

As it will be capturing video so there will not be any issue any image angles or blurry images because the application will automatically get most clear frames from the video and render it for object recognition automatically.

Besides, it being an on-the-go application its portability will be great to its value unlike most of the environment detectors it will be handheld and easy to carry as it will be on the . So, all the portability benefits transfer to it spontaneously.

Blind people will be encouraged to walk freely and will not have any hesitation or confusions in mind as the application will provide them the place name and the surrounding objects name so that they can get familiar with the environment.

Technical Details of Final Deliverable

In hardware Smartphone is required with good camera quality that can provide good media that is to be stored for processing of image. The image is captured from Smartphone’s camera. That will be stored in cloud’s or databases so that our data isn’t lost. The Object detection API is used that will help in detecting objects that are present in the image that is stored. With the help of those returned objects an algorithm is written to give the desired output such as name of place and objects that are present in the environment. Text to Speech API would be used to convey our message in the form of speech from text.
From opening to the closing of application it will be working with Speech API.

While there is another way to perform the same task but with a bit limited scope of application like Bedroom, Kitchen. It also starts with a camera functionality that will help in the storage of media. With the help of that media, we get all the data that is present in the environment. Operations are done on the media that is stored in storage.
Image segmentation API is used on the media that is stored via image functionality that will divide image into different object images.
For that Datasets must be collected of various objects such as chair, table, etc.
 Segmented data from image is compared with the datasets that are already collected.  With the help of those returned objects an algorithm is written to give the desired output such as name of place and objects that are present in the environment. Text to Speech API would be used to convey our message in the form of speech from text.
From opening to the closing of application it will be working with Speech API.

By implementing such technical details, above specified deliverables such as software etc. Walk with Environment application will be developed through which blind people can get benefited and walk freely.

Final Deliverable of the Project

Software System

Core Industry

Others

Other Industries

Core Technology

Artificial Intelligence(AI)

Other Technologies

Sustainable Development Goals

Good Health and Well-Being for People, Gender Equality, Industry, Innovation and Infrastructure, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com