I See You

Project Title

I See You

Project Area of Specialization Artificial IntelligenceProject Summary

In Pakistan progression on health sector related to technology is minimum as compare to other developed countries. In last few year people have increased around 2 Million who are suffering from blindness with no social resources to help them out in such a feasible manner. Today technology is improving daily in different aspect of life. Owing to the application of technology our standard of living has increased. Technology has also boosted medical industry. Medical technology leading towards innovative development of devices all around the world. Indeed, technology advancement has also helped blind and people with disability in so many ways.

Our proposed idea titled as I SEE YOU, an invaluable, intelligently designed, well perceived project providing confidence, assurance, and simply the love of life to the blind.  I SEE YOU, is a friendly user device equipped with face and object recognition, ability to avoid any obstruction and has a value-added feature of defining a walking route to any defined destination via voice recognition support. Moreover, a friendly Graphical User Interface will be developed by which beneficiary’s guardian can track their Live location and can manage face names and relationships labels. This innovative design of the product is skillfully based on regular goggles.  It is light-weight, appealing, and most importantly robust!  This technology is based on programmed principles of Machine learning, Artificial Intelligence, Computer Vision, Image Processing and Internet of Things. 

Project Objectives

Our main objective is to assist the unsighted people to safely and harmlessly move among obstacles and other hurdles faced by them in their daily challenges like: -

1. Recognize people they meet.
2. Walk freely anywhere and roam around.
3. Explore different places.
4. Go to any destination to where they want.
5. They can enjoy the happening of surrounding environment while walking

           Moreover, their Guardians can also keep an eye on their activities like: -

1. They can track Blind user from web, phone and desktop application
2. They can see and update face records which user has stored in glasses to meet people
3. Guardians also gets informed in the case of any sort of emergency through these web, smart phone and desktop software.

Project Implementation Method

We choose agile methodology for our project. This is basically a glass for blind people with hearing device. When a user meets any of their relative, glasses will tell the user name and relationship on request but when they encounter different people to whom they don’t know, the glasses have the capability to store the name and relationship with that person when he/she pronounces their name as technology is increasing rapidly day by day same with diseases. So, in future it may be possible to change or add some features in it according to the condition. Moreover, in agile method, interaction of client is more important. So, their desire and wants of the blind people in clearly understand and tested by the user itself. therefore, for completing it successfully and make it possible to use by the needed people, we have to interact and take feedback from the client on periodic basis. And this flexibility is possible in agile.

1st Phase (Requirement Analysis): -

1. Team discussion
2. Design according to user’s convenience
3. Software design planning
4. Collect Data set
5. GPS system planning according to user’s Home destination
6. Balancing glasses size
7. Finalizing requirement report

2nd Phase (Initiate Project): -

1. Construct fully functional glasses hardware
2. Upload Data set
3. Configure GPS
4. Design Software and deploy on website, windows and smart phone
5. Cascading microcontrollers and upload code on them

3rd Phase (Integration and Testing): -

1. Check size of glasses according user’s comfort
2. Data set testing
3. Testing of uploading random data set of faces with name labels
4. GPS accuracy test
5. Software comfort level with guardian
6. Microcontrollers performance

4th Phase (Quality Assurance): -

1. Durability of glasses
2. Data set maintenance
3. Processor’s smoothness
4. Software test
5. GPS smoothness

5th Phase (Deployment): -

• If all phases are successfully completed then it will be delivered to user
• If user need some changes or enhancements or some errors occurs then this whole cycle will iterate till better performance

Block Diagram

Explanation: -

User gives input through voice which will be received from mic, command will be performed by camera like if user wants to know that who is standing in front of him he can ask through mic to CPU then CPU will capture the image and tells who is standing in front, this process is done when camera acquire a image it will detect a face, create a bounding box around it then it will extract the features and compare the result from face dataset and then finally provides output from speaker of glasses.

Likewise, for object detection, it will acquire a image from camera create a bounding box around it and recognize from data set and it also measures the distance between user and obstacle to avoid obstacles in path and gives directions through speakers of glasses

 

Benefits of the Project

I See You gives the love of life to the blind community in the form a friendly companion

• User can store thousands of face record with their respective relationship status with that person
• Walking around the area or city will be easier and reliable
• User can go to a desirable destination by a walk
• User will be trackable to guardians by which user can go anywhere without being worried
• User can enjoy explanation of sightseeing.
• Explore thousands of different objects with their names and colors
• User can spend his luxury time by listening to entertainment music and FM radio live steaming.
• Guardians can monitor Users records

Technical Details of Final Deliverable

1. On the side of glasses an earpiece will be fixed on which all the output will be generated.
2. User can give input from mic to communicate with the processor in order to perform different task.
3. Camera will be placed on the front center of the glass from where image processing will be done, it will detect faces and objects.
4. Gesture motion gives a backup option to take pictures and to alert family members or guardians in case of malfunction
5. Ultra Violet Rays glasses to protect eyes
6. Rotatable switch to power on/off device
7. Slots to hold microcontrollers
8. Extra portion to place circuits and wires
9. Exhaust fans to keep the temperature of CPU cool.
10. GPS system will be places on Microcontrollers to keep tracking of user

Final Deliverable of the Project HW/SW integrated systemType of Industry IT , Health Technologies Artificial Intelligence(AI), Internet of Things (IoT), Wearables and ImplantablesSustainable Development Goals Good Health and Well-Being for PeopleRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	63820
Raspberry Pie 3B+	Equipment	2	8000	16000
Raspberry Pie 3B+ Starter Kit	Equipment	2	2300	4600
Heat Sink	Equipment	2	120	240
Fan	Equipment	1	40	40
Raspberry Pi Camera Module V2 - 8 MP	Equipment	2	5000	10000
Primer External Expansion Bread Board Jumper Wire Kit for Raspberry Pi	Equipment	1	1500	1500
SIM808 GPS Module	Equipment	1	3700	3700
Container for Raspberry Pi	Equipment	1	500	500
30mm Head-Set Speakers	Equipment	2	1700	3400
Mini stereo Microphone	Equipment	1	500	500
Battery	Equipment	2	100	200
Glasses Frame 3D-Prinitng	Equipment	1	10000	10000
Infrared gesture sensing motion direction recognition	Equipment	2	1200	2400
HC-SR 04 Ultrasonic Sensor	Equipment	1	250	250
Rotatable Switch	Equipment	2	100	200
Rocker Switch	Equipment	2	70	140
Sim	Equipment	1	150	150
Miscellaneous	Miscellaneous	1	10000	10000