TEXT RECOGNIZING SMART GLASSES

Visually impaired or blind people depend on others in order to live a normal life. Their disability prevents them to study in schools or universities. Braille system is used by blind to read books. Computer Vision Technology has played a significant role in assisting such people. It has helped to ca

Project Title

TEXT RECOGNIZING SMART GLASSES

Project Area of Specialization

Electrical/Electronic Engineering

Project Summary

Visually impaired or blind people depend on others in order to live a normal life. Their disability prevents them to study in schools or universities. Braille system is used by blind to read books. Computer Vision Technology has played a significant role in assisting such people. It has helped to carry out their day to day activities without much dependency on others.

Text recognizing smart glasses can help blind or visually challenged people to read books. The system consists of smart glasses with a camera mounted on it. The captured image is processed by the Raspberry Pi 3 B+ attached on the arm of the user. Text detection is done using the OpenCV software and open source Optical Character Recognition (OCR) tools. The OCR tools used are Tesseract and Efficient and Accurate Scene Text Detector (EAST) based on Deep Learning techniques. The recognized text is then processed by Google’s Text to Speech (gTTS) API to convert it into audible signal for the user to hear through headphones attached on the glasses.

Project Objectives

The objectives of the project are 

• To scan and recognize any printed text.
• To convert text to audio signal.

Project Implementation Method

The system consist of smart glasses with Raspberry Pi 3 B+, an ultrasonic sensor, camera, and headphones. The camera is connected to the Raspberry Pi 3 B+ which is attached to the arm of the user along with a power bank. The Raspberry Pi 3 B+ is a small computer controlling the functionalities of the glasses. It uses Raspbian as the operating system. An ultrasonic sensor is also attached on the glasses. The ultrasonic sensor will measure the distance between the sensor and the image. If the image is within 40-150 cm, the glasses will take a picture of the image by the help of a camera. The Raspberry Pi camera will be used to capture the text image with Still Picture Resolution of 2592 x 1944 pixels and will be placed on the glasses along with the ultrasonic sensor. The text in the image will be recognized by the Open CV and OCR software engines like Tesseract and EAST detector. Once the text is recognized the text will be transformed into audio signal using gTTS (Google text-to-speech). The user will hear this text through the headphones.

Benefits of the Project

The smart glasses will assist visually challenged people to read text and images.The system can be used for both commercial and educational applications. These glasses will give a chance to visually impaired people to study in any school or university. The reading of books by the blind will ensure universal and impartial quality education and strengthen lifelong learning chances for all.

Technical Details of Final Deliverable

The final deliverable will consist of:

• Raspberry Pi

The model of Raspberry Pi will be 3 B+, and Raspbian the operating system.

• Ultrasonic sensor

The model of ultrasonic sensor is HC-SR04. The maximum distance range of this sensor is up to 2-400cm with an accuracy of 3mm. It operates on 5 volts.

• Pi camera

The model of camera will be Raspberry Pi camera Rev 1.3. The camera has the Still Picture Resolution of 2592 x 1944 pixels. It captures the image with clarity of 5 Mega Pixels.

• Headphones

Headphones are used with jack specifications of 3.5mm.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Health

Other Industries

Others

Core Technology

Wearables and Implantables

Other Technologies

Others

Sustainable Development Goals

Quality Education

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com