HAWK EYE GLASSES BASED ON RASPBERRY PI

These ?Hawk Eye Glasses? are designed to help the blind people to read and translate the typed text which is written in the English language. These kinds of inventions consider a solution to motivate blind students to complete their education despite all their difficulties. Its main

Project Title

HAWK EYE GLASSES BASED ON RASPBERRY PI

Project Area of Specialization

Augmented and Virtual Reality

Project Summary

These “Hawk Eye Glasses” are designed to help the blind people to read and translate the typed text which is written in the English language. These kinds of inventions consider a solution to motivate blind students to complete their education despite all their difficulties. Its main objective is to develop a new way of reading texts for blind people and facilitate their communication. The first task of the glasses is to scan any text image and convert it into audio text, so the person will listen to the audio through a headphone that’s connected to the glasses. The second task is to translate the whole text or some words of it by pressing a button that is connected to the glasses as well. The glasses used many technologies to perform its tasks which are OCR, (gTTS) and Google translation. Detecting the text in the image was done using the OpenCV and Optical Character Recognition technology (OCR) with Tesseract and Efficient and Accurate Scene Text Detector (EAST). In order to convert the text into speech, it used Text to Speech technology (gTTS). For translating the text, the glasses used Google translation API. The glasses are provided by Ultrasonic sensor which is used to measure the required distance between the user and the object that has an image to be able to take a clear picture. The picture will be taken when the user presses the button. Moreover, the motion sensor was used to introduce the user to the university’s halls, classes and labs locations using Radio-frequency identification (RFID) reader. All the computing and processing operations were done using the Raspberry Pi 3 B+ and Raspberry pi 3 B. For the result, the combination of using OCR with EAST detector provide really high accuracy which showed the ability of the glasses to recognize almost 99% of the text. However, the glasses have some drawbacks such as: supporting only the English language and the maximum distance of capturing the images is between 40-150 cm. As a future plan, it is possible to support many languages and enhance the design to make it smaller and more comfortable to wear.

Project Objectives

The main goal is to empower the blinds so that they can live their lives like normal people (like us).

Glasses are designed to be the eye for the blind person and people who suffer from vision difficulties to make their life easier and be able to continue living their life as a normal human to follow up and achieve their goals and dreams.

• Convert printed text to audio.

• Inform the user by the location of the classes in the green zone.

• It makes their life easier and they will be able to live a normal life.

• Increase education level because “Hawk Eye Glasses” will help all people with vision difficulties to study by these glasses with normal people in any school and University.

Project Implementation Method

The methodology is divided into five parts. The first part is on the hardware
implementations, followed by software implementation, Steps, Programming and
working.

After set up all hardware and software on point first thing that we will do is to train
our device by following these methods.

Image capturing.

Image will be captured by the camera placed on the glasses We will train our
deceive to capture the high quality image because it will help to identify the content
with more ease.

Pre processing.

The captured imaged image will go to the software where the software converts the
content written on image into audio

Image to text converter

The transcription is further delivered to the audio output for the conversion. Once it is
done it will be announced on the earphones.

Text to speech

When the audio is ready it will start reading the text and blind will be able to listens
the audio easily.

Benefits of the Project

We are working on a project that is portable and can easily be used by a blind or low vision person so that they can utilize this for academic and intelligence ability. A device developed in this work utilizes other sensory function in receiving information from a text.

Technical Details of Final Deliverable

. Installing Raspbian Stretch Operating System:

Before downloading the operating system on the SD card, the SD card should be formatted, it was used SD Card Formatter for this purpose, Figure 1.9. Then the Raspbian stretch files were moved to the SD card. After that, the SD card was inserted into the Raspberry Pi. Finally, the keyboard, the mouse, HDMI cable and lastly the power were inserted into the correct raspberry ports.

 Installing OpenCV 4 Libraries:

OpenCV is a library of programming functions for real-time computer vision, the library is cross-platform and free for use under the open-source BSD license For the installation of the OpenCV 4 libraries, the recommended operating system for the raspberry pi B+ which is Raspbian Stretch was installed. Win32 Disk Imager was used to flash the SD card.

Importing Ultrasonic Sensor:

“Hawk eye Glasses” used the Ultrasonic Sensor to detect the text image. To connect the sensor the team used 1k ? Resistor, 2k ? Resistor, and Jumper Wires to connect Vcc, TRIG, ECHO, and GND. The team used python code to control the Ultrasonic Sensor detection then be able to measure the destination.

Setting Up the Button:

“Hawk Eye Glasses” used two buttons one for capture the image and other for translating. In order to, set the button the team runs small python code to connect the button. To check the button the team, add condition statement to print “Button Pressed” when the button was pressed. The connection was easy just two wires one for the ground and the other one connects the pin.

Setup a Raspberry Pi RFID RC522:

The connections:

• Team members connected SDA to Pin 24.

• Team members connected SCK to Pin 23.

• Team members connected MOSI to Pin 19.

• Team members connected MISO to Pin 21. • Team members connected GND to Pin 6.

• Team members connected RST to Pin 22.

• Team members connected 3.3v to Pin 1.

Convert text to voice:

One of the most important functions of the “Hawk Eye Glasses” is text to voice conversion. In order to implement this task, team installs gTTS which is abbreviations of Google Text-to-Speech. It is a python library that interfaced with Google Translate API. gTTS has many features such as convert ultimate length of text to voice, provide error pronunciation using customizable text pre-processors and support many languages and retrieve them when needed. Using python code, team members implemented the text to voice conversion task. The gTTS was installed using the following command:

$ pip install gTT

Final Deliverable of the Project

Hardware System

Core Industry

Manufacturing

Other Industries

IT , Medical , Health

Core Technology

Augmented & Virtual Reality

Other Technologies

Artificial Intelligence(AI), Internet of Things (IoT)

Sustainable Development Goals

Good Health and Well-Being for People, Quality Education, Decent Work and Economic Growth, Peace and Justice Strong Institutions

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com