EYE TRACKING BASED SMART ROOM AUTOMATION SYSTEM

The problems faces by the paralyzed/stroke patient that they haven?t living standards like normal people. We came up with a solution ?Eye tracking based smart room automation?. Through this the disable person may get independent to control his room. The system is especially for those who even can?t

Project Title

EYE TRACKING BASED SMART ROOM AUTOMATION SYSTEM

Project Area of Specialization

Internet of Things

Project Summary

The problems faces by the paralyzed/stroke patient that they haven’t living standards like normal people. We came up with a solution “Eye tracking based smart room automation”. Through this the disable person may get independent to control his room. The system is especially for those who even can’t speak or move their body properly like after brain stroke and having tetraplegia. The system is just required the eye signals from the disabled person using computer vision, the smart room automation with microcontroller utilizing voice assistant and it is wrapped up by IOT based camera device into an android application. This project is proposed under the vision of enhancement of living standards. Implementation of it can reduce cost of a 24/7 caretaker to some extent  i.e in homes and hospitals. 

The proposed project will make the daily basic operations easy to do for paralysed/stroke patients like controlling room appliances switch on/off the fan and lights and other room appliances like split, television and even blinds automatically. It can also increasing or decreasing the speed of fan and also lock the room by using the feature of smart locking. Through the application the patient can generate an emergency call to his care taker like for food and any other problem. The application can be customized in a sense that we may change or enter the new appliances into the system.

The problems faces by the paralyzed/stroke patient that they haven’t living standards like normal people. We came up with a solution “Eye tracking based smart room automation”. Through this the disable person may get independent to control his room. The system is especially for those who even can’t speak or move their body properly like after brain stroke and having tetraplegia. The system is just required the eye signals from the disabled person using computer vision, the smart room automation with microcontroller utilizing voice assistant and it is wrapped up by IOT based camera device into an android application. This project is proposed under the vision of enhancement of living standards. Implementation of it can reduce cost of a 24/7 caretaker to some extent  i.e in homes and hospitals. 

Project Objectives

• The aim of this project is to Facilitate inter-personal- and tele-communications for persons who are not able to communicate in the usual manner.
• Serve the smart technology in securing the lifestyle.  
• Give convenient access to the home appliances to the paralysed/stroke patients.  
• Provide benefits to the paralysed/stroke patients from up to date smart home technology through Environmental control system (ECS) and to demonstrate this potential to public.
   

Project Implementation Method

• First the device camera gets input from eye tracking uses facial landmarks, OpenCV, Python, and dlib, if the user looking left the left command generated that already described as a left room appliances in the android based application and same goes for all the direction.
• Now the voice assistant calls the name of left appliances, the appliances is mapped on binary combinations that is going to be selected by the number of blinks of the eye in a row and user can get the access of the selected appliance.
• A blink combination is used to process the input in real time and send appropriate control signal through Bluetooth to a microcontroller. The microcontroller takes appropriate decision based on various sets of inputs and the output of the microcontroller board is used to control the appliances.
• Here microcontroller board is used to check the correctness of the blink sequence. Opto-couplers are used to isolate the low power circuit from the high power circuit and a high current driver IC is used to activate the relays which switches the appliances. A 12V adapter is used to provide constant voltage to the ICs and relays.      
• All the room appliances locations already set into an android application that is connected to the device through internet and then it can be easily customized to add new appliances and caretaker details. This application also provides a notification alert feature.

Benefits of the Project

The proposed project will make the daily basic operations easy to do for paralysed/stroke patients like controlling room appliances switch on/off the fan and lights and other room appliances like split, television and even blinds automatically. It can also increasing or decreasing the speed of fan and also lock the room by using the feature of smart locking. Through the application the patient can generate an emergency call to his care taker like for food and any other problem. The application can be customized in a sense that we may change or enter the new appliances into the system.  The limitation of the system is that we can’t increase or decrease the temperature of split or can’t change the setting of any appliances. User can only give eye signals of the direction of appliances to the programed location of the appliances in the system as we have 4 eye positions up, down, right and left and if the appliances are more than four so they may stacked on same positions. 
 

Technical Details of Final Deliverable

We will start this project with open cv,python and dlib that track the eye motion and count its blink using facial landmarks . Now the design a voice assistant using python and deploye it into the raspberry pi and at last we will design android application using android studio by using java.
The setup of eye tracking unit located  6 inches above the users head and approximately 18 inches to 24 inches away from the user's eye. Eye commands tracking implemented by using digital image processing after this microprocessor received those as an input and process it by applying ‘kazemi algorithm’ from Dlib and by using signal processing control the room smartly by the help of voice assistant. State of the appliances set by android application by the caretaker and stored them in system database. The application also generate the notification alert  to caretaker device. Database also maintain a log of assistant details.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Others

Other Industries

Core Technology

Internet of Things (IoT)

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com