Smart Mirror Control With Gesture Using AI

Project Summary  The rapid evolution of the Artificial intelligence with Internet of Things (IoT) paradigm during the last decade has leads to its importance in developing smart devices. Recently, technology advances in the artificial intelligence based IOT smar

Project Title

Smart Mirror Control With Gesture Using AI

Project Area of Specialization

Artificial Intelligence

Project Summary

Project Summary 

The rapid evolution of the Artificial intelligence with Internet of Things (IoT) paradigm during the last decade has leads to its importance in developing smart devices. Recently, technology advances in the artificial intelligence based IOT smart devices is increasingly popular. In this study, we proposed comprehensive and extensive development model for the smart mirror with artificial intelligence based enabled IoT. Such kind of devices will be pivotal role in future 5G internet. In addition, IoT based systems role to interconnect with several things for smart and efficient communication and provide data sharing on the network, its vast array of advantages has grasped a lot of attention of several technologies. Smart mirrors are the mirrors of the future with an electronic display behind the glass that display time, weather, news, remainder, calendar, video display and current temperature of the room.  This mirror is enabled with artificial intelligence module and allows to receive the information about information stored in smart phones. The proposed model is twofold approach. First part is about 24 Inch flat tv screen configuration and the second part is about different sensors connected to raspberry PI to control different modalities and connect with screen through HDMI. The model will allows us to receive information online and display it on the mirror screen along with other details including current temperature of the room.  The proposed system will work as hybrid systems and uses a Raspberry Pi 4 Model based processor board along with LCD display and IOT based sensors such as DHT11 temperature sensor, PIR sensor for motion and APDS-9960 gesture sensor interfaced together. Further, the aluminum to construct the outer frame and will placed glass samples by holding the mirror in front of the display.  Currently some minor scales implementations of this problem are already implemented such as: i) Magic Mirror [1-3] . ii)Smart Mirror [4-6] There are few limitations in the existing model. Some of these projects is quite costly and very low consumer sales model and also with very limited features. The proposed system will be indigenous low cost open source mode and will be flexible to add on more features in the future. Also this project will be challenging in the sense to provide low cost design along provide open source module for learning based technology.

Project Objectives

Project Objectives

The objective of the proposed project to reduce the need for the user to make time in their daily morning or nightly routine to check their laptop, tablet, mobile or smartphone for the information they need. The mirror will provide the information (Such as time, weather, news, remainder, calendar, video display and current temperature of the room) with little to no effort from the user with the goal of not being a burden that user must maintain. it will turn on and off with help of gesture. The use of gestures will keep things simple and easy to use. This smart mirror allows the users to read, think, and plan their day while getting ready in the morning or night. The system will also update automatically the user calendar schedule and all related information.

Objectives:

• To provide more innovative solution for AI enabled based IOT Mirror.
• An Android App oriented update system to keep updated 7/24.
• To connect the mirror based LCD to Raspberry PI to  in-home environment.
• Environment sensors are connected to hybrid system to receive the information on Mirror
• Provide open source to build own more features for future design.
• Less costly and portable system..
• To provide awareness about room environment and mobile updates .

Project Implementation Method

Project Implementation Method

The implementation stage is broad divided into three layers. The three tier architecture is the most fundamental and essential architecture. The detail flow diagram as shown in Figure-1

Layer-1 : The layer is commonly related to physical equipment layer, in which we will test and connect different devices and sensors with Arduino and raspberry PI. Further, Configure and connect DHT11, PIR, and APD990 sensor with the Arduino UNO board and check the output of these three sensors. After connecting the sensor with Arduino board, connect Arduino board with raspberry pi through data cable.

Layer-2 : This layer is important layer in the since to connect and transfer the data to ThingSpeak cloud based system.  The advantage of this layer is to connect the data to cloud and later on retrieve and used in mobile application. 

Layer-3 : This layer is the most important layer as its interface layer connected with raspberry with LCD based mirror. In this layer we will connect Raspberry pi to the LCD screen. Install the magic mirror and magic mirror modules, node.js, and its related libraries to raspberry pi. Place all the system equipment’s in the mirror frame. Finally, display all module on LCD.

Benefits of the Project

 Benefits of the Project

The major benefits of the proposed project is to display useful information on the mirror. The user will just look at smart mirror and the information such weather , email. Room temperature etc will be online available. In daily routine the user multiple time used the mirror by stand in front of the mirror . The activity perform when stand in front for mirror is brush the teeth, makeup or prepare for the day. Imagine while you go through your morning routine you just look at your mirror and see a News, weather updates, room temperature etc. The proposed project is low cost and open source software. In future , the project will be have more modules such sound recognition and face recognition.

Benefits:

This project will provide the following benefits regarding provide the following facilitation.

• The proposed smart device will facilitate human with low cost device. The aware about the different activities such weather condition email and provide information during critical situations like high temperature and humidity increasing/decreasing, and keep inform us using Smart Mirror.
•  The Proposed system will portable, indigenous and low cost solution.
• The system will provide open source solution that can be use in future research and built on many future applications.
• The proposed system is perfectly aligned with stat art technology for the requirements of 5G communication.
•  Control Gesture recognition through APD9960 will embed in the system.
• Give awareness and Help us to keep environment clean and according to human body requirements.

Technical Details of Final Deliverable

Technical Details of Final Deliverable

The different types of sensors like DHT11, PIR, APD9960 will use to collect the real time data. Raspberry-pi will receive this data from sensors connected with Arduino. Raspberry-pi will send this data to cloud and user will receive it  . Smart mirror will display all the relevant information related to sensor and also provide information of connected smart phone and will changes different activities using gesture recognition. our system uses a The Raspberry Pi 4b+ Model based processor board along with LCD display and IOT based circuitry and DH11 temperature sensor and APDS-9960 gesture sensor interfaced together. We use aluminum to construct the outer frame. then we placed glass by holding the mirror in front of your display. The raspberry pi 4b+ Connected to LCD through HDMI cable. The below circuit diagram explains the setup in a simplified manner.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Education

Core Technology

Internet of Things (IoT)

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Quality Education, Industry, Innovation and Infrastructure, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com