Student Productivity Booster using Conversational Vision

A camera will observe the student. The system will identify the face of student and ensure his presence using face recognition techniques. It will analyze the facial expressions to ascertain the productivity of student in class by checking his attention level. After face expressions analysis, his ac

Project Title

Student Productivity Booster using Conversational Vision

Project Area of Specialization

Artificial Intelligence

Project Summary

A camera will observe the student. The system will identify the face of student and ensure his presence using face recognition techniques. It will analyze the facial expressions to ascertain the productivity of student in class by checking his attention level. After face expressions analysis, his activity will be observed through body detection, body tracking and motion analysis. A productivity report will be generated by the system to check the concentration level of student in class. Both student and teacher can view the productivity report. A communication platform will be developed where communication will take place between student and teacher to provide useful suggestions to student by teacher for optimizing his productivity. Either system or teacher both can communicate with the student.

Project Objectives

• Our main objective is to make an automatic system to automate students attendance and to monitor student’s concentration level and behavior in classroom to lower the overhead on the teacher to monitor the students during lecture.
• It also minimizes teacher’s time and e?ort to observe student’s interest in particular subject.
• Teacher will analyze the report of student. He will provide important guidelines to students on that particular interested subject.
• It will also provide a platform where student and teacher can communicate through conversational chatbot so that communication gap between student and teacher will reduce and productivity of student is optimized which lead to better education system

Project Implementation Method

Attendance System:This system ensures the presence of student during class. In this system ?rst the face is detected and then recognized to mark the attendance of student.This system contains two sub modules.

1. Face Detection:In face detection, ?rst step is image pre-processing. After this resizing, cropping, blurring and sharpening of image is done for image manipulation if needed. Second step in face detection, that is the main aim of this module is to determine whether there is any face in an image or not. The algorithm needs to be trained on large number of positive and negative images. Training improves the algorithm’s ability to locate the face in image or video.
2. Face Recognition: In this module, picture is captured from photo or video of any student’s face who is looking straight ahead or nearly in pro?le. After that, geometry of face is extracted such as distance between eyes, distance from forehead to chin and facial landmarks which are keys for distinguishing the face. These are called facial signatures. Facial signatures compare with the faces in database by using mathematical formulas for recognizing the face correctly.

Facial Expression Analysis:

The objective of this module is to analyze facial expressions of student to monitor his/her concentration level in classroom By Live streaming, proposed system analyzes change in facial expressions of every student present in classroom. Human has ?ve basic expressions that are divided into two categories. In attention category: smile, anger and confuse, and in non-attentive category: sad, neutral are included. It results from expression which show percentage of every emotion. Checking his percentage, student will fall either in attentive or non-attentive category.

Activity Analysis:The main objective of system is to examine activity of students by detecting and recognizing his body motion. In body detection, upper body and full body are detected, and in motion analysis this module tracks the body of recognized student during the class. Face recognition, motion analysis and head pose technique is used to analyze the activity.  For activity analysis data is get from face recognition and motion analysis. Further in motion analysis, three functions are performed such as body detection, body tracking and motion recognition.

Productivity Analysis of Student: Productivity report of student is generated which contain student attendance, concentration level and overall behavior of student in class.This report is shown to both student and teacher. So that teachers can observe overall number of students who remain attentive during lecture and can also analyze the interest of student in that particular subject on the basis of their concentration level in the lecture.

Benefits of the Project

• Increase Student’s Productivity

Using proposed system, students can be monitored automatically and notify both the teachers and students about e?ectiveness of student during any lecture.

• Automatic Monitoring of drivers

To build a self-driving car system that monitors driver’s attention using facial expressions in order to avoid the road accidents. In this way rate of road accidents decreases.

• Monitoring at construction sites

This system is also useful to monitor the workers at construction sites. If they are going to take a wrong step, an alarm message is delivered to them.

• Automatic Monitoring during Pilot Training

Monitoring of pilots during training and ?ights is most crucial thing to avoid air tra?c accidents. Monitoring should be done using face expression analysis and evaluated during initial training, recurrent training and operational line checks.

• Monitoring During Interview

In this era, job interview is also conducted virtually through video calling and the proposed system with some variations is suitable to analyze face expressions of interviewee and determines whether he/she is good at for job or not.

• Consultation from Mentors

The proposed system is helpful for students or employees to seek guidance and consultation from mentor and to get bene?t from expertise of consultants in order to resolve any issue related to work.

• Increase Business Productivity

This system benefits by increasing the pro?t of the business by inspecting the employee’s attention and optimize their productivity by taking actions against their behavior.

• Tracking of suspicious activity

In order to monitor suspicious activity like theft, robbery or an unknown person trying to go to prohibited area, this system will helpful.

Technical Details of Final Deliverable

Desktop application services are available o?ine. The functionality of application is discussed below:

Home: Home screen has registration and processing button from where user can navigate.

• Registration: Registration button allows user to go to registration screen where user can register students.

• Processing: Processing button allows user to go to processing screen where user select required option from combo box and start processing.

Registration: By clicking on “Registration” button, a new screen opens where user add student’s name, roll number and upload image. By clicking on “Register” button, student’s image is saved in folder with given name and roll number.

Processing: By clicking on” Processing” button, a new screen opens from where user select Face Mask Detection, Face Recognition, Emotion Detection, Motion Detection, Object Interaction. Video is captured live through web cam and mobile cam. Video is displayed in a frame which is controlled by start and stop button.

Final Deliverable of the Project

Software System

Core Industry

IT

Other Industries

Education

Core Technology

Artificial Intelligence(AI)

Other Technologies

Others

Sustainable Development Goals

Quality Education

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com