Real time Emotion Detection System in healthcare
A person?s good health requires that he is mentally prosperous. And if he is mentally calm, he will be able to do good work, or on the other side if he is suffering from any mental problem such as work stress or any other personal problem which he cannot share in office, then it effects on his work.
2025-06-28 16:34:42 - Adil Khan
Real time Emotion Detection System in healthcare
Project Area of Specialization Artificial IntelligenceProject SummaryA person’s good health requires that he is mentally prosperous. And if he is mentally calm, he will be able to do good work, or on the other side if he is suffering from any mental problem such as work stress or any other personal problem which he cannot share in office, then it effects on his work. So, therefore, I want to create a system which can detect person’s emotions. Because emotions and expressions tell how actually a one person is feeling, he is in happiness, sadness, fear, disgust, anger, neutral or surprise. This system recognizes user’s emotions in image processing using facial recognition and is designed as a Python based System. In which Emotions are detected in real time for the health care of the user, and this can be done by using Raspberry pi 3, So, emotion detection bases on information acquisition and processing from the several sensors placed in the environment to recognize some affective states(happy, sad, anger, fear, disgust, neutral or surprise), and camera to acquire facial emotions, camera to track the behavior, and this is a window 10 IoT based project. Realtime Emotion Detection System in Healthcare is an Artificial Intelligence based project and uses one type of Artificial intelligence that is deep learning, uses algorithms of Deep learning such as ANN (Artificial Neural Network), in which we design a system that captures human image through camera and recognize the emotions which are showed in image and after this display a result on the screen that are according to the picture of the person whose emotion is detected. If person is in bad emotional (e.g. in anger or in stress) sate then the system should show an alert.
Emotions can detect through speech but My project detects emotions by taking a picture and also display that picture on the screen.
Project ObjectivesOur objective is to detect the Emotions of human face in real time as fast and as accurate as possible, that are useful in healthcare.Emotion detection is essential and useful in human computer and human robot interaction applications because emotions indicate feelings and needs. Our application can recognize user emotions to provide appropriate services in healthcare.
- Emotion Detection is the process of detecting human emotions from facial expressions for human’s healthcare.
- The human brain recognizes emotions automatically, and software has now been developed that can recognize emotions as well. This technology is becoming more accurate all the time, and will eventually be able to read emotions as well as our brains do.
- Our healthcare system focuses on emotional aspects and integrates emotion detection from facial expressions to identify user emotions to provide appropriate services.
- Humans Emotions are detected through a machine using different sensors.
- This System diagnose the emotions of the human which can puts a bad impact on his health.
- A major objective of real time emotion detection system, is try to provide a health care to the user.
- Humans can try to live stress free life through this system because whenever a user is in unusual condition or system detects unusual emotions in his Behavior, which can be detrimental to his heal, So, then the system shows an alert on the screen.
- Human emotions change with different states of health; therefore, an emotions detection system can be beneficial to a healthcare framework.
- A real time emotion detection system is proposed to improve the service of the healthcare in a smart city.
- This project is used to detect human emotions through a picture, and picture is taken/captured by the using camera, Camera shows the picture on screen of monitor or Tab.
This project is proved beneficial in health because thorough this device doctors can check patients’ emotions and realizes that the patient is in anger or in stress and the treatment of the patient can starts immediately. Thus, you can say that this system can save the doctors time.
Project Implementation MethodReal Time Emotion Detection System in healthcare implementation methods are:
The emotion detection finds a user’s face from the video
frames (input).
• The detection extracts the facial features and normalizes
them to form feature vectors.
• It then classifies the user emotions into one of seven classes
(neutral, happiness, sadness, anger, disgust, fear and
surprise) using a classifier that is generated from training
process.
• Finally, it calculates the percentage of each emotion for
The emotion detection finds a user’s face from the video
frames (input).
• The detection extracts the facial features and normalizes
them to form feature vectors.
• It then classifies the user emotions into one of seven classes
(neutral, happiness, sadness, anger, disgust, fear and
surprise) using a classifier that is generated from training
process.
• Finally, it calculates the percentage of each emotion for
The emotions detection finds a user’s face from video frames. The detection extracts from the facial feature and normalizes them to form feature vectors. It then classifies the user emotions into one of seven classes happiness, sadness, fear, disgust, anger, neutral or surprise using a classifier that is generating from training process. Finally, it calculates the percentage of each emotion for further analysis.
Classifying the emotion on the face as happy, angry, sad, neutral, surprise, disgust or fear.
To detect emotion in the
Tools Used:
There are different tools which are used for the implementation of the project. These tools are as follows:
- Raspberry Pi
- Raspberry pi camera
- Sensors
- Tablet
Languages:
- Python
- OpenCV
- Machine Learning
Deep Leaning
Benefits of the ProjectEmotion Detection System in Health Care can give the following benefits:
- This System will very useful in term of human health, this gives an idea of when to give patients medicines or why the patients’ health is not improving.
- This project is proved beneficial in health because thorough this device doctors can check patients’ emotions and realizes that the patient is in anger or in stress and the treatment of the patient can starts immediately.
- This system can identify seven different type of emotional states in real-time: happiness, sadness, disgust, surprise, anger, and fear.
- This system can provide benefit to the psychological patients. Through this system doctors can easily detect patients’ emotions state and take the idea which emotion is not letting the patients’ health recover. And then the doctor starts more focusing on those emotions that are stopping patients from recovery.
- The one benefit of this project is that it can save doctor and patients time, because doctor can easily understand patient’s condition by seeing patients emotional state.
- Detecting emotions with technology is quite a challenging task, yet one where machine learning algorithms have shown great promise.
- The e-health sector benefits from emotion detection system to monitor mental states of patients at home and to improve recovery rates through a more personalized care.
- Emotion Detection System might be useful to predict emotions from patients who are unable to express their emotions, for example patients suffering from autism (Autism spectrum disorder is a condition related to brain development that impacts how a person perceives and socializes with others, causing problems in social interaction and communication.) born dumb babies and depth
- This System will help peoples to keep them away from frustration and trouble.
- This System is very useful for people who are unable to speak and born mute and deaf. Because born muted people cannot easily express their so it is very beneficial for them.
One of the benefits of this system is that people can see their emotions themselves and tries to overcome if they are in anger state. Emotion Detection System can be used to determine levels of stress while handling machines and vehicles and helps to reduce the risk of car crashes or accidents at work.
Technical Details of Final DeliverableThis Project is an Emotion based. So, in final it is a kind of artificial Intelligence based machine which simply takes inputs from the user and show the output to the user. And this can be done by using different algorithms that are part of artificial intelligence, machine learning, and deep learning. These algorithms used to detect emotions happiness, sadness, fear, disgust, anger, neutral or surprise that are important for human healthcare. The final delivery of the project is a hardware based which is connected with raspberry pi 3 and LCD screen or TAB and camera and sensors.
Final Deliverable of the Project HW/SW integrated systemCore Industry ITOther Industries Education , Medical , Health Core Technology Artificial Intelligence(AI)Other Technologies Internet of Things (IoT)Sustainable Development Goals Good Health and Well-Being for PeopleRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 80000 | |||
| Raspberry pi 3 | Equipment | 1 | 16000 | 16000 |
| camera | Equipment | 1 | 9000 | 9000 |
| sensors | Equipment | 7 | 1000 | 7000 |
| Laptop | Equipment | 1 | 30000 | 30000 |
| Printing report | Miscellaneous | 1 | 2000 | 2000 |
| Micro SD Memory Card | Miscellaneous | 1 | 2000 | 2000 |
| USB flash | Miscellaneous | 1 | 2000 | 2000 |
| tab | Equipment | 1 | 8000 | 8000 |
| stationary | Miscellaneous | 1 | 4000 | 4000 |