uGO

Project Title

uGO

Project Area of Specialization Artificial IntelligenceProject Summary

u-GO: an Automated Tool for the Assessment of Presentation Skills

Confidence building is a key factor in the personality development of any student or professional. This is targeted through inter-personal activities, such as presentations, throughout a student's academic career. People with good communication and presentation skills not only get the better career opportunities but also excel in their professional lives. Even though these inter-personal skills play a major role in our lives, we see that not enough attention is paid to promote their development. There is no proper way to evaluate these skills as well as no platform where people can receive a critical review on presentation skills.

To tackle this issue, we have developed a solution for the assessment of presentation skills. Students, professionals, teachers who want better learning of their students, and HR departments that want better and faster evaluation of candidates, can benefit from the detailed analysis of any presentation provided by our tool. We provide a dashboard which displays the Body Language Features, Face Emotion Features and Audio Features of the presenter and also their respective scores. We also provide a Progress Tracking System through which people can see the progress of their confidence level and inter-personal skills throughout their learning journey. U-GO aims to help people improve their communication skills so that they can gain confidence and reach their true potential.

Project Objectives

• To provide a platform where people can improve their confidence by practicing their presentation and communication skills.
• To develop a standard to measure preentation and communication skills.
• To provide easy, accessable, and interactive platform for the development of soft skills.
• To deploy the solution in the education sector so that students have good presentation and communication skills.
• To deploy the solution in the corporate sector so that professionals can present their knowledge and their enterprise in the best way.
• To deploy the solution in the HR sector to act as a screening test for roles that require well-developed soft skills such as marketing.
• To provide a detailed analysis of any presentation in the form of a dashboard with features like body language scores, vocal communication scores and emotion scores.
• To provide a progress tracking system so people can see their progress as they learn and grow.

Project Implementation Method

We first created a dataset of videos and audios and used this dataset as an input to train our Deep learning Models. We then joined these Deep Learning models into an integrated AI algorithm. We deployed this AI algorithm onto a web based platform where it can be accessable to our users. The methodology of the project can be descired as given below:

• The users can record a video of their presentation through their own mobile device.
• They will then upload it to our platform where we will evaluate the presentation.
• The evaluation takes place in the following steps:
  1. Face Detection provides the face of the person in the frame.
  2. Emotion Detection outputs the emotion of this face.
  3. Pose Detection provides the location of key-points of different body parts.
  4. Activity Recognition uses these key-points to identify what activity the person was performing. The activities include facing thescreen, using their hands, standing with arms crossed, negative body posture, and positive body posture.
  5. Speech Recognition converts the audio spoken into text.
  6. Unique words, filler words and repeated words are identitfied from the text obtained.
  7. Rate of speech is calculated by using the text.
• A score is generated for all the evaluations above out of 10 and represented in the Dashboard.
• These scores are then used to calculate a Body Language Score, Emotion Score and a Vocal Feature Score which is represented in the Dashboard.
• Next, these three scores are used to calculate an overall Confidence Score out of 10.
• The Dashboard containing all the information is then displayed to the user and saved in his history.
• If the user has the Hardware Integrated Solution, all of the above steps take place on the hardware device.

Benefits of the Project

Our project not only has good value to the market, but also addresses a social issue. People lack confidence and soft skills and, are hesitant to work on them as no such motivation or resources are available to them. With our product, we aim to provide an inspirational factor as well as the complete equipment so that people can achieve their true potential. Our tool adds value to the folowing market sectors:

1. Education sector: Our tool helps students build up confidence and by improving their presentation and communication skills. Teachers also benefit from our tool as they can easily evaluate every student of their class and track their progress.
2. Corporate sector: In many areas of professional life, good communication is the key to success. Enterprises can use our tool for training their staff so that they are at their best when representing their company.
3. HR sector: The hiring departments can use our tool to analyze their candidates for communication skills.

Technical Details of Final Deliverable

• We have an online platform where any student or organization can login and based on their subscription plan, specific content would be available to them.
• We also provide a hardware integrated solution to organizations that want to ensure privacy of data.
• On the platform, users can upload a video of a presentation which is processed by our AI algorithm which looks at the folowing features:
  1. Emotions of the presenter.
  2. Hand usage of presenter.
  3. Audience Interaction of presenter.
  4. Positive Body Postures.
  5. Negative Body Postures.
  6. Unique words used by the presenter.
  7. Filler word usage such as 'basically' or 'like'.
  8. Repeated word usage.
  9. Rate of speech of the presenter.
  10. Variance in pitch of the presenter.
• The user gets a score for each of the feature listed above.
• On the basis of the features, the user gets a Body Language Score, Emotion Score and a Vocal Feature Score.
• An overall Confidence Score is calculated based on these three scores.
• All the scores are used to form a dashboard that presents all of this information to the user in a meaningful manner.
• The platform also serves as a progress tracking system to its users by dispalying the history of their scores throughout their learning journey.
• We also provide guidance through displayed information and targeted tutorial videos to help the growth of the user.

Final Deliverable of the Project HW/SW integrated systemCore Industry EducationOther Industries Others Core Technology Artificial Intelligence(AI)Other Technologies OthersSustainable Development Goals Quality Education, Gender Equality, Partnerships to achieve the GoalRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	78000
OpenCV AI Kit	Equipment	2	35000	70000
Printing	Miscellaneous	1	2000	2000
Posters	Miscellaneous	2	3000	6000