Virtual Sign Language Teacher

Project Title

Virtual Sign Language Teacher

Project Area of Specialization Artificial IntelligenceProject Summary

The Application is designed as a Teacher to allow the hearing-impaired children to learn the Pakistan Sign Lanuage with interactive feedbacks and allow them to track their progress when learning sign language

Project Objectives

The Goal is to create a virtual platform where the student can learn sign language. But not just to watch videos on how to do it instead the user can also perform the gesture on the screen using their webcam and the system would predict, analyise the gestures that are created and appoint a score and also feedback on which sequences which part of the hand had annomalies when creating the gesture. A Learning Management System is also incorporated in order to track the progress for the student with automated test assignment and practice for sentences.

Project Implementation Method

The Project is mainly constructed as a Desktop Application intended to be used in Computer with a suitable 720p Webcamera. There would be three users the admin, Teacher and the Student. The admin as the name suggest would control the entire application all from the point of modifying student and teacher credientials to add, update or remove the training videos. Teachers would be able to assign tests to the student or to the entire class if so desired the system would automatically assigned a score based on the students test performance on the three attempts that he/she has made in the test and the teacher can also modify the course videos as well. Students would be able to see their progress about their gestures, perform gestures and gain system feedback with accuracy and error checks for their gestures and to practice gesture as well in the form of whole sentences

Benefits of the Project

The Project's Hardware Resource is minimal with only a single 720p Webcam required and a desktop computer to initiate and run the application. Its Feedback of Providing gesture accuracy and mapping on to each finger tips at each sequence as to where the error actually occured means a better chance of creating accurate sign language gestures with proper guidance and accuracy labels with the advantage of tracking progress and test assignments being included.

Technical Details of Final Deliverable

In the Final Deliverable would be a Desktop Application which would be able to run on any Windows Based Machinie equiped with a webcamera for the gesture recognition. The Software will be equipped with the data that is verified by the Pakistan Sign Language Association and the Learning Management System will contain data as a test case for the final test.

Final Deliverable of the Project Software SystemCore Industry EducationOther IndustriesCore Technology Artificial Intelligence(AI)Other TechnologiesSustainable Development Goals Partnerships to achieve the GoalRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	49000
Webcam	Equipment	14	3500	49000