AR Virtual Assistant for Physiotherapy

Project Title

AR Virtual Assistant for Physiotherapy

Project Area of Specialization Artificial IntelligenceProject Summary

This project proposes an innovative solution to promote independence by offering patients virtual therapy. Its main objective is to remotely aid the patients who need physiotherapy.  It incorporates an augmented reality headset and a smart device that detects a patient's gestures.

Physiotherapy usually requires patients to visit clinics regularly and also practice physiotherapy exercises at home which sometimes leads to poor adherence of exercises resulting in them getting anxious and irritated. Patients also become dependent on their caretakers for taking them to their physiotherapists for sessions.

The solution we came up with is to provide patients a system that consists of a wearable VR headset to help them perform their daily therapy exercises with a virtual assistant in augmented reality and our smart device will monitor patient’s movements and guide them accordingly.

                        Our system would be able to provide instant and illustrative feedback to patients. With its help, physicians could easily make customized therapy plans developed on the basis of careful assessment and following case-by-case therapy goals. It could also enhance patient’s engagement and motivation with 3D virtual environments.

Project Objectives

Project Objectives (Tentative):

• Detecting motion and gestures of patient
• Reporting error
• 2D to 3D conversion of animation
• Results backup on cloud

Project Implementation Method

Part 0: Make hardware for connecting software with cloud and camera

Part 1: Process and identify patient's movements 

Part 2: Develop mobile and web application

Part 3: Develop headset with 3D animations

Benefits of the Project

Our proposed system covers the physiotherapy of patients who need help regarding their torso, legs (excluding feet) and arms (excluding hands).

Technical Details of Final Deliverable

(Tentative) 

• Smart Phones
• Google VR Cardboard
• RGB Camera
• Laser emitting device
• Servo motor
• Server
• Android Studio
• Anaconda and PyCharm
• Visual Studio
• MATLAB and OpenCV

Final Deliverable of the Project HW/SW integrated systemCore Industry MedicalOther IndustriesCore Technology Augmented & Virtual RealityOther Technologies Artificial Intelligence(AI)Sustainable Development Goals Good Health and Well-Being for PeopleRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	18206
Aryzon Headset	Equipment	1	8456	8456
Arduino	Equipment	1	629	629
jumper wires	Equipment	40	4	160
1K ohm resistor	Equipment	25	1	25
wifi module	Equipment	1	369	369
laser	Equipment	1	1444	1444
camera	Equipment	1	7048	7048
10k ohm resistors	Equipment	25	2	50
100k ohm resistors	Equipment	25	1	25