Spherical Robot For Interaction With Autistic Patients

Autism is a complex neurobehavioral disorder which impairs the person to socially interact with others, communicate or have repetitive behaviors. Our idea is to develop a system/project which will not only help in the diagnosis of autistic patients but also help them in their treatment. It is not on

Project Title

Spherical Robot For Interaction With Autistic Patients

Project Area of Specialization

Robotics

Project Summary

Autism is a complex neurobehavioral disorder which impairs the person to socially interact with others, communicate or have repetitive behaviors. Our idea is to develop a system/project which will not only help in the diagnosis of autistic patients but also help them in their treatment. It is not only limited to autistic patients but we can also use this robot as an entertainment tool (Build in Alexa as well as our own software which will perform functions like playing song from youtube of your choice) and it could also be used in military for various purposes. User/patients are able to interect with the robot through their voice or they can also interect with the robot through special gestures which they teach to the robot. Robot will perform certain actions or show us response through a voice.

Project Objectives

> Autistic Patients Diagnosis

> Autistic Patients Treatment

> Entertainment Tool

> Military Purposes

> Surveilance

Project Implementation Method

Robot:

Research suggest that one of the best therapies for the treatment of autistic patients is through play therapy so the idea of building a spherical robot came into existance. It consists of two 100RPM motors which drive the robot as well as a camera for image processing, arduino uno as a controller along with other modules.

Interaction:

User/patients interact with the robot with the help of their voice but before sending the command through their voice they have to trigger the robot so that it can listen to your command. So user have to say maela (Robots name) to wake her up and then speak what ever they want the robot to do. Robot will listen to that voice and send that voice to our application through bluetooth.

Application:

Application is build in java swing and java SE. Its job is to receive the voice signal from controller or arduino and translate it to text, we are doing it by using google speech recognition library for python. Upon converting the voice to text our application will check for markers or more precisely for what the robot should response. Application will perform its processing and translate that response into voice using again google's text to speech library for python or gtts in short, our robot will send that voice back to our robot through bluetooth and robot will play that voice or perform the action which the application sends.

Diagnosis:

We are not performing diagnosis on medical level as currently their are no medical ways available to diagnose the child with autism. We can only diagnose the child by observing it which is very difficult nowadays as most parents are doing jobs and are not able to give their most time to their children. As children with autism have repetitive behaviors our robot will check for that using image processing and YOLO or tensor flow libraries available for python. Weekly report will also be generated and emailed to your doctor for further improvement. Doctor can also facetime with their patients which will be available on our application.

Treatment:

Application will help in the treatment of young childs as well. We'll have some designed programs which the child should go through in the supervision of a caretaker. Those programs include the basic teaching of how shapes work and then giving the quiz to the user. Weekly report will be generated and is emailed to your doctor so that he/she can check for improvement.

Benefits of the Project

Our aim is to hit two major areas of life:

> Benficial for society

> Governness level

We're hitting those area's as autism is affecting around 350,000 children in Pakistan. To have such a system which will help in the treatment as well as the diagnosis will surely benefit the society not just that it could also be used as an entertainment tool because it has alexa build in as well as our own software which will help you to build skills so that you can control the robot the way you want it and this robot can also be used in military for various purposes due to its surface tackling and swiming capabilities which is satisfying our second goal of governness level use.

Technical Details of Final Deliverable

Final Deliverables will include:

> Spherical Robot

> Java based application

> Documentation

Research suggest that one of the best therapies for the treatment of autistic patients is play therapy so the idea of building a spherical robot came into existance. Its design will attract the children attention. Spherical Robot is build around two 100RPM motors, 1 arduino uno board to control them, 1 speech recognition module to trigger the robot, 2 high quality speakers for outputting sound, 1 ELP 2 MP camera module for image processing.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Medical

Other Industries

Health

Core Technology

Robotics

Other Technologies

Sustainable Development Goals

Good Health and Well-Being for People, Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com