Development of proof of concept for helmet mounted cueing system for flight simulator

The aim of this project is to develop a proof of concept for helmet mounted cueing system. This includes integration of glasses with embedded sensors to detect eyeball movements of the pilot and lock targets on screen of the flight simulator and to develop a pilot?s head position monitoring to opera

Project Title

Development of proof of concept for helmet mounted cueing system for flight simulator

Project Area of Specialization

Wearables and Implantable

Project Summary

The aim of this project is to develop a proof of concept for helmet mounted cueing system. This includes integration of glasses with embedded sensors to detect eyeball movements of the pilot and lock targets on screen of the flight simulator and to develop a pilot’s head position monitoring to operate a flight simulator.

Project Objectives

Following are the tasks to be performed in this project:

(1) Tracking the eyeball movement of the subject to lock different targets on a flight simulator.

(2) Tracking the head motion of the subject to change the viewing angle in the simulator.

Project Implementation Method

(1) The head motion data is transferred from the sensor to arduino.

(2) A connection from MATLAB to flight simulator is established using Simulink.

(3) Data from webcam and IMU is transferred to the flight simulator using MATLAB to control it.

Benefits of the Project

Advancements in technologies have significantly increased the prices of new aircraft. Commercial vendors are spending millions of dollars for the training of their pilots. The proposed project will offer a low-cost training solution, where the pilots and ground operators will be able to familiarize themselves with Helmet Mounted Cueing System (HMCS). Integration of actual sensors and associated hardware will give a real mission feel to the operator. Moreover, the eyeball and head movements of professional pilots can be noted and used to groom novice pilots and operators.

Technical Details of Final Deliverable

A custom-built headgear integrated with webcam/IR sensor and IMU connected with arduino. The headgear will be supplemented with dedicated software to translate the sensed data and human (operator's) head and eyeball movements into measurable actions by integrating it with a commercially available flight simulator. For experimentation purpose, XPlane flight simulator has been shortlisted which will be integrated through MATLAB.

Final Deliverable of the Project

HW/SW integrated system

Type of Industry

IT

Technologies

Wearables and Implantables

Sustainable Development Goals

Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com