AI virtual mouse control

Project Title

Project Area of Specialization

Artificial Intelligence

Project Summary

Here we proposed a system where the cursor moves through the desktop and action will occur based on hand gestures. The system will apply hand gestures. We were using OpenCV Library in this AI virtual mouse project. A real-time webcam is used in this project to track the movement of hand landmarks and hand tips also gesture patterns instead of a physical mouse. Based on the movement of the object system will fire an event. The system will get desktop screen size. The system will acquire a single frame from the video. The system will flip the frame for user-friendliness. The system will perform image processing. The system will add a bounding box around the object, which is moved by the user around the display. The bounding box centroid is calculated. The system will detect the mouse point routine.

Project Objectives

The main objective of the proposed AI virtual mouse system is to develop an alternative to the regular and traditional mouse system to perform the same functions of the mouse, and we can be achieved with the help of a web camera that captures the hand gestures and hand tip and then processes these frames to perform the particular mouse function such as - (1)(2)
left click,
right click,
zoom in
zoom out
scrolling function

Project Implementation Method

IMPLEMENTATION TOOLS AND TECHNIQUES – (1)

Web Cam
Python
Mediapipe
OpenCV
Autopy
Numpy
Pandas
Matlab

Benefits of the Project

The AI virtual mouse system is useful for many applications; it can be used to reduce the space for using the physical mouse, and it can be used in situations where we cannot use the physical mouse. The system eliminates the usage of devices, and it improves the human-computer interaction.

Technical Details of Final Deliverable

These are the following features in this project

Based on the movement of the object system will fire an event.
System will get desktop screen size.
System will detect objects even in night darkness with the night vision camera feature.
System will acquire a single frame from the video.
System will flip the frame for user-friendliness.
System will perform image processing.
System will add a bounding box around the object which is moved by the user around the display.
Bounding box centroid is calculated. The system will detect the mouse point routine.
Yes, Latency will be improved in our system