Robot Controlled by Human Gestures

Nowadays, robots are increasingly being integrated into working tasks to replace humans specially to perform the repetitive task. In general, robotics can be divided into two areas, industrial and service robotics. Service robot is an operational aid which operates semi- or fully autonomously to per

Project Title

Robot Controlled by Human Gestures

Project Area of Specialization

Robotics

Project Summary

Project Summary:

Nowadays, robots are increasingly being integrated into working tasks to replace humans specially to perform the repetitive task. In general, robotics can be divided into two areas, industrial and service robotics. Service robot is an operational aid which operates semi- or fully autonomously to perform services useful to the wellbeing of humans and equipment, excluding manufacturing operations.

These robots are currently used in many fields of applications including office, military tasks, hospital operations, dangerous environment and agriculture.

Besides, it might be difficult or dangerous for humans to do some specific tasks like picking up explosive chemicals, defusing bombs or in worst case scenario to pick and place the bomb somewhere for containment and for repeated pick and place action in industries. Therefore, a robot can be replaced human to do work. Here in our project our aim is to reduce human effort with minimal human intervention. Today’s systems are reducing in size and cost we interfaced our prototype of hand with a Raspberry Pi, a mini computer. Our project provides a secure approach with the aim of lowering risks to human life. These risks include working in hazardous environment like mines, industrial compounds, radioactive areas, etc. Inaccessible areas like outer space, extreme temperature areas, etc can also be interacted with human like precision.

Project Objectives

Objectives of Project:

In this project, for the bachelor’s proposal in Electronics, the construction of a wireless human controlled robot is considered. The aim is to build a robot for which a high level of dexterity for the human body is desired. We, as a team, want to make a robot which can perform task(s) in unfavorable environment where humans can barely survive, or where the environment is very deadly, this robot can perform easily and reliably. In various countries, earthquake & many natural disasters occur, and many people are trapped in their houses, offices, and different kind of places but no one wants to guide and help people. It can also be used during war by military. The application of this model is not limited to such extreme conditions, but can be employed in the normal household where people can use this robot to help disabled peoples in their normal routine work

The goal is to be able to grip lightweight objects using the robotic hand. The control of the robotic hand will be carried out through wireless communication, providing wireless communication to Robot with a separate controller, to replicate the mechanical movements of human body a combination of wires, rotary servo motors and sensors are applied.

Project Implementation Method

Implementation Method:

The Glove & Shirt: (Transmitter)

The main components of the controller for the Robot’s arm consisted of a glove with four flex sensors for each arm. Each joints of the robotic hand will be controlled by one flex sensor. The flex sensors were attached to the gloves & shirt and then connected to an Arduino Nano via a breadboard. By mapping the variable resistance of the flex sensors to a degree of rotation in the servo motors both extension and flexion of the hand will be achieved. The controller glove was made wireless by hooking up the Arduino Nano to the RF transceiver module nRF24L01. The Arduino Nano for the controller glove was powered through an external power source of a 9V or 5V battery.

Robot & Robotic Arms Movements: (Receiver)

Eight servo motors that will be connected to the robotic arms would be programmed by first importing the Servo library. For the radio frequency transceiver modules, the RF24 library is also imported, allowing for the address of both transceiver & receiver modules to be set. After setting the address and opening the communication between the two RF modules the data received is used with the write () function to rotate the servo motors. The flex sensors can be calibrated first by using the analog Read () function from which the values for a fully relaxed to fully bent flex sensor’s data is observed. And according to data received from the flex sensor we will rotate the robotic arms servo motor in the different angles like a human body arm.

we will use the joystick to control the chassis so that our robot can move in every direction we require. The joystick will be connected with the Arduino Nano and according to joystick movements the data will be transferred through RF transceiver module to Arduino Mega.

We use the camera to see front side of our robot. Esp32 cam is cheap and most commonly used in these kinds of projects. we also have another option of using raspberry pi camera because we are using raspberry pi. We can also use a web camera.

We are going to need a single board computer to get the video output of the camera which is connected to our robot, and we are going to use the single board computer (Raspberry pi) to run the python script of computer vision to Identify the objects which comes near to camera’s vision.

Benefits of the Project

Benefits of Project:

The concept of a Robot has several applications. It is therefore thought that the project has potential usage in diverse industries such as the medical industry, in laboratory settings and the defense industry, if it were to be developed. In particular, for the medical industry. Similarly, a well-functioning Robot could be used in environments dangerous to humans such as the handling of toxic substances and dismantling of bombs. Using less complicated method to control a Robot which can be used by any teenager to elderly person for different purposes. this robot use less complicated method to use 

Technical Details of Final Deliverable

Technical Details:

Flex Sensor:

 The flex sensor is a variable resistor, where the degree of bend in the sensor determines the resistance.The variations of resistance is recorded digitally and the data is in this case translated into degrees of rotation for the servo motors.

nRF24L01 Transceiver and Adapter Module:

The wireless transceiver nRF24L01 is based on the radio frequency (RF) transmission to the microcontroller. It operates on 2.4 GHz and helps to wirelessly transfer the data of flex sensor to the robot.

Robotic Arm:

robotic arm will replicate the arm movements of human body. we are going to use 4DOF robotic arm. each servo motor of the arm will move according to the data of flex sensor.

Arduino Nano:

The Arduino Nano is an open-source microcontroller based on ATmega328P offered by Arduino. It is comparable to the Arduino Uno, offering similar functionality but in a smaller size. arduino nano will read the data of the flex sensors and joystick then transfer it to the arduino mega which is located in the robot.

Arduino Mega:

The Arduino Mega, is an open-source microcontroller based on ATmega328P. this microcontroller will control the arm and horizental movements of the robot, it receives the flex sensor and joystick data through radio frequency transceiver module and move the servo motors and chassis motors accordingly. 

Raspberry PI :

The Raspberry Pi is a very cheap computer that runs Linux, but it also provides a set of GPIO (general purpose input/output) pins, allowing you to control electronic components for physical computing and explore the Internet of Things (IoT). we can run our pythone script of computer vision in this single board computer. the algorithm of computer vision will detect the objects in the range of our camera.

Chassis:

The chassis is the bottom framework of our robot. we will use the chassis for the movement of legs in Robot. The chassis contains two DC motors for horizontal movement. Chassis provides stability and balance to Robot.

Camera module:

We use the camera to see front side of our robot. Esp32 cam is cheap and most commonly used in these kinds of projects. we also have another option of using raspberry pi camera because we are using raspberry pi. We can also use a web camera.

Joystick:

we will use the joystick to control the chassis so that our robot can move in every direction we require. The joystick will be connected with the Arduino Nano and according to joystick movements the data will be transferred through RF transceiver module to Arduino Mega.

Final Deliverable of the Project

Hardware System

Core Industry

Others

Other Industries

Manufacturing

Core Technology

Robotics

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Decent Work and Economic Growth, Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com