Using NLP and Mixed Reality to Control a Drone
The normal approach to delivering any physical objects from one place to another is to pick it up and carry it to its destination. This is done by a person who has to travel some distance to deliver the object. This approach becomes time-consuming when the delivery person is stuck in a traffic jam w
2025-06-28 16:29:54 - Adil Khan
Using NLP and Mixed Reality to Control a Drone
Project Area of Specialization Artificial IntelligenceProject SummaryThe normal approach to delivering any physical objects from one place to another is to pick it up and carry it to its destination. This is done by a person who has to travel some distance to deliver the object. This approach becomes time-consuming when the delivery person is stuck in a traffic jam which delays the delivery to a few hours or even days depending upon the destination which could either be within the city or outside the city. Our goal is to make the delivery system more efficient and convenient. And for that, we are developing a hardware and software integrated system that uses a drone to dispatch the items from one place to another without wasting time.
It can be used for delivery of any sort of light or semi-light object. Such a product is useful in today's era where people are not allowed to leave their homes and also harmless, as it is a contactless delivery system; viruses will not transfer easily. It is highly useful for medical emergencies as well. Such as requiring blood bottle or medicines for a critical patient from another destination in less time. It allows customers to get their hands on something they ordered online and want it to be delivered in a few hours instead of a few days.
Project ObjectivesIn times like COVID-19, the need for making life's essential needs readily available from home emerged. To develop this project is to contribute to the problems faced in such scenarios. The project objectives are mentioned below;
1. To decrease manual labor.
2. To provide efficient and quick delivery system.
3. To minimize the possibility of unsuccessful delivered packages.
4. To maximize the reward of on-time delivery.
5. To minimize delivery cost.
6. To build a system that is easy and fun to handle (an understandable mechanism).
Project Implementation MethodTo implement natural language processing and mixed reality in our system we will use the programming language Python and Java to operate the system. For the development, we will use PyCharm and Android Studio. To connect our software with the real world; drone, we will use the raspberry pi. Popular python libraries such as Natural Language Toolkit will be used to implement NLP in the system.
Benefits of the Project1. Reduces manual labor
2. More work in less time
3. Easy to handle and use
4. Easy mechanism
5. Quick service
6. Cost-efficient
7. Easy to manage
8. Eco-friendly
9. Increased productivity
10. Introducing AI in daily chores
11. Harmless at situations like COVID-19
Technical Details of Final DeliverableThe final product can be used by any company that offers delivery of their products and wants to make the delivery process more efficient, convenient, safe and quick. Instead of a delivery person, the drone will deliver the products. A person will be required to operate the drone through the natural language, he/she can ask the drone to pick up or drop items, take off, land or move/travel. The commands given to drone in natural language will be recognized by the python libraries and the drone will process according to it. Or through mixed reality, he/she can control the drone with the virtual controls and drop the product at the destination in the shortest time possible.
Final Deliverable of the Project HW/SW integrated systemCore Industry ITOther IndustriesCore Technology Artificial Intelligence(AI)Other TechnologiesSustainable Development Goals Industry, Innovation and InfrastructureRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 80000 | |||
| Raspberry pi 4 model B | Equipment | 1 | 10000 | 10000 |
| Quadcopter complete kit with RC transmitter | Equipment | 1 | 30000 | 30000 |
| Drone power distribution board | Equipment | 1 | 1500 | 1500 |
| Electronic Speed controller | Equipment | 1 | 1500 | 1500 |
| Camera | Equipment | 1 | 20000 | 20000 |
| RC receiver | Equipment | 1 | 5000 | 5000 |
| Flight controller | Equipment | 1 | 2000 | 2000 |
| wires, connectors, battery, circuit holders etc - 4 each minimum | Miscellaneous | 4 | 2500 | 10000 |