AR Based Intelligent Medicine Specification System

Many decades? pharmaceutical drugs (medicines) are facilitating many patients in the cure of their diseases. In literature, these drugs are classified as prescription drugs, over the counter drugs, and vaccines based drugs, etc. Patients, especially from developed countries, use over counter drugs c

Project Title

AR Based Intelligent Medicine Specification System

Project Area of Specialization

Artificial Intelligence

Project Summary

Many decades’ pharmaceutical drugs (medicines) are facilitating many patients in the cure of their diseases. In literature, these drugs are classified as prescription drugs, over the counter drugs, and vaccines based drugs, etc. Patients, especially from developed countries, use over counter drugs category frequently without knowing the after-effects and alternatives of the drugs. The Coronavirus pandemic rises this problem and patients use their own medication for the cure of the diseases. From literature review it has been found that existing medical systems are insufficient to provide the drug specifications. Moreover, in Pakistan medical systems are found on point-of-sale (POS) terminals which are desktop or web based applications and cannot be accessible by the general public. Currently, very limited mobile based app have been found which provides mobile based medicine specification facility in Pakistan. Existing systems only list the names of the pharmaceutical medicines. They only have limited data and do not suggest any similar drug.   In these systems user manually compare and extract drug information. To overcome, above mention gaps we proposed a system which is “AR based Intelligent Medicine Specification System”. The proposed project will capture the medicine image and provide an augmented reality (AR) based environment where patients can see the drug specification, side effects, etc. the proposed project will also provide the facility where patients can check the alternative of the same formula drugs and compare their cost. . For the successful completion of the proposed project machine learning (ML) based techniques will be used for android platform. This project will not only facilitate the patients by providing the details of the medicine but also help the doctors to get knowledge about similar drugs of the prescribed formula.

Project Objectives

The objectives of the proposed project are:

• A literature review has been done in this project which helps to identify the suitable tools, techniques, and methodologies essential for the project.
• Image Management is developed to capture, identify, and recognize the leaflet and prescription by using deep learning (DL)  and AI based techniques.
• Medicine Knowledge Management is developed to extract data from different web pages and pharmaceutical companies database. It will also apply classification models and will compare alternate drugs specifications
• AR Mobile Application is developed to provide drugs specification in an augmented reality-based environment. It’s a touchable interface where users can select different options (e.g., specification, cost, side effects, precautions, etc.) about the medicine.
• More than 1000 data sets will be taken from the virtual world out of the 70% will be used for training and the remaining 30% will be used for testing.
• The effectiveness of the final experimental results will be tested and verified by the AR based mobile application connected with the cloud database.

Project Implementation Method

In this project, AR based Intelligent Medicine Specification System is quick and efficient way for finding the medicine specifications and cost.  Initially, the system will offer an AR Mobile Application module that provides interfacing for users through which they can capture, compare and check the specific medicines or prescriptions details easily and effectively in an AR environment. Image Management uses camera to capture, identify, and recognize the drug name by using Deep Learning (DL) i.e. (CNN) and AI based techniques. Medicine Knowledge Management extracts data from different pharmaceutical companies’ database by using dynamic programming based proposed data extraction algorithm. The proposed data categorization algorithm categorized the refine drugs data according to their formula and save it into the medicine data repository. Finally, experimental results are verified using a web-based AR mobile application that is connected with a database. Figure 1 presented the block diagram of the proposed project.

Figure 1: Block diagram of the proposed project

Benefits of the Project

The basic benefits provided by the proposed project are:

• The literature review of the previous studies that have been done in this project will help the researchers to enhance this work in multidiscipline.
• The proposed solution will be helpful for the Drug Regularity Authorities to maintain and monitor the quality and cost of same formula drugs.
• The proposed project will facilitate people by finding the correct medicine in low cost without physically interacting with the market.
• It uses minimum resources (cost, time, human effort) utilization and provides maximum benefits by enhancing user drugs specification learning skills.
• The datasets generated by the proposed software using machine learning techniques will be used for further researchers.

Technical Details of Final Deliverable

In the end, we will deliver the code and the documentation in the form of a final project report containing all the proposed algorithms pseudo and implementation code.

Final Deliverable of the Project

Software System

Core Industry

IT

Other Industries

Medical

Core Technology

Augmented & Virtual Reality

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Good Health and Well-Being for People, Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com