SMARTPHONE BASED AUGMENTED REALITY

Nowadays, smartphones have the core features to develop an AR applications such as camera, touch screen, Inertia-Measurement Unit (IMU), internet access and so forth. The advancement of smartphone technologies which enable real-time image processing camera and powerful performance from built-in Cent

Project Title

SMARTPHONE BASED AUGMENTED REALITY

Project Area of Specialization

Augmented and Virtual Reality

Project Summary

Nowadays, smartphones have the core features to develop an AR applications such as camera, touch screen, Inertia-Measurement Unit (IMU), internet access and so forth. The advancement of smartphone technologies which enable real-time image processing camera and powerful performance from built-in Central Processing Unit (CPU) and Graphics Processing Unit (GPU) made basic AR application development easier without external supporting device. Furthermore, smartphone based AR application can be made interactive with user due to built-in 2sensors such as accelerometer, gyroscope, compass (magnetometer) and Global Positioning System GPS). Besides, more and more smartphone based application have been developed such as wikitude to explore the surroundings, augmented to visualise 3D model is augmented reality, ARBasketball to play basketball games and so forth. These show growing interest for AR technology and application in the market. In this project, the process to develop an interactive smartphone based AR application will be proposed. This project focused on the development of smartphone’s augmented reality application with integration of control system. The elements involved include applications development, communications and feature extraction. Two different applications will be developed separately comprising two smartphones where one built to perform a controller-like application and the other act as a passive smart device which act upon the signal delivered by the controller.

Project Objectives

The primary objectives of this project is to

1. Create an augmented reality application which it is able to interact between user and smart device.
2.  Other than that, the objective of this project also target to implement new device control system other than control method that existed in the market nowadays. 
3. Thirdly, this project also intent to make use of the AR technology and available sources to create a low cost augmented reality head mounted device.

Project Implementation Method

The application flow begin with the controller functioned smartphone positioned inside the Google Cardboard with the camera turn on. The user will have to observe through the lens to the smartphone screen. When the smartphone detected an ID marker of a specified smart device, it will display the virtual 3D object. Then the virtual object is interactive whereby when the user “touch” the virtual object using magnet trigger from the Google Cardboard, the smartphone will connect to the smart device and subsequently control the smart device current activity. At the same time, the smart device must able to differentiate the signal received and make corresponding action. The hardware that will be used in this project includes two android smartphones and a laptop. The laptop will be used to develop the AR application and modify the application code. Meanwhile, the software that needed in this project consist of Metaio SDK, Google Cardboard SDK and Android studio. Metaio SDK is needed to design the AR application, Google Cardboard is needed for magnet trigger function and Android studio is required to develop all the application needed in this project. Metaio SDK is chosen because it is free, it is easy to use for beginner in AR technology, contain powerful 3D rendering engine and most importantly it has some related source code for reference.

Benefits of the Project

At the end of this project development, an augmented reality head mounted display will be created using Google Cardboard and Metaio SDK as the fundamental program. Since Google Cardboard is low cost by nature and smartphone is considered a necessity to almost every household, this Google Cardboard based application has actually resolved one of the entry barrier to reach out the consumers in the market.

Technical Details of Final Deliverable

In this project, implementation of a smartphone based augmented reality with its ability to interact using Google Cardboard has been proposed. In addition, the proposed tracking method uses ID-encoded marker as a marker of a dedicated smart device. The Google Cardboard granted features to allow user to interact with the smart device remotely. This project focused on the development of smartphone’s augmented reality application with integration of control system.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Others

Core Technology

Augmented & Virtual Reality

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Good Health and Well-Being for People

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com