3D Realistic Character Animation using 3D Laser Scanning and Photogrammetry and Bio-Mechanical Motion Capture

This project aims to generate animations using 3D laser scanners and Bio-Mechanical motion capture. Using point cloud data, 3D laser scanners will be used to create a mesh of several kinds of objects. These body meshes will be refined to generate a 3D model. A body model can be generated by applying

Project Title

3D Realistic Character Animation using 3D Laser Scanning and Photogrammetry and Bio-Mechanical Motion Capture

Project Area of Specialization

Augmented and Virtual Reality

Project Summary

This project aims to generate animations using 3D laser scanners and Bio-Mechanical motion capture. Using point cloud data, 3D laser scanners will be used to create a mesh of several kinds of objects. These body meshes will be refined to generate a 3D model. A body model can be generated by applying CGI on body mesh and skeleton. Bio-Mechanical motion capture is used to record actions performed by the actor. Such actions can then be used to generate a skeleton performing that action. Once an action has been recorded then this action skeleton can be applied to the CGI body model. This will generate an animation of the body performing that action. Multiple actions can be recorded and applied to the CGI body model which can be combined to make clips ranging from small videos to full fledge animated movies. It can also be used in making cut scenes for games or recording some actions such as swinging a sword, throwing a projectile etc.

Project Objectives

· Mesh generation using 3D laser scanners available in LUMS CS Dept.

· Making a 3D model using generated point cloud mesh.

· Generating action skeletons using Bio-Mechanical motion capture available in Bio-Mechanical Lab in LUMS.

· Creating an animation by applying the action skeleton onto the 3D model generated by the mesh.

· Creating a short-animated video from all the recorded actions and models.

Project Implementation Method

For 3D modelling, laser scanning is one of best techniques used for creating 3D models of subjects. Similarly, motion capture is used for 3D subject behavior replication onto 2D. Both techniques involve geometrical transformation from space to plane and vice versa. At software level, it provides bridge to simulate real world in virtual world of computer.

Most character animation approaches assume the perspective of a rigid animated 3D model of a subject. This approach, however, possesses inherent limitations. A lot of manual animation must be performed using available commercial softwares. It hinders natural workflow of productivity and costs a lot of time. Some encouraging progress in the field has been seen if we look at the progress that has been made in character animation using modern techniques. In the past few years, combination of 3D modelling and motion capturing has been used. It leads to better production and utilize less time relatively. This technique revolutionized film and gaming industry. Films are now being made at advanced scale with realistic graphics, animations. Games are providing cutting edge character animations, cut scenes and in-game physics. This new era began with combination of computer vision and graphics.

High-end 3D laser scanners that can reconstruct the digital geometry of a physical model are used to generate subject mesh. 3D laser scanners scan the body of subjects and generate the point cloud mesh which can be further enhanced and refined into proper 3D models. Another process commonly known as structure from motion is a process that estimates the three-dimensional coordinates of surface points using pictures of a single physical object taken from different angles. Take a bunch of pictures of the object from all possible directions, then use these photos as an input for a specialized software. Knowing the camera positions and orientations, it creates a 3D point that corresponds to the 2D feature on the photo. Ideally, 3D mesh of a subject is generated as an output after post processing.Motion capture performs motion scan of subject in real-time. It replicates behavior of 3D subject on 2D plane which can then be used for commercial and production purposes. motion capture technology, which for years has been used to add all sorts of special animation effects to movies.Motion-capture process in films is performed by placing actors in front of blank blue or green backgrounds, don tight-fitting suits studded with infrared markers that cameras recognize.. Those markers help the cameras track and record the actor's movements as he moves in front of the backgrounds, which are called blue screens or green screens.The backgrounds are blank, so that the cameras record the actor's performance without any distracting extraneous objects that would clutter the recording or throw off the movement-tracking process.

Benefits of the Project

Using such technologies will help local movie industry in making animated movies using modern technologies and the gaming industries for generating multiple actions or making cut scenes.

Technical Details of Final Deliverable

A computer generated animation with photorealistic graphic models of human actors. Actions will be generated using motion caputre.

Final Deliverable of the Project

Software System

Type of Industry

Others

Technologies

Others

Sustainable Development Goals

Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com