Digital Heritage

Populating virtual worlds to bring alive digital hertiage brings together numerous challenges from animation, rendering, virtual/augmented reality and 3D content creation.

India Digital Heritage (IDH) Project

Digital heritage applications use virtual characters extensively to populate reconstructions of heritage sites in virtual and augmented reality. Creating these believable characters requires a lot of effort. The characters have to be modelled, textured, rigged and animated. In this chapter, we present a framework that captures a point cloud of a real user using multiple depth cameras, and subsequently deforms a template mesh to match the captured geometry. The topology of the template mesh is preserved during the deformation process. We compare the measurements of limb lengths and body part ratios with actual corresponding anthropological measurements from the real user, in order to validate our system. Furthermore, we use a single depth camera to capture motion of a real performer that we can then use to animate the mesh. This semi-automatic process only requires commodity depth cameras (Microsoft Kinect cameras) and no other specialized hardware. We also present extensions to available open-source animation authoring environment in Blender that allow us to synthesize character animation from pre-recorded motion data. We then briefly discuss the challenges involved in enhancing the appearance of the characters by physically-based animation of virtual garments.

Mini Hampi

The overall objective was to place animated characters in augmented reality to depict social life in Hampi from an earlier era in time. We have developed two applications – one for authoring the AR content and one for viewing it. The authoring app allows the user to select which animated asset to place and then select a location among the tracked points that allows the placement of content at that location. We have further added the functionality of scaling this content to life size characters, so that the augmentations look realistic. Multiple such augmentations can be done for any given scene.