[ISEA2014] Paper: Raakhi Kapur & Ajay Kapur – SAMSARA: A DIGITAL MEDIUM FOR THEATRICAL STORYTELING USING ANIMATION, ROBOTICS AND IMMERSIVE TECHNOLOGY

Abstract

This paper describes the use of contemporary technology to create a novel digital medium for theatrical storytelling. This involved integrating a team of creative technologists, animators, dancers, actors, storytellers, and production designers to create an immersive environment for electronic performance art. Samsara means reincarnation. Hindu and Buddhist philosophy embraces the concept of reincarnation as a way to learn, grow, and evolve. Samsara pulls inspiration from ancient morality fables found in the Panchatantra and the Jataka Tales. Five stories of reincarnation are portrayed: from an   elephant, to a monkey, to a bee, to a quail and finally to a lion. Each story was realized using a different set of robotic devices, animation, or wireless dance technology to create an immersive experience for the audience. For example, the mice in the stories are represented by ‘chattering’ of twenty dispersed mechanical ‘clappers’ in the audience seats, where as, the bee in the story is represented by 12 robotic spinning bees installed above the audience, moving from one location to the next. Where as 9 projection‑mapped screens portrayed animated characters that performed along a troop of 6 choreographed dancers. This new medium of custom technology, brought together a novel way to perform these stories in an unconventional manner. This paper discusses what was learned, and how to scale these technologies for digital performance venues in the future.

  • Raakhi Kapur, California Institute of the Arts, USA
  • Ajay Kapur is currently the Director of the Music Technology program (MTIID) at the California Institute of the Arts, as well as the Associate Dean for Research and Development in Digital Arts. He received an Interdisciplinary Ph.D. in 2007 from University of Victoria combining computer science, electrical engineering, mechanical engineering, music and psychology with a focus on intelligent music systems and media technology. Ajay graduated with a Bachelor of Science in Engineering and Computer Science from Princeton University in 2002. He has published over 80 technical papers and presented lectures across the world on music technology, human computer interface for artists, robotics for making sound and modern digital orchestras. His book ‘Digitizing North Indian Music,’ discusses how sensors, machine learning and robotics are used to extend and preserve traditional techniques of Indian Classical music.