[ISEA2015] Paper: Bill Manaris, David Johnson & Mallory Rourk – Diving into Infinity: A Motion-Based, Immersive Interface for M.C. Escher’s Works

Abstract (Long paper)

Keywords: Interactive art, motion-based interaction, M.C. Escher, video animation, Kinect-based interface, art installation, humancomputer interaction. 

We describe a Kinect-based interface for navigating M.C. Escher’s works. Our interface is based on the Kuatro, a framework for developing motion-based interactive virtual environments. Kuatro utilizes the Model-View Controller (MVC) architecture and Open Sound Control (OSC) to provide an expandable environment for motion-sensor based installations for composers, artists, and interaction designers. We present a case study based on “Print Gallery”, an intriguing, self-similar work created by M.C. Escher in 1956. Our interaction design involves a Kinect sensor, a video projector, a Kuatro server, and a screen; it allows a user to zoom in and out, as well as rotate the image to reveal its self-similarity, by navigating prerecorded video material. This material is based on previous mathematical analyses of “Print Gallery” to reveal / explain the artist’s depiction of infinity. We discuss adapting this approach to other M.C. Escher works involving infinity

  • Bill Manaris is a computer science researcher, educator, and musician. He is Professor of Computer Science, and Director of the Computing in the Arts program, at the College of Charleston, USA. His interests include computer music, human-computer interaction and artificial intelligence. He explores interaction design and modeling of aesthetics and creativity using statistical, connectionist, and evolutionary techniques. He designs systems for computer aided analysis, composition, and performance in music and art. He studied computer science and music at the University of New Orleans, and holds an M.S. and Ph.D. degrees in Computer Science from the Center for Advanced Computer Studies, University of Louisiana, USA. Manaris is Associate Editor of the International Journal on Artificial Intelligence Tools, and has recently published a textbook in Computer Music and Creative Computing.
  • David Johnson is a graduate student at the University of Victoria, Canada, working on his Ph.D. in Computer Science. He is a member of the multidisciplinary MISTIC lab working with computer scientists, engineers, artists and musicians. He holds an M.S. in Computer Science from the College of Charleston, USA. His research interests include interactive spaces for sound and art, music interaction, music information retrieval, 3D sensor technologies, HCI and distributed systems.
  • Mallory Rourk is a graduate student at the College of Charleston, USA, currently earning her M.S. in Computer and Information Science. She holds a Bachelor’s degree in  Computing in the Arts and a minor in Mathematics. Her interests include interactive art (e.g., immersive installations and real-time, motion-based environments), human computer interaction, and the relationship between mathematics and art.

Full text (PDF) p. 692-699