Panel: Visual Effects Remixed
In this paper the author will describe and show examples of his live audio-visual work for 3D spatial environments. These projects use motion tracking technology to enable users to interact with sound, light and video using their body movements in 3D space. Specific video examples of one past project (Virtual DJ) and one current project (Virtual VJ) will be shown to illustrate how subjective and flexible user interaction is enabled through a complex but predictable mapping of 3D space to media control. In these projects audience members can interact with sound, light and video in real-time by simply moving around in space with a tracker in hand. Changes in sound, light and real-time visual effects can be synchronized with changes in sound and or light (i.e. music volume = light brightness = video opacity). These changes can be dynamically mapped in real-time to allow the user to consolidate the roles of DJ, VJ and light designer in one interface. This interaction model simulates the effect of synaesthesia, in which certain people experience light or colour in response to musical tones.
- Dr. Steve Gibson is a Canadian media artist, interface designer and media curator. He completed his Ph.D. at SUNY Buffalo, where he studied music composition and electronic music. He was also a postdoctoral researcher in media and technology at Concordia University in Montréal. He currently serves as Senior Lecturer in Interactive Media Design at Northumbria University. He was curator for the Media Art event Interactive Futures from 2002-07 and currently serves as co-Director of Digital Art Weeks (ETH Zurich). He currently holds a Visiting Professorship at Xi’an Academy of Fine Arts, China and is Artistic Director of Limbic Media Corporation, a company specialising in physical computing applications. Influenced by a diverse body of art and popular movements his work fuses electronica, immersive art, game art, montage and post-minimalism. He works in a range of media, from live electronic music to immersive and physical installation. His works have been presented in such venues as: Ars Electronica; the Whitney Museum of American Art; Banff Centre for the Arts; Digital Art Weeks; the European Media Arts Festival; ISEA; Interface3, Hamburg; the San Francisco Art Institute; 4 & 6CyberConf. He recently co-edited a volume entitled Transdisciplinary Digital Art which was published by Springer (Germany) in Spring 2008. telebody.ws grandtheftbicycle.com Video: “Wacoff” Tablet Demo
Full text (PDF) p. 955-958 [Longer title]