[ISEA2011] Paper: Ioannis Zannos – Migration and Morphing of Sounds in an Interactive Installation

Abstract

This paper describes the techniques used in the realization of a Performance and Installation which explores the gradual “osmosis” between three different sound worlds: The song of swallows recorded at summer above the town of Corfu the song of Weddel Seals recorded in Antarctica (from the macaulay library of marine biology), and the emissions of short wave “Numbers Stations” recorded by amateurs all over the world (from recordings pubished by irdial). The sound recordings are segmented tools available in the SuperCollider sound processing environment and then the individual parts are analysed by several feature extraction algorithms based on fft data extracted by tools such as SPEAR and LORIS. Boid swarming algorithms are used to model the movement of samples in a parametric space, which is then mapped into simulated sound space with multichannel audio. The sounds are transformed in real time by exchanging spectral characteristics through FFT-based processing methods, taking into account the previously extracted spectral characteristics. Several examples are given of the various ways in which the sounds are transformed. The work also includes graphics synthesized in real time based on physical models of particles and fluid modeling. Different ways in which the sound transformation technique are combined with the graphics and how they are contrlled in live performance as well as in an interactive installation are described. These techniques include various multi-touch surfaces ranging from iPhone or iPad to reactable-based technologies to open-handed gesture recognition from video input.   irdial.com/conet.htm   klingbeil.com/spear    hakenaudio.com/Loris

  • Ioannis Zannoshas a background in music composition, ethnomusicology and interactive performance. He has worked as Director of the Music Technology and Documentation section at the State Institute for Music Research (S.I.M.) in Berlin, Germany, and Research Director at the Center for Research for Electronic Art Technology (CREATE) at the University of California, Santa Barbara, USA. He has taken part at numerous international collaborative Media Arts projects and has realized multimedia performances both alone and in cooperation with other artists. He is teaching audio and interactive media arts at the Department of Audiovisual Arts and at the postgraduate course in Arts and Technologies of Sound of the Music Department at the Ionian University, Corfu. Publications include: “Ichos und Makam” (Comparative Studies on the Modal systems of Greek and Turkish Music, 1994), “Music and Signs” (edited proceedings of the 1997 conference on Music Semiotics and Systematic Musicology), an a number of articles on Music Technology and Media Arts. Participation in artistice collaborations include (2000), with Martin Carlé programming of interactive sound for Eric Sleichim / Bl!ndman Quartet, and Ulrike and David Gabriel, 2005-2006: Cosmos-X – Multimedia installation with multiple audio and video projections based on the work of Iannis Xenakis, with Efi Xirou, and 2004-2005, with Jean-Pierre Hébert real-time sound programming for the installation series on “Sand”. Currently Iannis Zannos is focussing on how environmental issues as well as problems of multiculturality are reflected in media-art terms. earlab.org   /avarts.ionio.gr