[ISEA2015] Paper: Eric Heep & Ajay Kapur – Extracting Visual Information to Generate Sonic Art Installation and Performance

Abstract (Short paper)

Keywords: Music Information Retrieval, Sonification, Audification, Inverse Discrete Fourier Transformation, Procedural Composition, Parametric Articulation.

A procedure for generating sound using visual information is outlined that allows for a data artist to interpret a visual work of art using the parameters of an Inverse Discrete Fourier Transform. This paper discusses the historical progression of musicians responding to visual artists, as well as the relevance of parametric articulation and how it relates to the science of audio analysis. A process is outlined that discusses how such techniques can be used to generate sonic art installation and performance.

  • Eric Heep & Ajay Kapur, California Institute of the Arts, Music Technology: Interaction, Intelligence, and Design, California, US

Full text (PDF)  p. 633-636