[ISEA2019] Paper: Yan Breuleux & Rémi Lapierre — The “Piano-of-Lights”: a visual-music instrument for FullDome display

Abstract

Keywords: Sound and Music Computing, Live performance, Colour Organ, Virtual Colour Organ (VCO), Visual Music, FullDome, Environmental Storytelling, Immersive Media, Virtual Reality.

Les Planètes is a “FullDome” immersive concert generated entirely in real time. The concert is made possible by the “Pianoof-Lights,” an instrument that enables a visual dialogue with pianist Louise Bessette during a novel performance of the work Les Planètes from composer Walter Boudreau. The Piano-ofLights’ dynamic constellations of small spheres are projected across the space of the satosphere of the Society of Art and Technology (SAT) in Montreal. The visual shapes are based on an analysis of the different sections of the score. During this process, the Piano-of-Lights emits light particles, becoming a catalyst for the dynamic constellations distributed across the dome. The project blends the tradition of colour organs and the live A/V approach of digital technology, bringing together an analogue piano, digital recording and immersive projection. The originality of this research primarily lies in the use of a colour-piano, which was designed to create a synthesis of the colour-sound association in an immersive format.

  • Yan Breuleux is a professor at NAD-UQAC (École des arts numériques, de l’animation et du design à Montréal), Canada. He is also a researcher and practitioner in the field of visual music for immersive display. For 20 years, he has collaborated with musicians and composers to create multi-screen, panoramic, architectural projection and FullDome pieces. Since 1998, he has created powerful sensorial A/V performances as part of the PURFORM duo with the composer Alain Thibault.
  • Rémi Lapierre has a solid background in programming, graphic novelling, 3D modelling and video games. His multidisciplinary skill set gives him an in-depth understanding of advanced technical issues in software design as well as the expressive dynamics of digital creation. Rémi is currently devoting his efforts to automated virtual environment generation. He is a master’s degree student at the NAD (École des arts numériques, de l’animation et du design).

Full text (PDF) p. 461-464