[ISEA2022] Paper: Maxime Gordon — The sonic body: creating embodied sonic performances within an extended reality context

Abstract

Short paper, theme: Humans and NonHumans: Aesthetic experience and speculation
Venue: CCCB, date: June 14

Keywords: Augmented reality, sound art, muscle sensors, interactive music performance

“The Sonic Body” is a research-creation project that offers insight into how AR and muscle sensing technology might be used to create a real-time, embodied sound art installation and performance.

This paper presents “The Sonic Body”, a research-creation project conducted between May-September 2021 that studied methods of creating embodied sonic performances and installations within an extended reality (XR) context. I explain two prototypes created for the project, outline the strategies I used and rationale behind the design choices, and summarize the results of my research. The prototypes explore contrasting methods of engaging with sound in an embodied way: one employing the use of head-mounted augmented reality (AR) and the other muscle sensors and material interaction. As my methodology relied on a self-reflexive approach, I focus on my personal experience as an artist designing these prototypes. Two research questions guided this project and inform this paper: How can new types of interactive audio affected and enhanced by bodily movement and gesture affect the experience of listening and connection to the environment? How can such interactive listening systems be designed to better encourage this sense of connectedness? Ultimately, this paper showcases “The Sonic Body” project, conveys the findings of the research questions from the research results and offers insight into how AR and muscle sensing technology might be used to create a real-time, embodied sound art installation and performance.

  • Maxime Gordon is a Canadian sound and new media artist. In her work Gordon is interested in exploring the boundaries of sound, architectural space and the human body. Through sound art, performance, and installations or a combination of these media she creates immersive art works that offer a looking glass into various intersections of humanity and technology. Gordon’s work has been shown at Monom in Berlin (Germany), the Spatial Sound Institute in Budapest (Hungary), and the OutsideInsideOut residency in Stadt Wehlen (Germany). https://twitter.com/realbenedicte