[ISEA2023] Artists Talk: Jean-François Jégo, Julie Chateauvert & Georgios Tsampounaris — Remixing the Flying Words Project

Artists Statement

Theme: Immersion(s) Subtheme: Symbiotic Imaginaries

Keywords: Installation, digital art, deaf poetry, virtual reality, visual vernacular, synesthesia, performance-capture, motion-capture

Remixer le Flying Words Project is a digital art installation crossing the creative sign poetry of Peter Cook and Kenny Lerner with a Virtual Reality (VR) experience. We present here how we are designing the first version of the artwork investigating the idea of symbiosis. It appears to be the central pivot of this project mixing sign-art and digital art, video of the performers with visuals generated by performance-capture and point clouds in real time. Instead of adopting the idea of translating the poem in VR, we have created a passage from one art to the other as a fusion in order to create synesthesia.

The method adopted is a “bricolage” between several scientific tools based on DIY practice, biomechanics, movement quality analysis, and on human perception, body referential to create a synesthetic experience. Analyzing the ways we address the first version of the VR experience reveals how the arts practice were crossed, the technologies were merged and the different
backgrounds of the team members got synchronized.

  • Jean-François Jégo is an associate professor in the Image Arts & Technologies Department and the INREV research team at the University of Paris 8, France. As a digital artist and researcher, he creates and analyzes in regards of the concept of Ecosophy immersive and interactive experiences, artistic installations and digital performances hybridizing Virtual and Augmented Realities.
  • Julie Chateauvert, Artist-researcher, assistant professor at the Élisabeth-Bruyère School of Social Innovation, Saint Paul University, Canada. https://www.mouvementhabitats.com/juliechateauvert
  • Georgios Tsampounaris, Digital Artist https://tsabou.com/index.html