[ISEA2024] Paper: Hui-Ting Hong, Isadora Teles de Castro e Costa & Arnaud Tanguy — A Cross-Temporal Robotic Dance Performance: Dancing with a Humanoid Robot and Artificial Life

Abstract

Keywords:
Human-Machine Co-Creation, Robotic Dance, Autonomy, Artificial Life, Interactive Art, Performance, Transdisciplinary Art

We present a case study exploring the integration of artificial, autonomous, and interactive artifacts into the realm of choreography. Specifically, we assessed our experimentation on the HRP-4 humanoid robot and an evolving virtual ecosystem, utilized as characters and dynamic scenography in a dance performance. Our research sheds light on the mechanisms enabling dynamic interplay between human beings and artificial entities, with a specific emphasis on the significance of crosstemporal dialogues. Additionally, we demonstrate the potential of autonomous interactive systems in fostering improvisational co-creation in the process of stage development.

  • Hui-Ting Hong is a Taiwanese artist based in Paris. She obtained her bachelor’s degree in EECS and her master’s degree in Electrical Engineering, both from National Tsing Hua University. Currently, Hui-Ting is a Ph.D. candidate at Paris 8 University in the INREV research team, focusing on the interaction and transformation between body, space and mind. She has participated in the Cr´eons au Mus´ee project and performed virtually at the Grand Palais and the Co-´evolution, Co-cr´eation et improvisation Homme-Machine (CECCI-H2M) research project under the framework of EUR ArTec and performed at the season opening of Centre des Arts Enghien-les-Bains; she also has cooperated projects and solo projects that were presented at the Huashan Umay Theater, the Taipei Fringe Festival, the Hsinchu 241 Art Space and the Arts Center Tsing Hua. Her aim is to explore the improvisation and co-creation process with autonomous system by developing both dancing gestures and Artificial Intelligence integrated tools. Her artistic research practice focuses on the perception-action of body movements, discussing in particular the shared rhythm happened in human-machine interaction.
  • Isadora Teles is a Brazilian artist based in Paris. She is currently a Ph.D. candidate at the INREV research team, within the laboratory Art des Images et Art Contemporain at the University of Paris 8. Her artistic practice is in the fields of digital generative art, artistic modeling of self-organizing systems, and the design of interactive interfaces for live performances. She participated in practice-based research projects presented at the Grand Palais (Projet “Cr´eons au Mus´ee”), the Bains Num´eriques festival (“La Fabrique Numerique“), and the Ars Electronica festival (with the Interface Cultures Master students, exhibition “Made in Linz“). She also took part in the design of interactive installations and scenographies for events at the Gaˆıt´e Lyrique (“ClekclekBoom label anniversary“), the Nuit Blanche in Paris (with Romain Cieutat, at La Rotonde), the K-Live Festival, and the Peacock Society festival (both with Superbien studio). As part of her practice-based research, she is currently experimenting with the design of sensitive, actuating, and connected electronic costumes as well as the computer development of interactive evolving visuals for improvisational theatrical scenography. Other than digital arts, Isadora also experiments with video, 2D traditional animation, illustration, electronics, and, most recently, web data visualization.
  • Arnaud Tanguy has studied computer engineering at the Polytech’Nice-Sophia engineering school, specializing in computer vision. During his studies, he spent an ERASMUS year at Trinity College Dublin, where he specialized in technologies linked to video game development (physical simulation, graphics rendering), followed by a research internship at Technische Univesit¨at M¨unchen, where he worked on a neural network artificial intelligence system for location recognition in a 3D map (e.g. where’s the robot?). He then went on to write a thesis combining real-time mapping and localization (SLAM) technologies with the control of humanoid robots, in order to give them greater autonomy in their interaction with their environment. He then pursued his career as a research engineer in the Joint Robotics Laboratory at the Advanced Institute of Science and Technology (AIST, Tsukuba, Japan) and in the Interactive Digital Human (IDH) team at the Laboratoire d’Informatique et de Micro´electronique de l’Universit´e de Montpellier (LIRMM), where he currently works.
  • Abderrahmane Kheddar received the BS in Computer Science degree from the Institut National d’Informatique (ESI), Algiers, the MSc and Ph.D. degree in robotics, both from Pierre et Marie Curie University, Sorbonne University, Paris. He is presently First Class Directeur de Recherche at CNRS. His research interests include haptics, humanoids and recently Bionics. He is a founding member of the IEEE/RAS chapter on haptics, the co-chair and founding member of the IEEE/RAS Technical committee on model-based optimization, he is a member of the steering committee of the IEEE Brain Initiative, Editor of the IEEE Robotics and Automation Letters, Founding member and Deputy Editor-in-Chief of Cyborg and Bionics System. He was Editor of the IEEE Transactions on Robotics (2013-2018) and within the editorial board of other robotics journals; he is a founding member of the IEEE Transactions on Haptics and served in its editorial board during three years (2007-2010). He is an IEEE fellow, AAIA fellow, titular full member of the National Academy of Technology of France and knight of the national order of merits of France.
  • Chu-Yin Chen is an Artist and Professor in Digital Art, INREV research team at Paris 8 University. Her creations, based on Artificial Life and complex systems, develop interaction modes between audience and virtual creatures showing autonomous and evolving behaviors. Her digital artworks have been shown in numerous international exhibitions. Her research articulates two overlapping areas: 1) Digital Creation using algorithms of complexity and emergence, and 2) Metacognition and Elicitation of the processes of creation, enaction and aesthetic reception, via psychophenomenology and mindfulness.