[ISEA2024] Paper: Xindi Kang, Xuanyang Huang, Mingdong Song, Varvara Guljajeva & JoAnn Kuchera-Morin — Interdisciplinary Translations: Sensory Perception as a Universal Language

Abstract

Keywords:
Media Art, Interdisciplinary Communication, Interaction, Translation, Sensory Perception, HCI, Artificial Intelligence

This paper investigates sensory perception’s pivotal role as a universal communicative bridge across varied cultures and disciplines, and how it manifests its value in the study of media art, human computer interaction and artificial intelligence. By analyzing its function in non-verbal communication through interactive systems, and drawing on the interpretive model in translation studies where “sense” acts as a mediation between two languages, this paper illustrates how interdisciplinary communication in media art and human-computer interaction is afforded by the abstract language of human sensory perception. Specific examples from traditional art, interactive media art, HCI, communication, and translation studies demonstrate how sensory feedback translates and conveys meaning across diverse modalities of expression and how it fosters connections between humans, art, and technology. Pertaining to this topic, this paper analyzes the impact of sensory feedback systems in designing interactive experiences, and reveals the guiding role of sensory perception in the design philosophy of AI systems. Overall, the study aims to broaden the understanding of sensory perception’s role in communication, highlighting its significance in the evolution of interactive experiences and its capacity to unify art, science, and the human experience.

  • Xindi Kang, AlloSphere Research Group, Media Arts and Technology, University of California Santa Barbara, United States
  • Xuanyang Huang, Computational Media and Arts, Hong Kong University of Science and Technology, Guangzhou, China
  • Mingdong Song, Royal College of Art, London, United Kingdom
  • Varvara Guljajeva, Computational Media and Arts, Hong Kong University of Science and Technology, Guangzhou, China
  • JoAnn Kuchera-Morin, AlloSphere Research Group, Media Arts and Technology, University of California Santa Barbara, United States