[ISEA2022] Paper: Yoon Chung Han — Machine Learning-based Approaches in Biometric Data Art

Abstract

Full Paper. Session: Humans and NonHumans / Nonhuman Creativity, and Agency

Keywords: Machine learning, biometric data, data art, data visualization

This project investigates the possible artistic approaches in using biometric data and attempts to find unbiased solutions for biometric data interpretations. The paper explores issues of bias on biometric data and anxieties about identifications through audiovisual interpretations of the biometric data artworks. As seen in previous historical approaches, many people have been concerned about the reading of race, character, and narratives into genetic traces. Recent history and current trends in biometrics show that biometric data relates to statistical prediction, and bias is an inevitable part of biometrics. The bias has been observed in my previous exhibitions from spectators who experienced their biometric-driven audiovisual outcome. The artist created an experimental version of the two biometric data artworks using machine learning (ML) methods of artificial intelligence (AI) to investigate the bias on biometrics. The AI-driven interface analyzes the input data, improves predictions, and extracts visual features based on sample data. Two biometric data (iris and finger-print) are used in the artworks, and an informal user study is dis-cussed. This project investigates the possible artistic approaches in using biometric data and attempts to find unbiased solutions for biometric data interpretations.

  • Yoon Chung Han is an interaction designer, multimedia artist, and researcher. Her researches include data visualization, biometric data visualization and sonification, a new interface for musical expression, and multimodal sensory user experience design. Her recent research focus was on multimodal interactions using body data, in particular on creating a personalized experience in media arts using biometric data visualization and sonification. Her works have been presented in many international exhibitions, conferences, and academic journals such as ACM SIGGRAPH, Japan media arts festival, ZKM, NIME, ISEA, IEEE VIS, ACM CHI, and Leonardo Art Journal. She holds a Ph.D. at the Media Arts and Technology, UC Santa Barbara (USA), and currently is an Assistant Professor in Graphic Design at the Department of Design in the San Jose State University. http://yoonchunghan.com/portfolio