Abstract

Keywords: artificial intelligence, machine learning, AI creativity, visualization, sound visualization

Artificial intelligence (AI) has become a much more familiar topic to the public as a result of the several attempts at making a computer and a human compete in a specifically mental sport competition such as Go or chess. Moreover, since recently, issues pertaining to AI have become as important to artifact creation as issues relating to the concept or styles of paint are to painting. It is not that AI and art necessarily share goals, but much of the knowledge about AI and its methods can contribute to human creativity, especially art making. This paper reviews several recent works that examined these issues in the context of creativity and visual aesthetics. Throughout the literature review and case analysis, this paper investigates AI creativity from several examples and practically applies AI creativity to the visualization of music. This research work investigated the concept with the creation described below. The application visualizes the similarities and relationships of many audio chunks from a single audio track. From this visualization, it is possible to see how many audio events happened in one audio file. In addition, the chunks are heard as time series. Every audio file has different sonic events and feature distinctions. Each music file can have its own form and figure in this visualization. Ultimately, this research work brought together a collection of research results and practice experiences that together helped illuminate this significant new and expanding area. In particular, it is suggested that this paper points towards a much-needed critical language that can be used to describe, compare, and discuss AI in the context of creativity.

• Sey Min is a data visualization artist and designer, who is interested in dealing with live data sets in various media formats. She makes projects that reimagine how humans relate to technologies, to societies and cities, and to environments. Combining elements of environmental studies, visual art, programming, and data storytelling, her projects range from building a real-time interactive information graphics system for a music club (Gender Ratio, 2007) to visualizing Seoul City expenditure data (City DATA: Seoul Daily Expenditure, 2014).Her work has been shown at NIPS 2018, National Museum of Modern and Contemporary Art, Korea; TED 2011; TEDGlobal 2012; Art Center Nabi in Seoul, and Lift Conference, and featured on CNN Asia, Lift09 etc. After serving as an urban information design researcher at MIT SENSEable City Lab, She was selected as a 2011 TED Fellow and Senior Fellow from 2012 to 2013. Her work is also available at ttoky.com.
• Jihye Lee is an interactive media experience designer and researcher. Currently she is working as a post-doctoral researcher in AI based AR/VR with UX design perspective, at the Mobile Cloud Computing Group in Aalto University, Finland. After completing PhD in Film and Digital Media Design in Hong Ik university in Seoul, she has published several journals in a field of convergence between AR/VR, design and UX design research including: Investigating Sociocultural Specificity of Mobile Augmented Reality (2017), Context-based Design Methodology For Augmented Reality Contents (2017), Augmented Reality and Art (2018), Multimodal based Storytelling Experience Using Virtual Reality in Museum (2018) and An Analysis and Directional Suggestion for Digital Cultural Heritage Education (2018). She has participated in several projects for smart city, and digital museum in Korea(2015-2017) and now design projects using AI based AR&VR in Finland (2018-).

Full text (PDF) p. 233-239