[ISEA2016] Artists Talk: Jiayi Young & Shih-Wen Young — Multi-dimensional Sound Mapping of Migration Tracks of Pelagic Species

Artists Statement

Abstract
This installation experiments with a multi-dimensional soundscape to map out migration tracks of pelagic (open ocean) species of one predator and three preys in the environment of their corresponding sea surface temperature (SST) change over the course of a two-year period. These studies would ultimately be incorporated into creating an immersive installation where audience would rely on wearable devices to experience a visual and audible environment that reflected the diversity and abundance of life in the oceans.
Specially, the installation would also address the pressing concern of over-fishing, and the evolution of these oceanic lives over time and across geographic locations. Our eventual goal for the project is to provide the audience with the feeling of being submerged under water and being able to detect and interact within a simulated oceanic environment.

Overview
This data sonification installation utilizes data extracted from the live Tagging of Pacific Predators (TOPP) project. TOPP is a project began in 2000 as one of 17 projects of the Census of Marine Life, a 10-year, 80-nation endeavor to assess and explain the diversity and abundance of life in the oceans, and where that life has lived, is living, and will live. Tagged animals send back data via satellites such as Argos, a polar-orbiting satellite. [1] Intermingled in the soundscape are mapped migration activities of pelagic (open-ocean) species of one Salmon Shark and three Northern Elephant Seals over the course of a two-year period (Jan 2011- Jan 2013), along with corresponding Sea Surface Temperature (SST) change of the shark’s tagged positions. [2][3][4] Sitting in the middle of the room, the blindfolded audience becomes the shark with a heightened sense of hearing detecting its prey’s spatial and directional location. (Fig 1.) These activities are submerged in the mapped sound of Sea Surface Temperature change surrounding the shark covering an area of 121,000 km2 along the track. The first two phases of the project experimented with various fitting methods using Mathematica to find the best-fit functions for migration tracks and SST data, which were then used to generate multi- imensional sound channels.

Data Mapping Method
-Two-dimensional tags are fitted into smooth curves to form migration tracks (seal relative to shark). Tracks are then mapped into the waveforms with subjective frequency assigned (within human audible spectrum).
-SST data is fitted into smooth curves, and then mapped into wave forms with subjective frequency assigned (within human audible spectrum).
-Mapped animal track sounds are outputted from speakers on the floor.
-Mapped SST sounds are outputted from speakers above participants.

References

  1. Tagging of Pacific Predators (TOPP). 2016. gtopp.org
  2. Barbara A. Block, Validation of geolocation estimates based on light level and sea surface temperature from electronic tags, (Marine Ecology Progress Series, 2004), Vol. 283: 81-98.
  3. National Oceanic and Atmospheric Administration (NOAA) ERDDAP. 2012.
  4. National Oceanic and Atmospheric Administration (NOAA) ERDDAP. 2012.
  • Jiayi Young, Design Department, University of California, USA
  • Shih-Wen Young, Ph.D., Astronomy/Physics Department, American River College, Sacramento, USA

We thank Dr. Barbara Block and Dr. Randy Kochevar of Marine Sciences, Stanford University, California, USA, for providing access to and assistance in understanding the data.

Text with images [PDF]