[ISEA2016] Paper: Mei-Kei Lai — Flip the Book, Flip the Memories: a Case Study of Multimodal Interaction for the Library Located in Macao World Heritage Site

Abstract (short paper)

“Flip the Book – Flip the Memories” is a multimodal interactive artwork exhibited in Sir Robert Ho Tung Library, which is part of Macao World Heritage site. This artwork integrates smell with audio visual together into reading experience. When the reader turns the page of the physical book, it would trigger different videos projected on the book. Meanwhile, specific scents would be released from the side according to the videos. The video footages are collected from local video photographers, which have preciously captured the images of the old days in Macao. This artwork uses smell as an ambient medium to connect the present with the past. It aims to lead the readers to recall their memories from the past, also to think about the present while being surrounded by the environment of cultural heritage. By combining physical book with multimodal interaction, this artwork brings the cultural heritage visitors tangible and intangible experience altogether. This paper would take “Flip the Book – Flip the Memories” as the case study to discuss the opportunities and the challenges behind while bringing new media into cultural heritage, especially the role of olfaction in multimodal interaction.

  • Mei-Kei Lai, School of Arts, Macao Polytechnic Institute, MO

 Full text (PDF) p. 297-300