The Sound Studies Group is an international academic team dedicated to sound studies
across disciplines, regions, and institutions. From theory to practice, it explores all things related to sound. It also operates a Sound Lab in the School of Design, SUSTech Shenzhen.
I Light U Up
Exploring a New Emergent Narrative Paradigm through Physical Data Participation in AI Generative Experiences
Project by:
Zhen Wu, PhD candidate at The Hong Kong University of Science and Technology
Collaborators:
Ruoyu Wen, Marcel Zaes Sagesser, Sum Yi Ma, Jiashuo Xian, Wenda Wu, Tristan Braud
2024-2026
#Emergent narrative
#LLM
"I Light U Up" is an interactive installation that explores the use of light as input for emergent narrative powered by a large language model (LLM). Through an installation with light sensors, the audience uses light to communicate with the parallel digital beings, generating a narrative experience that emerges from the interaction. This work serves as a proof-of-concept, supporting a conceptual framework that aims to foster new perspectives on the participation of physical data in emergent narrative experiences. It seeks to develop a new dimension in contrast to the text-centric one-way relationship between reader and story by including agency beyond human interactivity.
Developed in collaboration with the Sound Study Group, which contributed the sonic design of the imaginative language of the flowers, which is based on light frequency and intensity for representing the emotional expression. It interprets the LLM generated sentence and translates it into sounds that form a non-semantic language.
Publication
I Light U Up: Exploring a New Emergent Narrative Paradigm through Physical Data Participation in AI Generative Experiences
Wu, Z., Wen, R., Sagesser, M. Z., Ma, S. Y., Xian, J., Wu, W., & Braud, T. (2024).
SIGGRAPH Asia 2024 Art Papers, 1–9.
Conference publication, 2024
doi
Contact
Sound Studies Group
● 声音研究科研组
All content © 2023-2026 Sound Studies Group