Echoes of WHALE FALL
Machine learnning and emotional analysis
audio-visual system
Echoes of Whale Fall
Echoes of Whale Fall is an emotion-driven audiovisual system that uses machine learning to analyze emotional signals, transforming deep-sea sounds and imagery into a generative narrative of loss, memory, and rebirth.
Team
Lilith Ren
Location
Harvard GSD
Dates
25 Spring
Machine Learning
Problem
Shared memories are rarely symmetrical. Even when two people agree on facts, they often carry divergent emotional tempos. Most memory-sharing technologies assume negotiation must occur through narrative, where experiences are explained and aligned through words.
Problem
Narrative Framework to Emotion Driven Visualization System to Generative Audio-Visual Environment
Machine Learning Process
We explore liquid as a shared interface for memory by manipulating the water surface through datalized bio-signals. This transforms the water surface into a responsive canvas and explores the technical and experiential potential of water as a visual medium.
Storyboard of Whale Fall
The patterns contrast two individual participants’ emotional states. The left pattern shows an irregular breathing rate, with varied droplet sizes and tightly grouped scatter spacing across the liquid surface, reflecting a negative emotional state. The right pattern has a more uniform spatial distribution and consistent droplet size, reflecting a calmer, more positive emotional state.
Emotional Analysis and Sound Pipeline
We explore liquid as a shared interface for memory by manipulating the water surface through datalized bio-signals. This transforms the water surface into a responsive canvas and explores the technical and experiential potential of water as a visual medium.
The patterns contrast two individual participants’ emotional states. The left pattern shows an irregular breathing rate, with varied droplet sizes and tightly grouped scatter spacing across the liquid surface, reflecting a negative emotional state. The right pattern has a more uniform spatial distribution and consistent droplet size, reflecting a calmer, more positive emotional state.
The patterns contrast two individual participants’ emotional states. The left pattern shows an irregular breathing rate, with varied droplet sizes and tightly grouped scatter spacing across the liquid surface, reflecting a negative emotional state. The right pattern has a more uniform spatial distribution and consistent droplet size, reflecting a calmer, more positive emotional state.