Embodied Future
Embodied Future
Multisensory Storytelling and the Imagination about the Future of Individual Presence
Embodied Future proposes a series of participatory multisensory installations that explore the future condition of individual existence. Instead of presenting one continuous narrative, the work will be structured through a group of small stories, each drawn from a specific memory, align with multisensory participatory interactions. These stories begin from intimate fragments: a father’s letter hidden beneath layers of black ink, a childhood memory of Jiangxinzhou that returns through wind and reeds and a feeling of flavor and qi that cannot be fully translated into language. Each story will then be transformed into a live or participatory multisensory design.
The larger question behind the project is how might individuals understand their existence in a future where memory, identity and bodily experience are increasingly intertwined? Today, much of digital interaction is still organized around screens and finger-based gestures. We tap, scroll, type, and look. These actions are efficient, but they often separate information from physical place and reduce the body to a device-operating tool. I am interested in a different possibility. As XR, spatial computing continue to develop, interaction may no longer be limited to the hand and the screen. The whole body may become involved in how people receive and generate meaning. It also begins from my long-term interest in a form of connection that is gentle but not weak. I am drawn to works that do not need to appear violent, cold to be taken seriously. I want to create experiences that are quiet and intimate, but still carry emotional force. For me, this is a form of larger love. It is not sentimental love, and it is not limited to personal affection. It is a way of asking how people remain connected to what has shaped them, even when those connections become difficult to describe. I am interested in tenderness as a structure.This is why I choose small personal stories as the foundation of the project. These stories are not included only because they are private memories. Each one allows me to examine a relationship that is fragile but still active. My father’s letter carries a kind of care that was never fully spoken aloud. The memory of Jiangxinzhou carries my changing relationship with a place that has disappeared and returned to my life in another form. Flavor and qi allow me to think about cultural memory as something the body understands before language does. A voice left in space suggests a future form of connection, where one person can leave a trace for another person who arrives later. These stories are different, but they share one question: how can care continue to exist when its original form is no longer directly accessible? I believe future interaction will involve more of the body and more of the surrounding space. I want to approach this future as an artistic and ethical one. If future media can extend perception, then it should also help people become more attentive to others, to place, and to memories that cannot be clearly archived.
In this way my project uses art to speculate on this shift. It asks how future interaction can become more embodied and more intuitive connected to memory and place.
Based on this framework, I will create a room-scale multisensory installation composed of several small story-based stations. Each station begins from one personal or cultural story and turns it into a participatory experience. The audience will read or watch the stories first. Then they will need to enter them through actions that belong to the meaning of each story. Through these stations, the project asks how future forms of interaction might carry not only information, but care.
The first station will be developed from my work about my father’s letter. Before I left home, my father wrote me a letter. In my earlier artwork, I copied parts of the letter repeatedly with thick black paint and then covered the whole surface with black ink. The words became almost unreadable, but the raised traces of the writing remained. For this project, I want to turn this idea into a tactile reading experience. The audience will encounter several dark surfaces that appear almost blank at first. When they touch or move their hands across it, they will feel the hidden texture of the writing. Their touch may also trigger a quiet sound layer, such as paper friction, breath, and low voice-like vibration. This station asks how personal memory can remain present after language disappears from view. It also asks whether touching can become a form of reading.
The second station will be based on my memory of Jiangxinzhou, an island on the Yangtze River in Nanjing. When I was a child, I visited the island with my family to pick grapes. Later, the vineyards disappeared because of urban development. For a long time, I was not even sure whether my memory of the place was accurate. Years later, my family unexpectedly moved back into relation with the island, and I experienced a strange feeling of familiarity through sunset, wind and the riverside. This station will use field recordings and scent to create a sensory condition of returning to a place that has changed. The audience may need to walk through hanging fabric, follow a sound, or stand close to a reed-like material before the memory begins to appear. This station asks how a place can return through the body when visual evidence is no longer enough.
The third station will explore flavor, qi, and cultural memory. I am interested in the way Chinese medicine, tea culture, and food traditions understand the body through subtle sensations that are difficult to explain visually. Flavor and qi are not easy to translate into images or words. They are felt through the tongue. In this station, I want to create an interaction where invisible sensations are translated into other sensory forms. For example, touching a vessel, approaching a scent source, or even something edible, like pig oil installation. The translation will not be exact. I am interested in the gap between one sense and another, because this gap is similar to how memory works. We often remember something not as a clear image, but as a feeling that shifts when we try to describe it.
The fourth station will come from my recent experiment with spatial voice and AR bubbles, but this project will not focus on AR as the main medium. In this prototype, a person could leave a voice in a specific location, and another person could later hear it by physically moving into that space with AR equipments. What interests me is not the device itself, but the idea that a voice or memory can wait in a place for another body to arrive. In this installation, I want to create a sound-based station where visitors encounter voices or sound traces that are attached to specific positions in the room. They may need to lean in and stand in a certain relation to the sound source in order to hear it clearly. This station asks how future communication might become more spatial, intimate, and embodied, rather than remaining only on screens.
Together, these small stories will form a larger installation about future individual presence. I use the word “future” not to mean science fiction aesthetics, but to ask how people will continue to feel real.
The future individual may not exist only as a profile, data set, they may exist through traces they left in space and relationships built with each other. My project imagines this future as neither purely technological nor nostalgic. It proposes a more delicate form of existence, where technology helps reveal the body’s connection to memory, place, and others. The project will be developed through a practice-led and arts-based research methodology. Making will function as both research process and artistic outcome.
Grant support will allow me to move this project from a conceptual framework into a finished multisensory installation. At this stage, the project needs support not only for materials, but also for testing how each story can become a clear physical experience for the audience. The grant would help me build the installation environment, produce the sensory elements, test the sound and interaction systems, and create printed and digital materials that guide visitors into the work.
The project will require both physical materials and digital production tools. For the physical installation, I will use paper, ink, layered paint, fabric, translucent materials, reed-like textures, small vessels, scent containers, speakers, microphones, simple motors, sensors, microcontrollers, wires, lighting equipment, and projection surfaces. These materials will help me build the tactile and spatial parts of each station, so the audience can touch, move around, listen closely, and physically enter the stories. The stories themselves will be presented through a combination of filmed footage, AI-generated moving images, written text and speaker played sound. I will shoot real video materials connected to each story, and also use AI video generation to create images that are difficult to film directly. Written text will appear in a limited way, but as short fragments that guide the viewer into the emotional context of each story. For digital editing and sound production, I will use software such as Adobe Premiere Pro, Fuser Studio After Effects, Photoshop, Audition, and possibly TouchDesigner or p5.js for responsive visuals. Adobe Audition or another DAW will be used to edit field recordings. Premiere Pro, Fuser Studio and After Effects will be used to edit filmed and AI-generated video materials into short moving-image sequences for the installation. TouchDesigner or p5.js may be used to connect sound, image, and sensor input when a station requires real-time response. These tools will allow the stories to move between physical material, video, sound, and interactive experience.I will also prepare the technical equipment needed for presentation, including projectors or monitors, speakers, audio interfaces, cables, possible sensor boards, and small playback devices. Visitors will gain a fully immersive and multisensory experience in my work exhibition by seeing, hearing, reading, and physically encountering the stories in the space.
A key part of the grant will also support the public-facing materials of the project. Because this work is built from small stories, I want the audience to receive enough context without turning the exhibition into a written explanation. I plan to create a small printed guide or takeaway card for visitors. There would be four version cards that introduce each one story in a short and poetic way, while also giving a simple invitation for how to approach the station. For example, instead of saying “touch sensor here,” the card may say something like “read with your hand when the words disappear.” These printed materials will help visitors understand that their bodily actions are part of the storytelling. I also want to develop AR cards as an extension of the installation. Visitors may scan a printed card with their phone to access a short digital layer connected to each story. This layer could include a sound fragment, a short moving image, a 3D trace, or a small piece of text that continues the memory outside the exhibition space. The AR card is important because it allows the project to extend beyond the room without becoming only documentation. After leaving the exhibition, visitors can still carry a small part of the work with them and reactivate it later. This connects directly to the project’s theme: memory does not stay fixed in one place, but can return through a sensory trigger, a gesture, or a small object.
The grant would also support documentation and future presentation. I plan to document the project through a short movie, from the creation process to the final exhibit stage. Because multisensory work is difficult to document through image alone, I will pay attention to recording how people move through the space, and how they interact.
The final outcome of this grant will be a completed proof-of-concept installation, printed visitor materials, project documentation, and a clearer methodology for multisensory storytelling. I want viewers to leave with more than an understanding of my stories. I want them to remember the feeling of reading. In this way, the project aims to leave a memory in the audience’s body, not only in their interpretation of the work.
Long term, this grant will help me develop a flexible artistic method that can be expanded beyond this first installation. The structure of small story-based stations can later respond to other places, communities with redesigned and location based theme. The AR cards and printed materials can also become a portable archive of sensory stories, allowing the project to move between exhibition, publication, and participatory workshop formats. I want it to become a continuing practice for exploring how future artistic approaches in storytelling.