Experience Sharing Studio

Conventional digital archives remain predominantly audiovisual, lacking the haptic and embodied information crucial for sharing experiences with others. Experience Sharing Studio (ESS) is an immersive platform designed for the spatio-temporal recording and playback of embodied multisensory memories. By integrating multimodal data—including spatial video, haptics, and 3D body poses captured via wearable and environmental devices—ESS allows users to physically relive another person's experience.  

The system utilizes the Experium platform to manage this integrated data using a unique Experience ID. A key feature of ESS is the "Spatio-Temporal Progress Bar," which visualizes 3D body poses as nodes to intuitively guide users through the playback of recorded experiences. Furthermore, ESS features a "User-driven Playback Mode" that dynamically adjusts the playback speed based on the user's performance. For instance, the system automatically decelerates the guide into slow motion if the user's physical transition is slower than expected, supporting the efficient acquisition of complex embodied knowledge.

This platform is highly versatile and can capture a wide range of human activities. It can archive dynamic, wide-area physical movements with a strong sense of grounding, such as a basketball practice sequence, as well as the static, precise gestures and tranquil spatial atmosphere of a Japanese tea ceremony.

‍