This work explores unsolved images, that is, anythingthat is ambiguous, bistable, multistable, illusory ormisleading in any way, and examines how, by linkingthese images to certain kinds of interactions thecognitive process of interpreting an image can affectthe way you see it.
Enter, act, interact, let your body see.

Recording technology in the digital age allows events to stop disappearing and being forgotten, images and sounds can still be alive and vivid. But the memories and feelings of that time are fading incessantly. This work explores a new perspective on capturing a live event.49 audience's real-time physiological data is recorded in the live concert, through the lamps that flicker with the heartbeat, forest-like projection mapping generates from body signals, and the abstract feelings are interpreted this way to reproduced in the gallery.
The projection mapping motif is inspired by the space and how we interpret ambiance. Karuizawa Ohga Hall is constructed from local trees and in an environment that is surrounded by nature. The hall has an acoustic effect that is changing with the wood over the years quietly but steadily. So the mapping also grows slowly and quietly with the surroundings. The ambiance is discharged is the emotion and feeling that was discharged in a certain space, at a certain time, with certain beings. So the mapping is generated from certain data recorded lively from the audiences on that day.
The 49 light bulbs aim to create the presence of the audience in an absent way. The lamps blink subtly as the heartbeat rhythm and give off a little bit of warmth. The luminance and warmth are close, intimate, and fleeting at the same time. The lamp stands are designed near the height of the heart when people seat down. The chair is an antique chair that was used in a theater. So exhibition visitors have the tendency to seat and realize the lamps are flickering near their hearts.

Pulse Dance is an interoceptive play installation that confronts two players with their own heartbeats. Every person's heart beats to their own rhythm. This rhythm is an integral part of our existence, yet a convoluted reflection of our conscious mind. While it can feel strangely alien to us, our heartbeat is intrinsically linked to our being. How do we relate to our own rhythm? To what extent is our heartbeat ourself, and to what extent is it alien?

Innermost Echoes is a mixed-media installation work which explores novel physiologically-driven performance practices. Prior recorded physiological data from a performer (Danny Hynds) will loop and manipulate two unattended musical instruments (robotic koto and Eurorack synthesizer), thereby affording a sense of freedom and autonomy to the objects themselves. In a sense, the prior presence of the performer will act as a vessel or avatar to guide the instruments.
Innermost Echoes: Live is an improvisational performance series which utilizes physiological sensing in a variety of musical and performative settings. A live koto performer, Aoi Uyama, will improvise alongside a robotic koto and a Eurorack synthesizer setup, performed by Danny Hynds. Many gestures and responses from the koto will rely on the live real-time physiological data from both performers, thereby integrating the presence of the performers in this robotic instrument. Through several different configurations, the concept of performance and liveness will be explored.

Ephemeral Counterpoint is a mixed-media installation which utilizes obsolete technologies as a vehicle for exploring the fragile and evolving relationship between recorded media and memory. Several discreetly placed webcams will broadcast the work to an interactive website which will allow for the convergence of the digital and the analog.

We present the concept of sharing frisson and the artifact of “Frisson Waves” by enhancing and transmuting aesthetic chills into emotion circle waves. We explores the intimate reactions and enables a way of inward perception that was transformative, individual as well as collective by facilitating the interpersonal transmission of frisson sensation. We describe an open integrated wearable system that consists of a wrist band, back-end processing, and output. Our proposed system enables the capturing and translating of physiological signals into thermal information to induce frisson.

Sonitecture: Module 1 is a sonic and sculptural installation. Several abstract beings respond to the audience’s presence and physiological sensing through responsive lighting and sound, creating a meditative and communicative feedback loop between the digital and the human worlds.

The origin of dance was in "ceremonies" and "festivals" where there was no boundary dancers and audience. Boiling Mind creates a bond between dancers and audience by using “sensation sharing” that dancers have unconsciously gained. During the performance, the audiences wear a heart rate sensor and eye tracking device to generate data that will be visualized later on. The visualization will become a part of the stage design and create the connection between the dancer and the audience.

Flow Zone is a VR experience that provides a rich, synesthetic environment to center the player’s focus on the present moment and catalyze a flow state. We use body movement and poi as the medium to dynamically create and interact with music, enabling players to embody both DJ and dancer simultaneously. Music synchronizes with visuals and haptics using VR and our custom haptics suit to create a fully immersive experience where life melts away and only creative and self-expression remain. Find happiness and wellbeing through flow, and emerge rejuvenated by entering the Flow Zone.

Tangible Pads is an interactive experience that combines sound, lighting, movement and haptics. Each Tangible Pad represents a different instrument and is only activated when the user interacts with it. The more people join the experience the more instruments get activated. The music builds up in response to movement. This way, participants are able to motivate each other to move. They are also able to collaborate through dance to make more complex sounds. Each Tangible Pad is equipped with an actuator that provides haptic feedback and lights that change to the beat of music. These parameters coupled with sound help provide an immersive experience. Through this experience users are able to align their movement with the music, build off each others' movements and contribute to the making of the music.

The atmoSphere is a system that provides users immersive music experiences using spatial audio and haptic feedback. We use cross-modal correspondence -the interaction between two or more sensory modalities- to create an engaging user experience.

The atmoSphere consists of a spatialized music and a sphere shaped device which provides haptic feedback. It provides users imagination of large sound environment although they feel haptic sensation in their hands.

Experience body vibrations of candy colored psychedelic sound rippling through an endless crystal universe. Crystal Vibes is a virtual reality experience that demonstrates the cutting edge of spatial 3D audio, full-body 'Synesthesia Suit' vibro-tactile stimulation, and sound visualization that maps sound and light based on the science of the human senses, to push the frontiers of technology-mediated sensory experience in virtual reality. With the project's predecessor (Sound World VR) described as “transcendent” and “like traveling through a psychedelic kaleidoscope” (Forbes 2016), this piece ups the ante with music from producer Ott. and is all-new.

The “Synesthesia Suit” was created to embody the multi-sensory concept behind the VR (virtual reality) video game “Rez Infinite”. The 26 actuators vibrate throughout the person’s body along with the music and simultaneously light up via LED. There is an element of texture to the vibrations — whether it be the feeling of stringed instruments or drums being played — to which the LED colors and light patterns synchronize as the game progresses. This multimodal suit allows the person to experience music not just through its ears but also through the senses of touch and sight.

This research proposes augmenting physical experience with unreal sonic effects to intrigue children’s emotional experience and physical activities, and inspire their creativity. To explore the idea, we present Dramagic, a playful furniture that enhances authentic sounds occurring on the furniture with cartoon sonic effects. To validate the proposed design, we conducted a field test to observe children experiencing. The results indicated that augmenting sonic experience intrigued more physical actions, such as touching, scratching, and rubbing. Moreover, children became more creative and tend to make stories with the playful sound interactions.

A design of product is an important factor in producing a new product. Product designers create three-dimensional computer-graphics (3DCG) models by the use of 3DCG modeling tools and make mock-ups to review their designs. However, there are differences of aspects between the original 3D models and the generated mock-ups frequently. Moreover, it takes expenses and long development terms to re-create new designs and mock-ups for desired products.
In this paper, we propose a system in that a user can create and check virtual mock-ups while creating 3D models of products. We construct the system by combining a commercial 3DCG modeling tool with an augmented reality (AR) technology, and 3DCG models are superimposed on the real-world environment in real time during their modeling process. Furthermore, 3DCG models are displayed with real scale and natural illumination on a see-through display. Therefore, the system enables product designers to review designs of new products without making real mock-ups.
We collaborated with Technology Joint Co. for commercialization of the proposed system. We developed an original AR function to display real scale 3DCG models and illuminate them naturally on real space. Moreover, we verified the effect of the proposed system for reviewing designs of 3DCG models in detail without making real mock-ups.