How an empty Italian Church shaped an immersive media experience.

Physical and digital. The two words inherently seem at odds with each other - physical referring to an object or space in the tangible ‘here’, mapped in three dimensions. Digital, on the other hand, conjures a much different mental picture. Data and images combining to inform, entertain, record, etc. It’s undeniable however that the two worlds are inextricably linked - shaping our day to day processes and interactions in a continually evolving fashion.

In 2014, I discovered a new exhibition by Postmatter magazine, exploring this exact relationship through the lens of art and fashion. The merging design of physical and digital was something I began to grapple with as a young architect and Postmatter offered a unique perspective on combining the two. Though the exhibit is now four years old, I still refer back to it for inspiration as I continue to explore the intersection of the two worlds in experience design.

Postmatter Interactive Fashion Film

Though the primary visual experience of Postmatter is captured via a two-dimensional screen, the exhibition is reliant on physical interactions, movement, and space to complete the experience. The installation is housed within a spare 16th-century church in Milan Italy. The slightly aged structure immediately sets the tone for the experience by providing a quiet but grand backdrop for the exhibit.

As each visitor makes their way into the church, they are greeted with three different experiences - Ripple, Echo, and Gravity. With each section, Postmatter explores the shifting relationship of physical and digital interactions by engaging users in motion and touch activated media experiences that challenge our typical relationship with technology.

Echo and Gravity use leap motion and motion sensors to split and push images. Ripple differs in that it engages users via a lightly tensioned fabric panel. The hand pressure and motion applied to the panel morphs the scene of the fashion model.

The tactile and sensory physical elements are a powerful element in the overall engagement with the exhibit. As visitors engage physically with the onscreen elements, they are able to create their own media experience while simultaneously, digitally translating the relationship of their body to that of the body onscreen.