Peter Sörries
Interaction Design & Research
»Aux Synesthesia« explores the intersection of real and virtual realities by transforming our cognitive perception.
Acoustic signals, inherently tied to interaction, define and distinguish materials through their unique echoes. This project harnesses sound’s spatial properties through absorption, reflection, and transformation to create an immersive interface.
In Cooperation with
Jan Batelka & Thushan Satkunanathan
Publication
Core77
Exhibition
Dubai Design Week
In the beginning, simple acoustic tests were conducted using a loudspeaker within a tube to investigate how different materials reflect sound.
Based on these insights, a first prototype was developed, using a Kinect that captures material properties such as shape or distance through its depth sensor. The data gathered was then processed as sound using the Processing software.
Rethinking the prototype as a handheld device, a first hi-fi prototype was designed by disassembling the Kinect and using a Raspberry Pi to run the Processing Software.
To extend the acoustic data based on the handheld device, an AR experience was added using Unity and an HTC Vive. Here, the acoustic data of the handheld device was translated into a fragmented visualization of reality.
