Sensory Interaction Transformation Layers
Sensory Interaction
The Grid Scanner
Based on the theory of Synaesthesia, we analyzed how complete multisensory experiences can be synthesized in multimodal interfaces. As “multisensory interactive technologies necessarily break down the human experience into separate channels (input and output)”, it is the task of the designer to put them together in a way which enables the user to experience them as a whole. We introduced the concept of distortion to approach this topic: How can a multisensory experience be mediated to people who perceive things differently? By using a 25 x 25 squared paper as an analogue pixel sensor and a self-developed processing-sketch (as mash-up based on code from the book Generative Design) we visualize the idea of a multi-sensory recording and translation technique which analyzes images as data storages for multisensory experiences.
