SYNESTHESIA SIMULATOR A.K.A SYN ² (2014)
The simulator Synesthesia: AKA Syn ² proposes the interaction between vision and hearing, space and time, virtual and current through the interpretation of Google Maps images by computer and its translation into sound synthesis.
The simulation synesthetic connections between color and sound provides the creation of new relations of identity between subject and real and virtual space. The operation of the installation system is based on the analysis of the color, saturation and brightness of the images by computer codes Processing programming language.
The analyzed data is temporarily stored and converted in real-time MIDI synthesized sounds. Each color: gray, violet, blue, green, yellow, orange and red gets the sound of a distinct timbre as the relationship between brightness and saturation determine, respectively, the height (severe or acute) and intensity (strong or weak) the sound generated.
The interaction with the work assumes the learning time for the public to recognize the timbre of each color and synaesthetic relationship is established fact. The choice of location and the point of view of what is to “listen” provides a great combination of sounds and even, in some cases, the compositional control of the sound sequence by the user.
The system created based on the interdependence between: (i) individual choice; (Ii) recognition of synesthetic relations; (Iii) availability of virtual space (controlled by the Google company policies and economic relations with the rest of the world), and (iv) the speed of the internet network available that can limit or expand the pace of navigation.
Synesthesia Simulator is developed by
Alex Tso
Gloria Fernandes
Loren Bergantini
Rafael V. Ribeiro
Vinicius Franulovic
Check Wiki for step-by-step development information