Group Project
Interactive audio-visual installation – Escola Superior de Media Artes e Design, Porto, 2024
Sound of Shapes is a group project created for the Multimedia Lab I and Sound I classes at Escola Superior de Media Artes e Design (ESMAD) in Porto. The team consisted of Ahmet Serdar Karakurt, Raquel Marques Morim and David da Costa Leite.
The project is an interactive audiovisual installation exploring the connection between music, shape, and colour. The concept asks, "If a musical note had a visual shape and colour, how would it look?" To explore this, visitors interact with two MIDI controllers placed in front of a large projection screen. Each key pressed on the controllers plays either a choir or a violin sound, while simultaneously creating geometric wire-frame shapes with unique colours fetched live from the Colormind cloud platform.
As visitors continue playing together, the screen progressively fills with layers of coloured shapes, creating a dynamic audiovisual experience. The project encourages cooperation, as it only reaches its fullest visual and auditory potential when two people collaborate, resembling a musical duet.
The project combined several tools:
Node-RED: connected to Colormind to receive real-time colour palettes from the cloud.
TouchDesigner: handled the real-time visuals, mapping MIDI inputs to shapes and colours.
FL Studio and Kontakt: managed audio samples of choir and violin sounds and sent output to speakers.
I was responsible for:
Creating and maintaining the Node-RED workflow to connect with the Colormind platform.
Developing visual components and interactive mapping in TouchDesigner, link shapes, colours, and sound.
Exhibited at ESMAD in June 2024.
