This was a collaborative installation made for university. The piece translates the music the users create with the instruments inside the room to responsive real time visuals that are projected on the walls. Our goal was to invite others to explore the creation process of sound design by making it more accessible and interesting. 

Above is a small video our DOP Jacob Waipara made after we finished this project The music overlaying the video was actually create by one of the users while they were using the display during the exhibition.

I was the developer and visual designer during this project. I created these visual using P5JS (Processing - Javascript) and P5PY (Processing - Python).

 I used the minim and sound libraries to translate 5 different frequencies while connecting my computer to a mixer and assigning different inputs to the different visuals transform and colour values.

The room consisted of one main visuals on the front wall and two matching on the side walls with three different instruments in the centre of the room. We ideally wanted a larger room with a drum kit, bass guitar and a piano, but due to the restraints on what was available, we got a smaller room and used a drum pad, synthesiser and a bass guitar. The cube visual was a variant on a tutorial of Samuel Lapointe and credit to the youtuber The Coding Train for teaching me the knowledge of P5 sound libaries needed to create these .

Feel free to look and use the source files here  --> Projet-Files