Process:

Generative visuals were created using Touchdesigner and seamlessly integrated into Resolume through NDI. In Resolume, additional visuals were added, accompanied by a variety of video mixing effects.

For the generative sound component, VCV Rack, a software modular synthesizer, served as the creative hub. An Xbox controller was mapped to trigger sound effects in VCV Rack and effects within Resolume. We configured a level switch, where to user could switch between different environments by pressing a certain button. Every other button press was then configured in a manner so that it produced a unique combination for every visual scene.

When interacting with the work initially, we noticed that viewers had to first become become familiar with the nuanced behaviors of the controller buttons. Over time as they got accustomed to the controls, they could engaged in playful exploration, crafting their own immersive landscapes. Going through various button combinations allowed the user to create personalized audio-visual environments. The core concept focused on the user dialing in their current emotional state through the different inputs of the controller with the installation being the visual vessel of their combination.