Translation between Sound and Morphology using Artificial Intelligence

2023-2024, Intra – Funding, Approved

together with Dr. Zeynep Aksöz Balzar

This project follows an interdisciplinary path integrating methods from the field of audio data analysis into the field of design and artificial intelligence to use audio data as a generative driver of design and design descriptions as a driver of audio compositions. The project will explore emergent morphologic and audio impulses and stimuli through the integration of generative systems of artificial intelligence and Artificial Neural Networks, that are trained to transform the architectural medium of geometry as a reaction to incoming audio impulses. The concept of the project presupposes a transformation between sound and light-based structures, both elements of the multisensory architectural medium, namely the transformation from enactive perceivable sound spaces into parameters of the virtually abstract medium of mathematics to enactive perceivable architectural structures in physical space and vice versa. Exploring these bilinear processes, the project aims to open novel ways of creation, liberating these media from their conventional tools by generating novel interdisciplinary instruments.

The project is based on a collaboration between the IOA (institut of architetcture)(Zeynep Aksöz Balzar) and the digital art department (Nicolaj Kirisits) of the University of applied art, Vienna.