Interaction Design

Interaction Design

Interaction Design in Computer Music mainly deals with Sonic Interaction Design (SID), which operates on the intersection of Interaction Design and Sound and Music Computing. Besides artistically motivated questions in SID, IEM is also concerned with more fundamental research in Interaction Design.

Interaction Design

Interaction Design in Computer Music is in most of the cases Sonic Interaction Design, as defined by the recently completed European COST Action on this topic. Many aspects of Sonic Interaction Design in Computer Music are closely related to the topic of Embodiment as well as the topic of Sonification. Due to its inherently transdisciplinary nature, IEM’s take on Interaction Design is touched upon in many of the institute’s research activities.

In the project "Embodied Generative Music", a central strand of inquiry concerned the interaction of a dancer with a spatial sound topology. Using motion capture the movements of the dancer where tracked in realtime and used to control sound synthesis. Different motion/sound mappings have been developed together with dancers and explored in the artistic study "Bodyscapes". The experiences gained with "Bodyscapes" led to the sonic sculpture "Random Access Lattice", which deepens the understanding of a particular mode of spatial sonic interaction.

Another further development of "Embodied Generative Music" is "Transbody", a project where the dancers movements are used to algorithmically generate a dynamic figure, which is projected on the stage. In a further step, a sound texture is synthesized based on an algorithmic analysis of the dynamic figure.

In the project "The Choreography of Sound", the movements of dancers will be used to control the spatial aspects of sound synthesis and projection in an attempt to design new interactions between dance and music. Besides these artistically motivated research questions, IEM also conducts research in more fundamental questions of Interaction Design. Within the context of composition and music performance, we explore ideas that can be applicable in broader domains such ubiquitous computing, natural user interfaces, multimodal interaction and mixed reality. Sonic Interaction Design is explored, addressing the potential contribution of sound to interaction designs as well as the design of interaction with sound per se. In this context we synergistically use interaction design techniques, usability evaluation and phenomenological observations  to inform the iterative interaction design loop.

Publications and Documents