Publication detail

Back to list

Musical sonification in electronic therapy aids for motor-functional treatment - a smartphone approach

Publication ID 55708
Abstract This work presents a system which uses an Android smartphone to measure the wrist motion of patients in ergotherapy and creates musical sounds out of it, which can make exercises more attractive for patients. The auditory feedback is used in a bimodal context (together with visual feedback on the smartphone’s display). The underlying concept is to implement a therapy aid that transports the principles of music therapy to motor-functional therapy using a classical sonification approach and to create an electronic instrument in this way. Wind chime sounds are used to sonify the patient’s wrist motion, a three-dimensional parameter mapping was implemented. The system was evaluated in a qualitative pilot study with one therapist and five patients. The responses to the musical auditory feedback were different from patient to patient. Musical auditory feedback in therapy can encourage patients on one hand, on the other hand it can also be perceived disturbing or discouraging. From this observation we conclude that sound in electronic therapy aids in fields other than music therapy should be made optional. Multimodal electronic therapy aids, where sound can be toggled on and off, are possible applications.
Edition title Proceedings of the Sound and Music Computing Conference 2016 (SMC)
Publication URL
Publisher Month 01
Publisher Name SMC 2016
Publisher Location Hamburg (Deutschland)
Note procedure: peer-reviewed
Status published
Publication Type full paper
Publication Reference proceeding
Year of Publication 2016
Authors Stahl, B., Zmölnig, J.
Editors Hajdu, G.