The Kinect distance sensor as human-machine-interface in audio-visual art projects
Matthias Kronlachner
25.04.2012 - 26.6.2012
wissenschaftliches Toningenieur-Projekt
Ressource:
The Kinect distance sensor as human-machine-interface in audio-visual art projects
For several years now, the entertainment and gaming industry has been providingmultifunctional and cheap human interface devices which can be used for artistic applications.
Since November 2010 a sensor called Kinect™ for Microsoft's XBox 360™ is available.This input device is used as color camera, microphone array, and provides as anindustry-first, a depth image camera at an affordable price.
As part of the project Pure Data/Gem externals have been developed which allowaccess to the video and audio streams of the Kinect sensor. By including a frameworkfor Natural Interaction (OpenNI), methods can be used for user identification or theextraction of skeletal models from the depth image.
The video streams and motion data produced by the sensor, in combination with the software, is used in multimedia art projects for controlling sounds and video projections.The documentation of these art projects and examples of the usage concerning thedeveloped Pure Data externals make up the practical part of this project.