The Kinect distance sensor as human-machine-interface in audio-visual art projects

excerpt of project thesis

excerpt of project thesis

I finished my project thesis including general information about the Microsoft Kinect sensor device as well as a detailed documentation about it’s application in combination with Pure Data and Gem.

This document might be useful for people working with the Kinect in combination with interactive sound and video installations and performances.

Get the PDF document here!

Live Interfaces

I’ll be presenting my work for the Kinect sensor and Pure Data/Gem at the LIVE INTERFACES: Performance, Art, Music[1] conference.

Find the material here:
lipam2012-kronlachner-paper.pdf
lipam2012-kronlachner-poster.pdf

A substantial project report about all Kinect plugins and examples will be available soon.

  1. [1]Live Interfaces http://icsrim.org.uk/liveinterfaces/

pd-kinect-examples

Find some examples about the usage of the externals pix_freenect, pix_openni, pix_threshold_depth, pix_depth2rgba, pix_head_pose_estimation on the Github page http://github.com/kronihias/pd-kinect-examples

In the moment just Mac OSX binaries of the externals are included. Windows binaries coming soon. Linux – please get the source from Github and build them by yourself.
Weiterlesen

documentation :: übersetzen – vertimas

Have a look at the trailer of the piece for dancer, sound and projection übersetzen – vertimas:

Sound optimized for headphone playback

technical details
Weiterlesen

übersetzen – vertimas | piece for dancer, sound and projection

Greta Grinevičiūtė - dance

For the JAUNA MUZIKA[1] 2012 Festival in Vilnius – Lithuania, I’m preparing the piece Übersetzen – vertimas for dancer, sound and projection.

Sunday, April 15th, 2012 – 16.00
LMTA Chamber Hall, Building 2 – Tilto str. 16, Vilnius

Greta Grinevičiūtė – dance
Aira Naginevičiūtė – choreography
Matthias Kronlachner – technology, sound

Weiterlesen

  1. [1]JAUNA MUZIKA 2012

IEM Computermusic Ensemble Concert Graz and Vilnius

ICE @ Porgy&Bess ViennaOn Tuesday, March 20th, 2012 will be the next concert of ICE – IEM Computermusic Ensemble. This networkconcert will be held in two locations at the same time. Listen to it in Graz – Austria or Vilnius – Lithuania.
LMTA[1] central building – Room 306, Vilnius
IEM[2] Cube – Graz

Announcement in lithuanian language
Announcement in english language

concert starts at
20:00 Graz local time
21:00 Vilnius local time

„extended fields“ – ICE (IEM Computermusic Ensemble)

Musicians:
– Jamilla Ballint
– Clara Hollomey
– Wen Liu
– Peter Venus
– Marian Weger
– Matthias Kronlachner (remote from Vilnius)
– Uluğ Can Kazaz (remote from Vilnius)
– guest: Daniel Hojka

Director: Winfried Ritsch
Weiterlesen

  1. [1]Lithuanian Academy of Music and Theatre, Gedimino pr. 42, LT-01110 Vilnius, Lithuania
  2. [2]Institute of Electronic Music and Acoustics, Inffeldgasse 10/3, 8010 Graz, Austria

pd-external: pix_openni 0.10

If you are working with Xbox Kinect Sensor here is another goodie for you – A pure data / Gem external to get Kinect rgb and depth streams as well as skeleton tracking and multiple hand tracking via OpenNI[1]

Download the packed Binaries for OSX and Windows pix_openni-0.10.zip.
Latest sourcecode available at github: http://github.com/kronihias/pix_openni

Look at this page if you don’t know how to install a Pd-External.

To control tilt, led and output accelerometer data you can use libfreenect based http://github.com/kronihias/freenect.
To get audio streams you can use libfreenect based http://github.com/kronihias/freenect_audio.
Weiterlesen

  1. [1]http://www.openni.org

pd-external: pix_freenect 0.10

(C)2011 Matthias Kronlachner

Version 0.10 of pix_freenect external for Pure Data/Gem now available.
Sourcecode and binary for OSX and Ubuntu 11.10 available at github: https://github.com/kronihias/pix_freenect

Look at this page if you don’t know how to install a Pd-External.

The pix_freenect external can output rgb and depth simultaneously from multiple Kinect sensors.

Features:

  • open specific Kinect sensor by serial number – useful for multiple Kinect installations
  • output registered depthmap -> rgb and depth image are aligned
  • output depthmap directly as 16 bit [mm] values
  • resolution of rgb image can be set to 1280×1024

To get audio streams you can use http://github.com/kronihias/freenect_audio.
Weiterlesen