Kinect Headtracking with OSC Support

left: GEM Window, right: head pose estimation by G.Fanellibased on
Real Time Head Pose Estimation from Consumer Depth Cameras by Gabriele Fanelli [ref name=”fanelli”]http://www.vision.ee.ethz.ch/~gfanelli/head_pose/head_forest.html[/ref]

======================================
download source and windows/OSX binaries: https://github.com/kronihias/head-pose-estimation

Application that detects head position from a depth image provided by Microsoft Xbox Kinect Sensor in x,y,z and Euler Angles (pitch, yaw, roll) from multiple persons.

–> needs no calibration!!

Application sends data as OSC[ref name=”osc”]Open Sound Control (OSC) is a message based communication protocol for multimedia systems.[/ref] Message in the format:

/head_pose [User_ID] [x] [y] [z] [pitch] [yaw] [roll]
Continue reading

pd-kinect-examples

Find some examples about the usage of the externals pix_freenect, pix_openni, pix_threshold_depth, pix_depth2rgba, pix_head_pose_estimation on the Github page http://github.com/kronihias/pd-kinect-examples

In the moment just Mac OSX binaries of the externals are included. Windows binaries coming soon. Linux – please get the source from Github and build them by yourself.
Continue reading

Live Interfaces

I’ll be presenting my work for the Kinect sensor and Pure Data/Gem at the LIVE INTERFACES: Performance, Art, Music[ref name=”li”]Live Interfaces http://icsrim.org.uk/liveinterfaces/[/ref] conference.

Find the material here:
lipam2012-kronlachner-paper.pdf
lipam2012-kronlachner-poster.pdf

A substantial project report about all Kinect plugins and examples will be available soon.

pd-external: pix_openni 0.10

If you are working with Xbox Kinect Sensor here is another goodie for you – A pure data / Gem external to get Kinect rgb and depth streams as well as skeleton tracking and multiple hand tracking via OpenNI[ref name=”openni”]http://www.openni.org[/ref]

Download the packed Binaries for OSX and Windows pix_openni-0.10.zip .
Latest sourcecode available at github: http://github.com/kronihias/pix_openni

Look at this page if you don’t know how to install a Pd-External.

To control tilt, led and output accelerometer data you can use libfreenect based http://github.com/kronihias/freenect.
To get audio streams you can use libfreenect based http://github.com/kronihias/freenect_audio.
Continue reading

pd-external: pix_freenect 0.10

(C)2011 Matthias Kronlachner

Version 0.10 of pix_freenect external for Pure Data/Gem now available.
Sourcecode and binary for OSX and Ubuntu 11.10 available at github: https://github.com/kronihias/pix_freenect

Look at this page if you don’t know how to install a Pd-External.

The pix_freenect external can output rgb and depth simultaneously from multiple Kinect sensors.

Features:

  • open specific Kinect sensor by serial number – useful for multiple Kinect installations
  • output registered depthmap -> rgb and depth image are aligned
  • output depthmap directly as 16 bit [mm] values
  • resolution of rgb image can be set to 1280×1024

To get audio streams you can use http://github.com/kronihias/freenect_audio.
Continue reading

IEM Computermusic Ensemble Concert Graz and Vilnius

ICE @ Porgy&Bess ViennaOn Tuesday, March 20th, 2012 will be the next concert of ICE – IEM Computermusic Ensemble. This networkconcert will be held in two locations at the same time. Listen to it in Graz – Austria or Vilnius – Lithuania.
LMTA[ref name=”lmta”]Lithuanian Academy of Music and Theatre, Gedimino pr. 42, LT-01110 Vilnius, Lithuania[/ref] central building – Room 306, Vilnius
IEM[ref name=”iem”]Institute of Electronic Music and Acoustics, Inffeldgasse 10/3, 8010 Graz, Austria[/ref] Cube – Graz

Announcement in lithuanian language
Announcement in english language

concert starts at
20:00 Graz local time
21:00 Vilnius local time

“extended fields” – ICE (IEM Computermusic Ensemble)

Musicians:
– Jamilla Ballint
– Clara Hollomey
– Wen Liu
– Peter Venus
– Marian Weger
– Matthias Kronlachner (remote from Vilnius)
– Uluğ Can Kazaz (remote from Vilnius)
– guest: Daniel Hojka

Director: Winfried Ritsch
Continue reading

übersetzen – vertimas | piece for dancer, sound and projection

Greta Grinevičiūtė - dance

For the JAUNA MUZIKA[ref name=”jm”]JAUNA MUZIKA 2012[/ref] 2012 Festival in Vilnius – Lithuania, I’m preparing the piece Übersetzen – vertimas for dancer, sound and projection.

Sunday, April 15th, 2012 – 16.00
LMTA Chamber Hall, Building 2 – Tilto str. 16, Vilnius

Greta Grinevičiūtė – dance
Aira Naginevičiūtė – choreography
Matthias Kronlachner – technology, sound

Continue reading