{"id":779,"date":"2012-01-09T03:03:36","date_gmt":"2012-01-09T01:03:36","guid":{"rendered":"http:\/\/www.matthiaskronlachner.com\/?p=779"},"modified":"2026-02-24T14:13:26","modified_gmt":"2026-02-24T12:13:26","slug":"pd-external-pix_openni-0-02","status":"publish","type":"post","link":"https:\/\/www.matthiaskronlachner.com\/?p=779","title":{"rendered":"pd-external: pix_openni 0.10"},"content":{"rendered":"

\"\"<\/a>If you are working with Xbox Kinect Sensor here is another goodie for you – A pure data \/ Gem external to get Kinect rgb and depth streams as well as skeleton tracking and multiple hand tracking via OpenNI[ref name=”openni”]http:\/\/www.openni.org[\/ref]<\/a><\/p>\n

Download the packed Binaries for OSX and Windows \n\tpix_openni-0.10.zip<\/a>\n.
\nLatest sourcecode available at github: http:\/\/github.com\/kronihias\/pix_openni<\/a><\/p>\n

Look at this<\/a> page if you don’t know how to install a Pd-External.<\/p>\n

To control tilt, led and output accelerometer data you can use libfreenect based http:\/\/github.com\/kronihias\/freenect<\/a>.
\nTo get audio streams you can use libfreenect based http:\/\/github.com\/kronihias\/freenect_audio<\/a>.
\n<\/p>\n

pix_openni (0.10 experimenting…)
\n======================================
\npure data \/ Gem external to get Kinect rgb and depth streams, skeleton tracking, hand tracking<\/p>\n

* depends on OpenNI, NITE, SensorKinect<\/p>\n

2011\/2012 by Matthias Kronlachner
\n__________________________________________________________<\/p>\n

::INSTALL::
\ntested under Ubuntu, OSX 10.6.8 and Windows 7<\/p>\n

OSX:
\nyou don’t have to compile the external for yourself -> use included binaries from build folder (copy pix_openni.pd_darwin in pix_openni folder)
\nyou still need OpenNI, NITE and SensorKinect!!
\n* download latest OpenNI and NITE unstable build for OSX from http:\/\/www.openni.org\/Downloads\/OpenNIModules.aspx,
\nsudo .\/install.sh in the extracted folders
\n* install SensorKinect from https:\/\/github.com\/avin2\/SensorKinect<\/p>\n

WINDOWS:
\nyou don’t have to compile the external for yourself -> use included binaries from build folder (copy pix_openni.dll in pix_openni folder)
\ninstall OpenNI, NITE and SensorKinect<\/p>\n

http:\/\/www.openni.org\/openni-sdk\/openni-sdk-history-2\/
\n(OpenNI SDK v1.5.4.0)<\/p>\n

Binary of NITE
\nhttp:\/\/www.openni.org\/openni-sdk\/openni-sdk-history-2\/
\n(NiTE v1.5.2.21)<\/p>\n

Binary of avin2 \/ SensorKinect
\nhttps:\/\/github.com\/avin2\/SensorKinect\/downloads
\nSensorKinect093-Bin-Win32-v5.1.2.1.msi<\/p>\n

Linux:
\n* get\/install pd and Gem (http:\/\/puredata.info)<\/p>\n

* get and install OpenNI, NITE and the hacked Primesense Kinect driver
\n–> instruction: https:\/\/github.com\/avin2\/SensorKinect
\nhttp:\/\/www.openni.org\/openni-sdk\/openni-sdk-history-2\/<\/p>\n

* edit Makefile for right path to Gem, pd and OpenNI sources<\/p>\n

* #…\/pix_openni> make<\/p>\n

* have a look at the pix_openni-help.pd file!<\/p>\n

:: Usage ::<\/p>\n

* Have a look at my pd-kinect-examples at Github: http:\/\/github.com\/kronihias\/pd-kinect-examples<\/p>\n

Hand Tracking:<\/p>\n

to track multiple Hands edit following File:
\n\/usr\/etc\/primesense\/Hands_*\/Nite.ini
\nand add or uncomment:<\/p>\n

[HandTrackerManager]
\nAllowMultipleHands=1
\nTrackAdditionalHands=1<\/p>\n

_________________
\nChangelog<\/p>\n

0.10 * various bugfixes
\n* depth_output simplified – just rgba and yuv available ->
\n* ATTENTION INCOMPABILITY: “viewable” depth output outsourced into pix_depth2rgba
\n* record and playback functionality
\n* user coloring
\n* skeleton settable smoothing factor<\/p>\n

0.03 * switchable OSC Style output of tracking data \/skeleton\/joint\/r_hand id x y z, \/hand\/coords id x y z
\n* switchable real-world coordinate output in [mm]
\n* switchable registration between rgb image and depth image -> change point of view from depth camera to match with rgb image (overlay)
\n* improved help file<\/p>\n

0.02
\n* OSX binaries
\n* output rgb and depth stream simultaneously
\n* hand tracking
\n* change image and depth modes
\n* init without .xml init file
\n* fixed depth to rgb conversion for output_mode 1 & 2<\/p>\n

0.01
\n* skeleton and rgb or depth stream output<\/p>\n

________________
\n:::THINGS TO DO:::<\/p>\n

* support for multiple Kinect<\/p>\n

* motor and led control as well as audio is currently not supported from SensorKinect
\nyou can do that with pd external freenect: http:\/\/github.com\/kronihias\/freenect<\/p>\n

* optimize record\/playback functionality<\/p>\n

questions: m.kronlachner@gmail.com<\/p>\n","protected":false},"excerpt":{"rendered":"

If you are working with Xbox Kinect Sensor here is another goodie for you – A pure data \/ Gem external to get Kinect rgb and depth streams as well as skeleton tracking and multiple hand tracking via OpenNI[ref name=”openni”]http:\/\/www.openni.org[\/ref] … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":780,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_lmt_disableupdate":"","_lmt_disable":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[3],"tags":[25,35,24,22,16,20,36,19,18,17,26,21,23],"class_list":["post-779","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-software","tag-depth","tag-external","tag-gem","tag-hand","tag-kinect","tag-open-ni","tag-open-source","tag-openni","tag-pd","tag-pure-data","tag-rgb","tag-skeleton","tag-tracking"],"modified_by":"matthias","jetpack_featured_media_url":"https:\/\/www.matthiaskronlachner.com\/wp-content\/uploads\/2012\/01\/pix_openni.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=\/wp\/v2\/posts\/779","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=779"}],"version-history":[{"count":1,"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=\/wp\/v2\/posts\/779\/revisions"}],"predecessor-version":[{"id":2773,"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=\/wp\/v2\/posts\/779\/revisions\/2773"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=\/wp\/v2\/media\/780"}],"wp:attachment":[{"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=779"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=779"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.matthiaskronlachner.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=779"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}