Tryplex Kinect Toolkit

monobrau's picture

Hi everyone,

We've just released the first version of the Tryplex Kinect Toolkit. It's a set of QC macro's that work together with OSCeleton.

The download and Installation doc's and more info is up at: http://code.google.com/p/tryplex/

More stuff coming soon, please share your improvements, results, problems, ideas and suggestions!

monobrau's picture
Tryplex Kinect Toolkit

Video with some examples:

CliffSchwarz's picture
Re: Tryplex Kinect Toolkit

I found it sorry

CliffSchwarz's picture
Re: Tryplex Kinect Toolkit

I am having trouble with the file that was provided OSCeleton. on this machine i get an error message saying "Classic mode is no longer supported"

monobrau's picture
Re: Tryplex Kinect Toolkit

You'll have to drag&drop it to a terminal window and press enter, starting it from the finder won't work.

For more info check the doc's we've put online. http://code.google.com/p/tryplex/wiki/Running

Good luck!!

stuart's picture
Re: Tryplex Kinect Toolkit

Nice one, thanks for sharing. Great set of macros.

I can't wait until OpenNI/Osceleton is more stable in OSX or better yet a QC plugin. Although it works, I still get "segmentation faults" while running OSCeleton, which causes it to stop sending data. I haven't tried using OSCeleton in Windows yet, but it appears to be more stable against these crashes. I'm sure the kinks will get worked out in OSX soon enough.

Even with the bugs, it is an exciting time when we can get skeletal information in QC using a $150 camera that works in the dark.

thanks to all that have contributed into the collective Kinect knowledgebase.

usaca2008@gmail.com's picture
Re: Tryplex Kinect Toolkit

I drag OSCeleton, and then the terminal keeps giving me bus error,what could be wrong?

monobrau's picture
Re: Tryplex Kinect Toolkit

Have you tried the version of OSCeleton that I included in the download? It's the first OSX release. I found it to be more stable than the later releases (didn't segfault on me yet).

monobrau's picture
Re: Tryplex Kinect Toolkit

Maybe the kinect is still in use by another program, try disconnecting and reconnecting & try again.

usaca2008@gmail.com's picture
Re: Tryplex Kinect Toolkit

thank you for you help, both osceleton and sendosc seem work fine. but as soon as I open the sample file in QC, the QC program crashed. maybe it is qcOsc plugin this time

Sandroid's picture
Re: Tryplex Kinect Toolkit

the same here.

monobrau's picture
Re: Tryplex Kinect Toolkit

That's unfortunate.

Is your Quartz composer set in 32-bit mode? (locate the Quartz Composer app in the Developer/Applications folder, select it, press CMD+I and select 32-bit)

Does it give any error when crashing, and what os/xcode are you on?

dust's picture
Re: Tryplex Kinect Toolkit

nice will have a look at this project. i hope all is well with mischa

usaca2008@gmail.com's picture
Re: Tryplex Kinect Toolkit

yay, it worked. I think you might leave a note on the install guide for people forget to set QC in 32-bit mode~That will be really helpful

monobrau's picture
Re: Tryplex Kinect Toolkit

Done, thanks for your feedback!

bios's picture
Re: Tryplex Kinect Toolkit

Thanks for your great macros it's work fine for me. Because I don't have a kinect I created this patch: http://kineme.net/forum/Applications/Compositions/KinectSkeletonPlayer

itsthejayj's picture
Re: Tryplex Kinect Toolkit

This is too much fun!!!! I changed the base macros quite abit but should have a few more macro gestures to add to the project by the end of next week. Thanks for building the template to get things started great work.

monobrau's picture
Re: Tryplex Kinect Toolkit

Whoa! cool stuff!

I'm wrapping up a 0.2 version within a week or so, would love to to add them!

dust's picture
Re: Tryplex Kinect Toolkit

these are great. i think its been left up to us, visual artist programer types to prove that the kinect is more than gimmick novelty item. if you keep pumping out some videos like this and one seconds keeps spreading the love at festivals and what not i think people may start to get it. my kinect scratch video defiantly turned some heads, most people didn't really know what to say but a bunch of people whom have never tried the software lol... had all kinds of things to say about how you can not dj with the kinect. say everything from some latency issues to the lack of haptic response.

what i say is if you need real haptic response point the camera at your real turntable or drum set or what ever. kind of defeats the purpose of the kinect if you ask me. my 3 year old can dj with an ipad and theres no haptic response so i would think a grown adult seeing them selfs on the screen should be able to do the same. so we need more of these proofs of concepts. something like this one is brilliant.

im hoping that this tryplex will help people get started. i mean right now you kind of have to be a bit of hardcore computer programer to even use the kinect, but with time there will be single plugin and play solutions.

ok so its kind of hard to convince a dj to take apart his HDTV and make a multi-touch table, now we have the ipad but thats even hard to convince the dj to buy two ipads. i'm hoping once there are more kinect games people will start to embrace this type of interaction and start buying the kinect.

as it is right now the hacks are the only reason to buy the kinect cam in my humble opinion. nice one josh.

dust's picture
Re: Tryplex Kinect Toolkit

so this seems to work good for me. the qcOSC plugin has been notoriously flaky for me and the cause of most my osc crashes but seems to be running. i haven't got any crashes yet. so maybe they where all user error in the past.

(edit) opps spoke to soon.

i do however get this error. (see pic) it seems qcOSC thinks its still connected to an operation even if its not. changing the port number should clear up these kind of overflow binding issues. i know that will break most of your code but might be a nice addition to be able to change the port.

either way nice stuff.

im learning some skeleton based programing in my computer simulation modeling class. it seems it is really complicated to make a skeleton. 2 joints takes up like 4 to 5 boards to write out the solution. so to solve the equations for just 3 joints and two springs is pretty much impossible to write out on the board. so we have moved making the computer write the equations for us in a symbolic math package. once i get that figured out and converted to c code then i will share...

PreviewAttachmentSize
Screen shot 2011-03-03 at 9.57.32 AM.png
Screen shot 2011-03-03 at 9.57.32 AM.png28.91 KB

monobrau's picture
Re: Tryplex Kinect Toolkit

Yeah, this error bugs me as well. You can't have two of the same ports/compositions open with qcOSC at once (sounds logical though). Only resolution is quit&restart QC, or use the spooky send patch with the skeleton receiver and reroute it this way to multiple compositions in your workflow.

The stock osc receiver is somewhat limited but once OSCeleton will have a new version hopefully some things will get easier.

dust's picture
Re: Tryplex Kinect Toolkit

it seems OSCeleton is getting a lot of use by qcer's would be cool to have a float, float, float type of structure maybe and using some kind of numbers code for the joint names or something ? i had been using the other max / msp solution. the issue is you have to write all your code to the re-structure of osceleton so would defiantly be cool if it where integrated into osceleton.

monobrau's picture
Re: Tryplex Kinect Toolkit

There already is a quartz composer option/support in the latest osx version, but I found it not stable enough. They are working on a new version that will resolve these issues.

Check http://groups.google.com/group/osceleton

if you want to chip in on that discussion!

dust's picture
Re: Tryplex Kinect Toolkit

yeah have not tried the latest version. i got the unity patch working natively on the mac but its way buggy and crashes so i have been testing with osceleton. seems the guy at sensebloom has trouble testing on a mac.

dust's picture
Re: Tryplex Kinect Toolkit

yeah have not tried the latest version. i got the unity patch working natively on the mac but its way buggy and crashes so i have been testing with osceleton. seems the guy at sensebloom has trouble testing on a mac. ?

the tryplex thing is also missing the sculpt demo. i have a cl sculpt bulge type of patch all ready so its no big deal. gt posted that one day here on kineme seems to be turned into a k3d patch now understandably. maybe will post mine someday. still need to incorporate saving the models to file.

kimba23's picture
Re: Tryplex Kinect Toolkit

Thanks It is very nice! Just started playing with it. Great installation guide too! Can't wait for version 0.2 :D

monobrau's picture
Tryplex Kinect Toolkit update, synapse support

Hi everyone,

There's a new version of the tryplex toolkit online, now with Synapse support. Meaning that you won't need a 2 hour install and it's a lot easier to play around with Kinect skeleton tracking!

Check it out at: http://code.google.com/p/tryplex/

itsthejayj's picture
Re: Tryplex Kinect Toolkit update, synapse support

Excellent news! A fun sunday inside for me then :) Shame the Synapse QC plugin is 64bit only though. Means we can't use the ps3 camera alongside :(

EDIT: I'm found the qc source on the Synapse site, complied the QC plugin successfully in 32bit. Might be worth mentioning this in your documentation.

EDIT of the EDIT: You have mentioned this in the documentation, nice one

monobrau's picture
Re: Tryplex Kinect Toolkit update, synapse support

Just added a universal build of the Synapse QC plugin to the tryplex package!

BTW, could anyone confirm if it works with Lion?

coyne's picture
Re: Tryplex Kinect Toolkit update, synapse support

Hi!

Great news that you added support for synapse.

But when running the examples macros for synapse quartz breaks down and and it says that quartz composer quit unexpected while running the qcOSC pluging.

Cant get it to work. Anyone have any ideas?

And as i understand now you dont need the quartz pass through patch from max or do you?

best regards Niklas

monobrau's picture
Re: Tryplex Kinect Toolkit update, synapse support

Hi! Try running QC in 32-bit mode. There will be a new release of qcOSC soon, that will fix this issue.

coyne's picture
Re: Tryplex Kinect Toolkit update, synapse support

Thanks a lot monobrau.

now its working fine :)

regards niklas

monobrau's picture
Re: Tryplex Kinect Toolkit update, synapse support

qcOSC 0.6 is just released, with 64-bit support. You can get it over here:

http://hexler.net/software/qcosc

I also added it to the tryplex package.

dust's picture
Re: Tryplex Kinect Toolkit update, synapse support

open frameworks is great. defiantly will save you some time by using synapse with ofxOpenNi. as you don't need to install everything manually.

you say two hours to build openNi. thats fast. you must be negating the optional documentation and mono installs.

it took me two days to install opencv 2.3 with openNi and cuda 64bit gpu support. just upgrading mac ports takes forever...

i think if you don't use mac ports to install libusb and to do it manually will save you a bunch of time.

going to give tryplex another go.....

vkmentt's picture
Re: Tryplex Kinect Toolkit

hello, i'm new in quartz-composer. Please how can i make it work? from which patch do i have to start this? downloaded everything and i'm trying to use the swipe sample but can't do mutch. I'm using synapse, can anyone give me a light?

itsthejayj's picture
Re: Tryplex Kinect Toolkit

tryplex has some great documentation on there website on how to set things up http://code.google.com/p/tryplex/wiki/Installation and you should ask questions there.

The synapse route is a good easy start but once you get more experienced try the osceleton route its more efficient. Tryplex is a great learning platform for beginners with Kinect work, but tryplex is not the only one way to do all this quartz composer, I tend to use iterators with my osceleton work. Just to keep you keen check out what i do with QC, ableton, sera to the kinect, and some tryplex macros.

vkmentt's picture
Re: Tryplex Kinect Toolkit

thats awsome man, i want to get this knowledge. So i gonna intall celeton http://vimeo.com/21588304 and see what can i do. Thank you for the voice! cheers

itsthejayj's picture
Re: Tryplex Kinect Toolkit

Watch out bud, like I said synapse is a lot easier to setup and run. The QC work for oceleton and synapse is the same, everything you've just seen me do, can be done with synapse <> qc. Honestly setting up OPEN NI and such is a bit of a pain and i don't want you to get put off.

vkmentt's picture
Re: Tryplex Kinect Toolkit

hehehehehe yeah, i'm getting some difficulties. So installing the OSCeleton it is not like in this video?do i have to do all this steps?http://code.google.com/p/tryplex/wiki/Installation ... so if i can do it with Synapse, why when i open the sample compositions the skeleton doens't respond? the first exemple works fine, but not the others. Something is missing, would that be the qosc patch?

StuShapiro's picture
Re: Tryplex Kinect Toolkit

Can anyone help:

My synapse to QC was working perfectly. Suddenly It stopped working, not all together..

qcOSC is receiving data from synapse over the port 12345/7 Tryplex patch recognizes there is a user tracked but the data from the skeleton structure doesn't seem to change in qc. so a skeleton doesn't move.

Synapse is definitely sending information and QC is definitely recognizing there is a user tracked, but there is no joint information.

Today i installed Abelton live 9.01 and was testing the sending osc from synapse to it, this was working great. When i opened QC with it open, things havent worked since then.

  1. Can I run Abelton to receive joint information and QC at the same time? both feeding off synapse.

StuShapiro's picture
Re: Tryplex Kinect Toolkit

Solved this: SOLUTION.

Wifi was off. sending osc data needs the wifi on.

StuShapiro wrote:
Can anyone help:

My synapse to QC was working perfectly. Suddenly It stopped working, not all together..

qcOSC is receiving data from synapse over the port 12345/7 Tryplex patch recognizes there is a user tracked but the data from the skeleton structure doesn't seem to change in qc. so a skeleton doesn't move.

Synapse is definitely sending information and QC is definitely recognizing there is a user tracked, but there is no joint information.

Today i installed Abelton live 9.01 and was testing the sending osc from synapse to it, this was working great. When i opened QC with it open, things havent worked since then.

  1. Can I run Abelton to receive joint information and QC at the same time? both feeding off synapse.

S33KER's picture
Re: Tryplex Kinect Toolkit

hi try running quartz_passthrough and open it after running synapse ando before quartz composer