kinect three-d fluid mesh painting (Composition by dust)

Author: dust
License: MIT
Date: 2010.12.01
Compatibility: 10.6
Categories:
Required plugins:
(none)

so here i'm using kineme 3d, kinect, open cl, ci, centroid tracking and few other technologies to paint in three-d.

;)

PreviewAttachmentSize
fluidHeight2.qtz3.84 MB

boya's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

Hi Dust. Kind of you to share. I just had a hd crash and had to rebuild.

Could you tell me what plugs I am missing to run this?

PreviewAttachmentSize
QC message.txt3.55 KB

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

last year almost to date i had my main backup external time machine and my internal hd go down over christmas break last year. it was painful but it comes down to what the data is worth to you to retrieve sometimes. its really just drive companies pushing hd capacity for cheaper which is ultimately ruining the quality of consumer storage. its sad, its only happened to me that one time. have seen it happen to many others so i feel your pain.

from your log it looks like you only need PixelSPlugIn i'm attaching it. http://www.oostrik.net/

PreviewAttachmentSize
Image PixelS.plugin.zip14.3 KB

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

here is another one. just imagine its a beautiful chick dancing in front of the vj booth instead of me jumping around. added audio input from the ipad ims-20 synth.

boya's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

Panfull yes, but somehow refreshing! I´ve got most of it backed, but it is in bits, and I want to take care not to move buggy stuff back with a restore.

Thanks!

mattgolsen's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

You should definitely check out Dropbox, I use it with a colleague to work on QC stuff, and it does file versioning. Really nice solution you don't have to poke and prode.

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

i have drop box. just don't have many people to collaborate with.

jrs's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

did you write the music? its nice

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

(edit) man the ipad makes me sound dumb when i type. i just erased my whole comment. to answer your question yes i made that song with the ims-20 synth by korg on the i pad. although the drums are sequenced into a 16 bar loop i played the bass line with xy kaos right pad set to i think d minor pentatonic scale or something. i like this box scale as i use to riff with the guitar all the time. had to use the second kaos pads xy to modulate frequencies and adjust cutt off resonance etc.. otherwise it wouldn't sound like a dubstep tune and would have sounded more like someone trying to play a nintendo song in a funk blues key.

mischaub's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

Hi Dust I am very impressed with your lovely work. I am new to QC and have just installed a kinect controller (which works great) and now I try to get your fluidHeight2,qtz up and running. I have installed the 3D-Plugin required, but this did not help. Is there any magic hattrick involved I should know about to start your composition? Strangely enough my kinect controller is recognized within the standard kinect-composition but not in yours. Any help would be highly welcome!

But I have another question: Do you see any hope of using a kinect controller as a design-interface for the visitors of an exhibition. These should be able to design models of 3D inflatables through their gestures and these blobby models should be stored in some kind of CAD-compatible 3D format, so that we could run these shapes through Rhino3D and terraflat to get and cut the patterns for welding them together from plastic sheets.

Whatever - you are the greatest!

Mischa

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

well the kinect is supposedly accurate down to the centimeter as far as depth is concerned. i have yet to break out my meter stick but i would say yes....

the kinect could work both in a collaborative display setting for an expo, letting participants sort of design there own inflatable based on some sort of preset patterns but equally it could be used as a rapid prototyping device enabling you to sort of scan or clone a physical 3d object to be machined out on site for fabrication testing or what not. to what precision i'm uncertain. i suppose it all depends on the contextual relevance.

lets say your making inflatables that will be use on the moon to shield people from the elements. i would think in this context you might want to use something other than xbox camera to make sure the structural integrity is sound enough for this type of use.

there are lots of possibilities with this technology. me and the other kinect hackers have really only begun to scratch the surface of what could be done with this technology for both aeronautics, robotics, industrial design, art etc...

here i'm posting all the plugins needed for this composition. place "Image PixelS" inside ~/Library/Graphics/Quartz Composer Plug-Ins. and place "GLTools", "KinectTools" and "Kineme3D" inside your ~/Library/Graphics/Quartz Composer Patches folder.

if you don't have these folders in either your root library or home library make them. (see pic) its best to keep them in you home library but i don't think these plugins will cause any issues in your hd root library.

qc doesn't really have any modeling export features but its possible to save your mesh structures down to file which can be later called back up.

kineme 3d i believe supports dxf format so certainly using a cad model inside qc as a starting point isn't an issue.

send me message we can more about this if you like.

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

the plugin you need. see comment below for instructions. if you got your kinect running then these plugs all go where the kinect plug is except pixelS goes in your plug-ins not patches folder.

PreviewAttachmentSize
PlugIns.zip12.07 MB

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

this uses open cl kernels as well so you will need a snow leopard machine with a nvidia graphics card 9600m or something like that or better to be able to view. my 9600m will render this but it hangs up sometimes. should be able to go full res with with this file on on macpro quad+ or hackintosh with better graphics card.

mischaub's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

Hi Dust This was quick and works flawlessly now. Congratulations! Could you come over to Switzerland rather soon for workshop? Send me a letter to mischa.schaub@hyperwerk.ch, please, then we could discuss the details involved.

Kind regards

Mischa

mischaub's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

I am really interested in something along these lines: http://www.designinterface.jp/projects/balloon/balloon.mov Could you imagine something similar might be done with kinect? Just as a starting point... Greetings Mischa

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

i don't see why not. i will be in los angeles working on a studio project until jan 10th. actually will be in geneva for a week or two a few months after with a professor of mine.

so the soonest travel date i'm guessing would be late january early february ? don't know if that works for you ? i will send an email etc...

i'm working on my email formalities and etiquette . i'm really bad with formal email correspondence thats why i gave my school email as i check that more often.

just let me know what kind of letter you need. formal or informal, reference cv etc...

dust's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

(edit disregard all this rant as i'm talking about v3 not v2 which is the patch i uploaded. got love kineme repository though. i don't know about anyone else but my patches change over time so its nice that i can revisit kineme and download a template idea i had at one point. maybe its just me as my filling re-visioning updating system is still in my head so i loose track of patches all the time. )

good you got this running. someone else pointed out to me that an ni blur is needed. i'm sorry about this. ni is plugin making system for AE but they ship image units that quartz composer can access.

i say i'm sorry because ni licensing is strange so i normally try not to use ni even though there wonderful plugs, but like i said distribution licensing is strict etc... although i think the blur i used is part of fx factory which is free so you can download and install in your plugin folder image unit directory.

vade works for them and helps the community out a lot. so i don't really want to grip about how you cant use an ni plug commercially which seems to defeat the whole purpose of making program that lets you create plugin you cant sell.

so with that stated i'm sorry if you get this error. ignore it and a download a v002 blur or replace with your own blur as its only to smooth out the occlusion mask.

i hope that doesn't sound like i'm being an ass in reference to ni, this is my understanding of how ni works from prior threads pertaining to bundling ni with a quartz builder app for instance.

i may be wrong as maybe you can make plugins that you can do commercial work with using fx factory but rendered using the host like AE ?.

either way its pretty sweet program and i got the free version and am giving this patch away so it doesn't really apply here other than you may get an exception telling you something like ni blur not found.

so i'm just apologizing for that, although i'm kind of assuming that if have a kinect and are looking at 3d fluid mesh simulation code you would have all ready discovered ni goodness and it would be on your system all ready.

i will download this as this patch has changed since i uploaded and see if i can replace with a stock cheap blur.

ramona777's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

Hey I'd love to play around with this,

Added the Image PixelS plugin but it still says it's missing, tried putting it in Library->graphics->qCpatches and also QCplugins. My Kinect tools is in QCPatches folder.

Any thoughts please?

adsrowe's picture
Re: kinect three-d fluid mesh painting (Composition by dust)

Hi Dust,

Sorry to bother you. Im pretty (very) new to QC, and ive been trying to get the kinekt set up. I have installed the plugins you have added here, is there something else I am missing??

My kinekt is plugged in but it is just flashing, and the patches say it isnt connected.

Im assuming i'm doing something really dumb???

Any help would be really appreciated.

Many Thanks,

Ads