open cv

cv tools hand tracking (Composition by dust)

Author: dust
License: MIT
Date: 2011.06.20
Compatibility: 10.5, 10.6
Categories:
Required plugins:
cv tools

you can use this patch to hand track with cv tools. see the gestures pdf for pics of available postures. or refer to the handvu project http://www.movesinstitute.org/~kolsch/HandVu/HandVu.html for any additional info.

Kinect on OSX !

mfreakz's picture

Hi there, Here is a begining for all those who dream about integrate the new Microsoft Kinect camera in Quartz Composer project: http://www.maclife.com/article/news/xbox_kinect_modded_work_mac_os_x?utm...

Please, please... Developpers, jump into that project ! Then our comps could have:

  • Z-depth real time video, mapping, detection, etc...
  • A "Z Threshold" to increase OpenCV detection...
  • A good HD Webcam + a basic stéréo Microphone...

After the WiiMote Patch, the Kinect Patch should mobilise us !

Opencv examples missing parts

dunpeal's picture

Hello, I just installed opencv plugin and when i open sample comp. I get errors. Anybody know what these are ? Thanks

(null) : Patch with name "QCImageToOpenCVImage" is missing

Macro Patch Cannot create node of class "QCImageToOpenCVImage" and identifier "(null)"

(null) : Patch with name "OpenCVBGR2Gray" is missing

Macro Patch Cannot create node of class "OpenCVBGR2Gray" and identifier "(null)"

(null) : Patch with name "OpenCVCalcOpticalFlowPyrLK" is missing

Macro Patch Cannot create node of class "OpenCVCalcOpticalFlowPyrLK" and identifier "(null)"

(null) : Patch with name "OpenCVGoodFeaturesToTrack" is missing

Macro Patch Cannot create node of class "OpenCVGoodFeaturesToTrack" and identifier "(null)"

Macro Patch Cannot create connection from ["outputImage" @ "VideoInput_1"] to ["inputImage" @ "ImageToOpenCVImage_1"]

Macro Patch Cannot create connection from ["outputButton1" @ "Mouse_1"] to ["inputUseInputPointsSignal" @ "OpenCVCalcOpticalFlowPyrLK_1"]

Macro Patch Cannot create connection from ["outputImage" @ "OpenCVBGR2Gray_1"] to ["inputImage" @ "OpenCVCalcOpticalFlowPyrLK_1"]

Macro Patch Cannot create connection from ["outputPoints" @ "OpenCVCalcOpticalFlowPyrLK_1"] to ["inputPoints" @ "KinemeGLPointStructurePatch_1"]

Macro Patch Cannot create connection from ["outputImage" @ "OpenCVBGR2Gray_1"] to ["inputImage" @ "OpenCVGoodFeaturesToTrack_1"]

Macro Patch Cannot create connection from ["outputImage" @ "ImageToOpenCVImage_1"] to ["inputImage" @ "OpenCVBGR2Gray_1"]

Macro Patch Cannot create connection from ["outputPoints" @ "OpenCVGoodFeaturesToTrack_1"] to ["inputPoints" @ "OpenCVCalcOpticalFlowPyrLK_1"]

Macro Patch Cannot create connection from ["outputButton1" @ "Mouse_1"] to ["inputFindSignal" @ "OpenCVGoodFeaturesToTrack_1"]

(null) State restoration failed on

CV tools head tracking and rotations.

dust's picture

so here is a snow leopard composition where im using my trackball to infer rotation based on the haar classification system. im glad the haar patch is working woot woot.

if you align your head to be in the middle of the camera frame you will be able to control the 3d model much better with facial recognition. if you want the model to follow you around hook up the xy to the models position and offset the origins so the rotations don't get messed up. you can infer a pseudo z depth by interpolating the product of the width and height as well. its a bit jumpy so i tried to smooth things out.

actually this got me all excited that cv tools is working with snow leopard in 64. i'm actually re-building a haar kit for snow leopard. i guess open cv is still using carbon based methods which took a bit to figure out, i need to be using gcc+4.0 compiler not 4.2. so i got that sorted now i need to figure out how to get open mp running so i can compile a multi thread haar kit to take advantage of the core2duo+. maybe there is a way i can use open CL and the LLVM compiler to make a haar kit. i think that would be much faster.

anyways when i get a working kit finished or compiled for SL. i will share it so you can do rapid object detection and other recognition stuff other than just facial, maybe gender recognition, hand recognition. could be cool to take photos of everything in my house and build a iphone cv program to guide me through my house blindfolded, i guess i would need an iphone for that though.

anyways here is how you can use facial tracking to do rotations etc... there are other methods for doing this like using the distance between the eyes to calculate rotation as well.