Dynamically identify and track moving objects (edges and/or x/y coordinates)?
Dear Kineme addicts,
I'm so glad I found this forum. I have spent a few hours browsing and already learned a lot.
I am a tree hugger working on magnifying nature experiences through art. I am currently working on an interactive forest floor, inspired by Avatar and Perilin, the Night Forest (Neverending Story). Basically, I want the forest floor to react to entering visitors in beautiful visual ways: Through light waves, light animals, etc.
I have been able to hoist my projector and Kinect 40ft into trees, import the depth image from Kinect into QC with Synapse, and play a bit with simple effects (City Lights.qtz). Fun already. But:
Right now, my bottleneck is turning the movement of my visitors (depth image) into beautiful visuals. I'm thinking of light waves on the forest floor that get brighter / more intense (amplitude) as you walk through it. Or of light bugs/fairies that dance in a safe distance from the person trampling through. Or waves that originate from the visitor like drops falling into water. Either way, it seems I need to:
1) Find or develop patches that dynamically identify multiple (bright) objects from an image on-the-go (i.e. no "reset" necessary) and simplify them to a format that other visual patches can use (x/y coordinates or edges).
2) Find or develop patches that turn such extracted data into 1) waves 2) animals 3) drops or any other visuals that pop up in your mind as you read this.
Fact is, I desperately need some guidance. I have browsed a few forums but remain in the dark regarding the distance of the learning path - in particular I don't know what has been done already. I may even be lacking the vocabulary to search. I found Kineme/OpenCV motion tracking, but it looks like it needs to reset every time ("Good points to track"). But I want to have this thing going for hours on its own. As a programmer (WAMP/R), I also feel there are hundreds of potential solutions / awesome-looking ideas out there but I haven't learned the language to identify and find them.
So here's my question: What would you want to appear on a forest floor as you walk through it - and how would you try to go for it, given your knowledge on existing patches? I may dive into xCode, but that will be a loooong journey.
If it's good, I'm happy to come over to your side of the woods for a night-time installation :)
P.S.: I also have different-colored strong laser pointers that a camera can track. How do I "burn" these patterns into the forest floor with QC? :)
More like this