openCV with smoke?

jersmi's picture

i'd like to try to get OpenCV to capture a live feed and surround a tracked figure in smoke. thought of using kineme particles + accumulator for smoke. any thoughts? i'm modeling this idea from a vimeo clip by memo in which dancing figures are surrounded by fire-- it's so nice: http://www.vimeo.com/3047446

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

toneburst's picture
Re: openCV with smoke?

That video is mighty impressive. I think Memo is doing some quite fancy stuff with optical flow there though- there's a bit more to it than simply creating the fire effect itself.

Not to say you couldn't create something similar using other methods.

a|x

psonice's picture
Re: openCV with smoke?

I've done very similar stuff, using some feedback effects (mine was more like "surrounded by explosion" but smoke wouldn't be too hard to achieve).

I didn't use optical flow/open cv at all though, I just used basic motion detection (store a few frames in a queue, then compare pixel colours to detect changes - it needs a bit of tweaking, and perhaps a bit of blur to remove errors from video noise etc). Then when the figure moves, you have a rough outline of where the movement is, and you use that as a source or mask to add your effect.

jersmi's picture
Re: openCV with smoke?

Optical flow using OpenCV is what i'm thinking, using tracking to generate effects. Memo's fire video is impressive to me. it's a good target / point of departure. i recognize the level of skill / experience he brings to the table.

i'll try all of it-- queue + compare pixels + feedback-- thanks for the advice. i definitely have a learning curve with this one-- it'll be a little while until i see anything useful.

jersmi's picture
Re: openCV with smoke?

Btw, what i was thinking here appears to be a combination of these two ideas:

  1. Vade's port to QC of Andrew Benson's jitter optical flow patch (GPU HSFlow): http://vimeo.com/3951567

  2. Fluid solver: http://kineme.net/FeatureRequests/FluidSolverQC#comment-5867

leegrosbauer's picture
Re: openCV with smoke?

jersmi wrote:
Vade's port to QC of Andrew Benson's jitter optical flow patch
As seen over at the Create Digital Motion website > the plugin is now available for download > http://002.vade.info/?page_id=28

It's just lovely.

jersmi's picture
Re: openCV with smoke?

whoa. i'm looking forward to digging into vade's new stuff...