openCL

OpticalFlow_OpenCL_Movie_Feed (Composition by cybero)

Author: cybero
License: (unknown)
Date: 2010.06.06
Compatibility: 10.6
Categories:
Required plugins:
(none)

The composition is a fairly simple exploitation of an optical flow OpenCL kernel developed from the kernel code published @ [mrkbrz work and ported to QC.

Part of a growing raft of constructs exploiting the facility, textured & untextured to re-create video using OpenCL, upon and within mesh renders, and by various other means.

This construct dispenses with Meshes entirely, although use could be made of some sort of queued Image to Structure setup or another, similar construct to process the video feed say into a Particle Mesh render, re-creating the video feed presented.

This is the video feed before being filtered through the OpenCL kernel.

& this is the video feed after being filtered through the OpenCL kernel

See elsewhere in the Repository for the Particle Mesh variant.

It, OpticalFlow_OpenCLParticleMesh, is the pepper to the salt of this construct.

OpticalFlow_OpenCLParticleMesh (Composition by cybero)

Author: cybero
License: (unknown)
Date: 2010.06.06
Compatibility: 10.6
Categories:
Required plugins:
(none)

This is pretty much as the composition title states. This is an exploitation of an OpenCL Optical Flow kernel, the output of which is fed through a Particle Mesh macro and rendered as Meshes.

It is the pepper to the salt of OpticalFlow_OpenCL_Movie_Feed.

The composition switches between Billboard rendering of the Optical Flow and then to the Particle Mesh rendering of that filtered video stream.

OpenCL Convertor | Particle Video Visualizer | W I P

cybero's picture

Little has been spoken of the proper use of the OpenCL convertor, which is hardly surprising as it hardly seems to recognise some OpenCL streams at all :-).

Essentially it is meant to convert an OpenCL structure into an image and it can do a pretty good job of dealing with video and streamed movies too.

This is a bit of a tangent to my creating some really effective OpenCL Optical Flow kernel based constructs. That is definitely a work in progress.

This little beauty shows how the Colours structure can be turned into a representation of the video [Coil.mov - online version]. There actually is more variation amongst the other structure members than this grab gives lie to :-) .

The other OpenCL structures also yield graphically renderable information, chromatic and movement. Note the image output from the Convertor patch. The other two Convertors output the rainbow background and the texture grid.

Put together, they make for a rather graceful visualizer, albeit a slow vehicle fps wise, which I don't find matters too much, especially as feeding the audio peak to the movie rate [Asynchronous mode] keeps the whole moving structure synced to the audio throughput.

Still it would be nice to find an even more effective fps capable kernel based construct.

Graphics Driver message

cybero's picture
19/05/2010 09:52:58   kernel   The graphics driver has detected a corruption in its command stream.

was the error message that came after a QC crash whilst creating GL Tool structures and co-existing Mesh structures from, essentially the same array .

preceded by messages about

19/05/2010 09:52:58   Quartz Composer[29602]   *** __NSAutoreleaseNoPool(): Object 0x147173360 of class NSCFArray autoreleased with no pool in place - just leaking

Got an idea as to what is precipitating that message, but haven't ever achieved that deeper degree of graphical trouble before now from a previously AOK composition.

t-linked + cybero mixdown + music visualizers

cybero's picture

A] - a mixdown of the Audio Tools synced offline rendering of the examples posted @ t-linked.com, with the kind permission of their author, Pascal Lesport.

t-linked + cybero mixdown - mini showreel from cybero on Vimeo.

With the kind permission of Pascal Lesport, the original author of some fine OpenCL examples to be found @ t-linked.com , a fresh mixdown of some of the examples posted.

Expect a posting of the visualizer versions of these Audio Tools based compositions soon.

Those files have been partially re-configured to suit an Audio Tools installation, although the original t-linked OpenCL & GLSL have been left , essentially, intact.

The compositions are audio synced to the mixdown tracks that also affect the resulting rotations, transformations, positions and other dynamic parameters, drawing into meshes and GLSL grids , sometimes with a static DAE input, otherwise with an OpenCL Particle output.

What really distinguishes these OpenCL compositions is that they employ a combination of Supersampling and Feedback to further change the rendered result of the OpenCL kernel, the output of which kernel has already been affected by the peak and spectrum [low, mid, high] data retrieved by Audio Tools from Kineme.

Offline rendered in Quartz Crystal to the tunes that they were set to. Resynced and output from GarageBand, wherein the original midid transcripts and loop mixes were created.

still being processed at the time of writing

B] - a set of re-drafted and protocolised for iTunes set of QC visualizers, employing the OpenCL & GLSL within the t-linked examples, as well as other components built in by yours truly :-).

Download link ----> [t-linked+cybero](http://cybero.co.uk/OpenCLOnline/t-linked-opencl plus-cybero.zip)