XML record limit?

mlanghorst's picture

Hi,

I have made a composition that loads a QT movie, reads an XML with telemetry data and then the telemetry data is synced to the QT movie (based on timecode) and displayed over the video. The purpose is to overlay telemetry data over a camera mounted in a race car.

The telemetry data comes in every 1/100th of a second so over time the xml tends to get large (>500MB). I seem to run into a limit of around 10.000 records (with 9 data points each). If I go over 10.000 the data won't display and just below 10.000 it takes around 30 seconds to load. The data catches up nicely due to the link with the QT timecode but still.. It's bad.

Smaller files with around 5000 records work flawlessly and it will display the 1/100th data without a glitch.

So my next idea was to 'stream' the xml into QC but I gave up on that. Seems that QC can only read the file in it's entirety. Then I thought about using midi or osc but I am wondering if anyone knows how to make a XML file (with around 1 million records) into a midi/osc stream?

Solutions to overcome the QT XML record limit are welcome too of course.

Any help is appreciated.

Marco

volkerk's picture
Re: XML record limit?

you can try the structure from file patch. i was able to stream data close to realtime that way. you need to convert your xml first though, to a binary plist. the apple dev tools plist editor helps you doing that.