Uhm. I'm really interested in trying it... saw it pop up last night and almost decided to stay up messing with it.
I loved the web to image plugin that was floating around, and this will seemingly add some function... for some reason I'm dubious about the swf thing, but hey, I will be happy...
On a side note... I thought it was kind of interesting for duder to put a link to his plugin page and then require registration to get the plugin. Don't get me wrong... you have to register to get beta stuff here, but it's not like Chris dive bomb's the list on every update to drum up members either. I've been on some other lists where the fella would have gotten ruthlessly called out as a spammer on principal (even though I don't think that was the intention).
That's why one of my email addresses is just for forums. ;) Dudes and corps alike just can't help themselves. I've read online newsletter marketing directives that claim customers forget who you are unless you email at least every fortnight.
I remember seeing the previous US Administration every day – doesn't mean I was buying their bs.
not till now, seems to work with the example posted, i tried with my joomla site. it just renders the site im not sure if there is any inherent flash interactivity work but its a great idea sort of going the reverse approach to using webkit inside quartz composer. i can see all kinds of fun things happening with this plugin. the first thing im going to do is put my website underwater.
usefuldesign.au wrote: Dudes and corps alike just can't help themselves.
to our defense, we don't use the email addresses we get unless we need to contact someone for clarification on a bug and sending custom builds. We reciprocate by providing email addresses at the bottom of each page (info@kineme.net actually goes directly to myself, smokris, and another person), so it's not like we're harvesting info without returning it.
Also, for us it's a simple test to see who's human and who's not. We've had so few spam-posters that I can count them on 2 hands (and possibly 1?). That save smokris and I a ton of time (otherwise we'd have to moderate, or babysit a moderation plugin etc). So in this case, it actually is to provide better service/lower overhead (and all the other TCO buzzwords people fling about ;)
(I don't think you were suggesting that we abuse it, but that people/companies in general have a tendency to do so -- on that point we don't disagree at all ;)
To clarify (guess I'm going to have to try it myself though)... you aren't seeing swf files on your website, just with the example swf? Hmmm. I'm hoping this adds swf via web, without having to do any safety stuff, or else it's just duplicate function of the web-to-image plug.
Time to stop yapping and actually try it I guess...
edit-
Been trying it. Got some kind of glitchy text bottom of screen on the default web url on the test, but it disappeared by the time I tried to take a screen shot.
The scroll thing seems a little fussy, but then again, I'm really used to using a modified version of "pdf zoom" with web-to-image for this stuff... which I feel is less fluttery as far as control of the page goes, but it's probably more that it's what I'm used to.... nah... this scroll thing is driving me crazy actually :) When I want to hover over an area, the page moves away from me! Yoinks.
It doesn't line up stuff quite correctly... check out www.beastieboys.com . The part that says "36 remastered tracks" lays over the menu tabs, which doesn't happen in Safari (or browsers in general). On a BIG plus, it is getting audio, which is WILD.
Yeah, I get that image glitch out on a few pages... I get it on the CoGe website and Youtube. You basically see remnants of the image that is directly the the left, laying over the image to the right. Kind of like when your old NES cartridges would get dusty, and you would try to blow them out to make them look right.
flosc works with upd etc... or flash open sound control... i don't actually use vdmx its something else i have to learn, i thought resolume avenue supported quartz composer with its gpu rendering but it dosent i guess vdmx is the best choice for a qc host ? ? ?
not sure if you know about this its in alpha right now its some sort of cloud based online flash node binding stuff but has some awesome links to flash 3d projects etc... could be useful. if you figure out how to get an invite please invite me. i guess i got to twitter no way getting around it. he says he has finished but cant create an account. so don't bother filling out the form the guy dosent email you any confirmation trust i have tried ten times but the project still excites me, i used to love flash now it qc love but looks like the two will have things in common soon.
the hover thing is a bit wierd. at first i thought my actual hover settings got messed up cause its crazy large the hover zone set up with this plugin. i use like 1/4 inch hover scroll on my system, not to detract from this plugin because there is lots more investigation to be done, but how are you doing this thing with a pdf george? i have seen the url to string patch from kineme but where to you find the web to image patch.
i installed the nightly build of webkit to see if that makes any difference not sure yet going to check the plugin out. here is kineme's site underwater with refraction spheres.
I have some setup where I use an image transform, but also change the pixel size of the web image, to effect a solid scroll when you "grab" the screen, but there was some kind of math I had to pull off with the web to image plugin pixel values to make it work right. It's on an HD that has a kind of crappy power supply connection, that I haven't sat down and backed everything up off of yet.... I start backing up and it loses power, etc...
Correct. not pointing the finger at Kineme. Opposite. That's why you have my higher level email address(s) for notifications, not my 50%-spam email address ;)
Guess that makes Kineme !== a dude or a corp according to my venn diagram?!
I took the source and re-arranged things, fixed some bugs, Optimized the hell OpenGl pipeline and made a multithreaded renderer out of it.
You can now have 2 to 3x faster rendering. I gave the code back to Tamas, who is going to do some more things with it.
I found another potential candidate framework based on googles Chromium branch of webkit, called Awesomium, which is made to do off screen rendering. It has some niceties like easy to use handles for passing in mouse/keyboard events as well as a rendering callback so you dont have to spit out an image every frame, which really optimizes the hell out of it. Unfortunately it requires a static library of the new Chromium webkit/webcore, but it is very fast, and supports some important gotchas like not making pop up windows come out of no-where (it traps them back to your main offscreen drawing destination).
Only issue is Flash support under OS X is currently dinky. I have it running as a plugin and its fast, and you can interact with pages and actually browse, but its touchy and a tad crashy.
Anyway, I think its good to have options, here is the new improved Coge webkit my changes, should see a HUGE perf difference:
would it be possible to post the source? I could try integrating some of the incomplete event handling stuff I had in our unreleased webkit plugin if I have some downtime/idle curiosity.
Interval Since Last Report: 101988 sec
Crashes Since Last Report: 12
Per-App Interval Since Last Report: 147627 sec
Per-App Crashes Since Last Report: 3
Date/Time: 2009-07-03 23:52:43.431 +0100
OS Version: Mac OS X 10.5.7 (9J61)
Report Version: 6
Anonymous UUID: A448D6B6-1825-4642-9516-2096E412390D
For plain vanilla HTML & CSS - excellent. Definitely faster scrolling, loves the might mouse input even more than coge's brilliant original. Could one get some of the event driven interface therein, I wonder. Does seem to render some sites, a little lopped off. I'm definitely in favour of publishing the width and height options. Can help with the loading of some pages.
way to go vade seems more responsive. i fixed the scroller if anybody cares. smoothed it out tweaked it a bit. the hover is better now, for some reason the example had the page going down when you hovered up ???? hope this is useful.
I am pretty sure this is the result of loading a Flash page, specifically - Platonic Solids. Nothing wrong as such with the page loaded at all, beautiful work actually.
The report is exactly the same as previously posted, bar the time it happened.
Of course :) Tomas made the source CC-NC-AT-SA 3.0, just so we are all on the same page :)
I would actually suggest (and suggested to Tomas) that there be a SVN for these if everyone is going to branch/fork it. Im actually in the process of setting up a public repo for the v002 plugins as well.. maybe it could live there but that strikes me as being a bit presumptuous on my part.
Anyway, I do feel a bit odd putting this out there as developers like to kind of put out complete and finished things on their own, but, the cats kind of out of the bag. I hope Tomas does not mind me posting it here. I know personally I might feel a bit weird about it.
I actually was going to work on adding in NSEvent support, and using freeboard to capture keypresses into an NSevent to the Webview. Chris do you mind holing off a bit on that?
In the code Ive implemented as much OpenGL optimization as I could, but there are a few things I started to set up that I did not finish, one of which was proper texture range support, as well as glFinishObject/double buffering texture submission support.
Ill also throw up a beta of v002 Awesomium soon, once I work a few other things out... its pretty cool, but I think I found the achilles heel of that framework, it does not load Java plugins at all, so no processing. Fuck!
Indeed, there definitely is something off with flash somewhere. Its certainly not a 1.0 and needs some work. Flash stuff can be tricky because sometimes it wants its own window, or even OpenGL context, according to the Netscape Plugins API docs.
This is one thing Awesomium does nicely, it handles edge cases for certain plugins and makes sure it sets the appropriate NP Plugin flags so things work. Unfortunately for now Awesomium on Mac OS X has some limitations, but im talking to the developer to get help get around them.
So you tried to quick look the QC composition that had CogeWebView? I did not think Quicklook let you preview private/3rd party patches? Unless this is that Kineme Plugin letting it load the 3rd party plugins sans safe mode. I dunno, im going to shrug on this one :)
Actually I didn't try to QuickLook the QC composition that had CogeWebView.
This was simply what resulted when , if I recall correctly, closing down QC with no file actually open, after viewing a web page with Flash content in pagescroll example, sorry, multi-touch version.
Could be 3rd party sans safe mode issue, as you speculated, I will reinstall the plugin and look into that.
Ive hacked the basics of mouse input but it seems to actually expose some issues in how the offscreen rendering works. Form controls like pop ups seem to break the capturing "context". Im going to have to do a lot of investigating on this one....
okay, we just implemented some new features with vade, there is 2 ways to gets mouse interacts, supporting transparency in flash content, etc. Hope the finish is close ;)
ok so i have had a little time to mess this plug_in a bit. thinking i will stop by mr .lov's site to report back some issues i found.
so first off i'm really happy with the plug_in and look forward to any future updates.
i have only done a few tests but before i get to the slight quirks the java script functionality seems to be woking superb and echoing any values i change at least as far as i have tested with dashcode. i like the html source as text. although i haven't tried this yet but i imagine being able to grep through web source's to automate or identify element ID's that can be used as input.
there seems to be lots of cool possibilities. i like the image downloading. i can imagine all kinds of cool apps to help people out that can be made with a plugin like this. i mean you could combine webkit with the apple script plug i made and do some sort of itunes album art finder ?
ok some of the quirkiness. i'm going to test with a swf file so i can not report other than youtube and hulu work better in the coge webkit than youtube does in google chrome. thats so weird like google doesn't work well with google.
so an added feature that seems a must have is text field input. im sure there is easy way to populate fields with a javascript so thats not to much of an issue but. still it is a bit wierd to have a cursor show and not be able to input directly. so i realize there is the webkit view that enables this. which is cool but i don't really like it. i mean yeah its cool to have an external view open from qc view which makes me think there is all kinds of cool integration that could be done in a plug-in context i guess for people that know how to do those things.
to me its about using the plug in QC, if i wanted a web view i would open up interface builder and drop a web view add a few buttons and done. i mean its like ok in interface builder you can build a simple browser in five min's without code. thats pretty cool but now you can do it in 5 seconds with Coge webkit.
well i take that back. sorry. i'm not sure what i'm doing wrong but you can not drag this plug_in to your editor from the patch creator and make it work. thats a little messed up. i could understand if it where a template like quartz builder template that is needed for external app but out of all the bugs im pretty sure being able to drag and drop from the patch creator is essential.
or at least directions on how to make it work from scratch. try it maybe its just my system ?
however the provided examples work fine. but when i try to replicate simple web browser as in adding a billboard to the webkit plugin it from the patch creator is a no go for me. i can upload a file set up the same as the example patch and there is no image. so not sure but there didn't seem to be any sort of protocol conformity or any thing. i just like to be able to make things from blank.
ok so thats it. for now. i am real excited. i just turned my multi-touch table into giant iphone(like) multi-touch full screen web browser. wicked. last webkit released inspired me to build my web-site. well my database migration didn't go as planed so now its time to rebuild. so thats inspiring.
oh yeah awesome java in QC without JNI components which seem to be out depreciated now or something. maybe java is just transparent now with java cocoa bridge just like python objc is in snow leopard. don't know will have to investigate.
i guess another thing is mr .lov if your reading this is that repository code doesn't run as its missing its pbx build files or something. i just wanted to hide your web view as i would rather have QC suppress a pop up or glitch out than to have a broken web view pop up when browsing a f!#%^ up site. i know thats a tuff one is people always find a way to pop behind or under over what ever so im not expecting .lov to add suppression. i mean if Microsoft and apple can't block all pops with all the money in the wold then im defiantly not expecting coge to do it. although i think if i could either hide or take out the web view all together QC seems to do an all right job as in it glitches out with pop ups and glitches are cool.
but yeah your your repository is missing some dependencies but at least there is code in it now as of last month it was empty. i was able to build fine by dropping in another project but there is some error that makes it not work once in qc . something to do with the cgl-ctx. which is beyond me as i'm having a hard time binding CA OpenGL Layer context to a QC Open GL context. but would be nice if your open your sourcing the project on google to be able to build the plugin so inquisitive minds like myself are able to study your and vade's code.
as you and vade are very talented but there is no use studying something that isn't the current build. maybe it is the current and im just being daft. the wierd thing is that i tried making a project called "CogeWebkit" and added your source and i get all kinds of errors now when i make a project QCWebkit and add your source and change the plugin implementation and interface names it builds without error's but doesn't work in QC.
the wierd thing is when i changed the name to QCWebkit and built it the CogeWebkit stopped working. Now I know from vades docs on his ofx qc plugin that i really want to build as well but yeah something is missing in that repository as well you can't have two plugin with the same class names ? interesting out of all the QC plugins there is namespace collisions ? I mean when I change the plugin class of webkit i still get name space collision even after changing the plugin implementation. so this means the other class files need to be unique as well. its weird i could have sworn i have used the same sub class in a plug ? maybe different for subclass.
but yeah those are some of initial thoughts. so i must say much .lov very inspiring and major improvement. i hope you don't take any of this comments as critique as this a very exciting plug_in.
Sorry for the quick answer, i don't have too much time yet.
The text field thing: yep, we want to do the magic, and sometimes its worked, but actually not found a solution which works stable, and i didn't want to spend more time to this thing only, because beta1 didn't worked on 10.6.
drag, replicate: works fine for me. Are there any interesting cogewebkit related console messages when you trying the drag or the replicate?
pbx: yeah, thanks for the point, i missed it. The reposity updated, check it ;)
(anyway, we used sourceforge.net before goggle code, search sourceforge for cogewebkit)
yeah i remember the source forge i went there one day to see if i could just your plug_in for my machine. i was wrong. thanks for updating the google code. i want to study the code so i can see how integrate different contexts inside a qc plugin.
looks like you forgot a semi colon when you where defining your in/ouputs. that easy enough to track down. i found qc plugins for me seem to run better with undefined dictionary attributes for in/out ports. meaning by using the
@property(assign)NSString* inputFoo;
and then not declaring any default attributes in the implementation usually gives me less errors. when im trying to build a plug-in. but then again no errors doesn't mean that its all good. cocoa assumes you know what you are doing which i don't although i like to think i do. i just pick things up on need to know basis but am interested in seeing how to off screen render via qc plugin, where apples offline render is maybe off screen but not the right code to be looking at to figure out off screen rendering etc...
so here im attaching a qtz its my test file from blank comp. black screen not sure what im doing wrong but im going to run one of your examples with xcode open and see if i see anything different.
thanks a bunch man this is really a great improvement. as per the onfocus input boxes and stuff that's all ready possible if you know the element ID your looking for. as in getElementById("search").value = "a qc string" works fine. i mean i would be using your plug_in for my website where i use moo fx js ext mysql php and joomla etc.. so im sure i can make a local browser for my own purposes.
but yeah you gots to keep some things magic i guess. or at least where a mask if you giving away the secrets so the other magicians don't turn you into a frog.
.lov, the site was actually an old exhibition site and that is still not working , although vimeo Flash is now working and in that previous session, .mov files [at another location online] were working, but they aren't now and Flash files are working AOK at present, but weren't on vimeo in that previous coge browser session.
Furthermore , the crashing site is trying to force a scripted window open manoeuvre & that doesn't go down too well, [does it :-)].
so what's happened to .mov support ? or is the problem client side?
The messages are not error messages, it's just log messages helping me on debug - so everything works as excepted. The blank composition is your fault (its not an offense or something bad:) ) - you using QC units for the Width/Height parameter, not in Pixels. Please re-check the attached examples with the plugin :)
The exhibition site url does work as a separate URL, it does for me and .swf elsewhere also works .
The crash reported previously was the result of .js asking to open a controlled browser window and QC doesn't spawn new windows [as yet] and allow for that kind of DOM referenced control to that extent which is why it is not All OK [AOK].
It would have spat its dummy out with or without Flash
Vimeo didn't seem to work in first session, but did thereafter as does Flash.
BTW, the .js browser window DOM based controls work AOK in your blank webkit example once the sizing issues are addressed in pixels not QC units, and that URL still crashes the Simple Browser example when called for by the enter link.
oh man i'm so daft i was using units not pixels. what a freaking idiot i am. yeah this thing works blank from a blank. yeah disregard half of my edit as i'm a bit ignorant. been working on getting a multi-touch table + iphone card game going for monday. my kid wakes up just as i'm going to sleep. i'm a bit fried right now. its like i'm saying i don't want pop up webkit view.
your guys magic fooled me as i have been running full screen with a hidden mouse. messing around on youtube with multi-touch inertia scrolling and other gestures which are all working fine on my table. i thought my left button click was working now i feel stupid for not reading the links i was clicking as my mouse is off screen somewhere clicking on some other random bull sh1t.
yeah damn this is cool i have had this same transparent idea to get multi-touch into apps that don't take it. brilliant. i think i'm going to have to do some java scriptscript to send my clicks though as im not using a mouse.
but yeah now that i see whats going its totally possible to get the cursor input to the qcview you just need an extra webkit view. meaning if you change the alpha of your webkit view to 0 and your pop is visible your getting cursor input but you can't see the web page as your using the webkit view to render the page.
just open your nib go to the core imaging setting of your content view get rid of the non transparent stuff then set the core imaging view to alpha 0 then run the plugin and pop up the webkit view you won't see anything but you will have text input you can't see because you need additional webkit to render and send to qc. then you will basically have a web kit view in a qc view but your not clicking the qc view ???
its the same principle of what your doing right now you just need another view. or at least it seems like it would work to me but then again im an idot and confused units for pixels and though i was left clicking just because i was jumping to another page.
i have been on the coge site clicking because my blobs highlight the buttons now i have a bunch coge website elements on my desktop from the mous im not using drag and dropping stuff that is invisible. haha.
sorry im daft sometimes. still a wicked plugin. in theory i think all you need is an additional webkit view to render to qc.
yeah, the popup windows screw up all the things just like pop-up buttons. We found a way to stop the pop-up screw up thing, but not working anymore - don't know why, maybe a sytem update cause this issue.
The .mov thing looks like a threading issue.
sidenote: Hmm, our experience: working with WebKit == Odd. Looks like the workflow different on 10.5 and 10.6.
yeah its not your english my friend, its my poor explantation as i was pretty sleep deprived the day i wrote that. i spent some time messing with the plug-in and thought that it might be possible to have a transparent webkit on top of the qc viewer taking in events that are displayed in the qc viewer like input fields and what not. i have done a little tinkering and maybe thats not the solution. i will report back once i get some time got to run to the lab.
I've never, ever seen errors with properly programmed plugins with input port dictionary attributes. Not to be an ass, but this tells me something is going wrong somewhere in your code. If this is an issue with CogeWebKit, I will admit to not looking at it for some time, since I added threaded rendering to it. :\
no issues with the webkit as per data type declarations and default values. i just find it faster to not use the dictionary defaults while building. obviously no one does this but apples default x-code template does say its optional to declare defaults.
your not being an ass, as not declaring defaults can actually cause more problems if your using virtual inputs in the quartz file that goes along with the plugin. although when using splitters with declared data types in a quartz file that correspond to your property settings, things seems to work smoother for me.
i have only been messing with QC for a little over a year now and just started messing with plugins this summer. so i'm still a noob talking out of my ass.
actually distributing a plugin without defaults i don't think is a good idea as there would be more of a chance of breaking the plugin but while building a plugin it seems to be quicker work flow for me.
i made a slight change to the source nib of webkit2 beta. basically on launch the cogee webkit view gets launched but to the back window layer. so basically the offscreen render is on screen but at the back or first layer. so with my apple script plugin you basically tell the webkit window to select and click the back webkit view indexed window 1 and it updates the cogee webkit view in quartz. so you can browse the internet in quartz composer. here is plugin and simple qc browser. im thinking of doing the same sort of gui script for the typing via universal access. the script works best at first launch. this works with cogee beta 2 if you launch the webkit view manually and then send to the back of the qcview. i was going to add another offscreen render so i could render transparent webkit on top of the qc view. i don't know apple script that well so im sure this can be done with a minimized view as well.
yeah i'm sure there are a few other ways to do this. this way works inside QC but would need to change a bit for xcode or QB build. didn't do anything to your mouse events inside the plugin. so even if the cogee view isn't enabled you get mouse events. i could swear when i first tried the plugin clicking things was working.
i just have a different build on my system now, got to make another one and change all your class names so i can have 2 versions of the plugin on my system so i can override the mouse events with multi-touch events and hopefully get the same functionality encapsulated in one plugin. don't know what that means, but im sure this can all be done in cocoa if not java script as well.
im almost done mapping the keyboard to the universal access keyboard. actually doing the same thing as with he apple script passing in xy and select clicking by those positions the keyboard viewer. i figure if i map everything to the keyboard viewer and iterate through my touches it could act as pseudo multi-touch keyboard like on the iPhone. plus it will be very easy to switch languages using the the keyboard viewer.
i got to do more of that. i was reading the other day that its good practice to tag your NSStrings with some sort of localization command which i forget now but thats supposed to make it easy to add different languages etc.. which i have never done, or at least make it easier for someone to reverse engineer into different language which isn't really of concern as you have open repository but all the same maybe its a good practice i should start doing.
all the same i have studied your plugin, still not sure what your private cogee data format is NSBitmap ? So i appreciate you opening source as now I can see clearly how to grab things from different contexts and put into QC. i thought contexts where supposed to be sort of universal or interchangeable but i thought wrong so at least this shows how i can get any application that runs in a view to render to qc although i would think that doing some sort of context cast would be faster than off screen render for qc processing.
i will share what i make with your plugin my friend, hopefully soon but i have finals approaching. so maybe in the next few days i will upload the code for keyboard text input or override mouse events to universal coordinates i'm just mapping everything twice once for multi-touch and first for mouse or NSPoint.
actually its pretty cool although there is tiny delay when navigating hyper links i have done some testing by queue-ing the qc image and transitioning between pages, actually put the webkit texture to mesh bend and stuff pretty bizarre some of the results. not sure if people are ready for a crazy browser but i will tell you my friend you did a lot of work, and the way your getting page elements without knowing what they are is brilliant as i think making some sort of more persistent cache of website images that you visit may in conjunction with html 5 may make much better browser experience.
i guess there isn't enough time in the day because i know there are lots of amazing things that can be done with this webkit in qc, but either not enough time or man power to get all done. all the same, i still really like the new webkit view even if it bugs out sometimes, as it gives a glimpse into the future for me at least.
A picture can speak a thousand words - [ grabbed from http://www.jonathanyuen.com/main.html using the Simple Browser for CoGe] & the latest Flash plugin too.
:-)
[BTW - just noticed the neat Remove link on the file attachment section.]
It would be pretty damn cool if the Unity webkit rendered in CoGe (forgetting about syphon stuff). It's slick that it renders in the browser... but it would be nice if it would render in the actual output that QC provides.
I think it has the some issue like Flash. Seems to this stuffs not using the backing store of the window and that why we can't build a texture from it. Or something similar .
Actually, yeah, ditto too [ Flash 10.0 or >], the QC Viewer won't render Flash media , nor does it reliably render plain HTML neither after it has been asked to render Flash, or embedded .qtz files.
Suddenly all the previously honoured scaling goes out of the window.
Another interesting 'defect' is that when going to an embedded media site like vimeo, the sound file on the video plays, but the visual does not.
Well, it does render text ,images & markup code nice and fast, but the text scaling can easily be knocked out of shape when seeking to scroll down a page, also the textual input only really works as a send / receive in the browser window, not in the QC viewer window [to be expected , I guess].
Definitely faster rendering, including , is my impression, within the browser window. [again, embedded media , including Flash v 10, only works fully in the browser window].
Quote: but the text scaling can easily be knocked out of shape when seeking to scroll down a page
hmm, what does it mean exactly?
Quote: but the text scaling can easily be knocked out of shape when seeking to scroll down a page
it works for me, for example, i can use google inside QC view - but hitting Enter doesn't working. BTW, i never deal with the browser window - its a simple WebkitView, works as expected, but if i wanna use an onscreen solution, just turn on safari and vade's screen capture plugin :)
Quote: embedded media , including Flash v 10, only works fully in the browser window
No chance to make it working in this way. Technically, we locking focus on an offscreen NSView and generating texture from it, but according to the docs, some views just don't use window backing store - like NSMovieView and seems FP10 - well, no chance to grab a texture from it with this method. BTW, with FP9 the flash stuff works well.
Flash & Java side by side, same QC app, two different compositions, running concurrently, in fact the Processing stuff, if sized to take up the available space would look just as seamlessly cool as the Flash does.
Nice work.
[BTW, just my experience to date, but the Java renders without the odd mouse lag & co-ordination that I'm getting with the Flash in the QC Viewer window.
Also, don't know as yet if this also happens with Java Audio, but the Flash audio just keeps on playing even after the Flash visuals have been ceased. Stops once QC app is entirely quit.]
Just updated this plugin silently, fixes the flash issue and other misc changes, please let me know if you run into any issues with it: http://code.google.com/p/cogewebkit/
Completely awesome plugin. However CSS3 hardware acceleration does not seem to be functional. I can see it in the mini browser but in quartz composer its' just blank. what gives?
for example:
-webkit-perspective: 800;
Just hoses the rest of the code and nothing else displays..
any ideas? is this plugin using the latest build of webkit? just can't understand why this wouldn't work
Thank you!
Uhm. I'm really interested in trying it... saw it pop up last night and almost decided to stay up messing with it.
I loved the web to image plugin that was floating around, and this will seemingly add some function... for some reason I'm dubious about the swf thing, but hey, I will be happy...
On a side note... I thought it was kind of interesting for duder to put a link to his plugin page and then require registration to get the plugin. Don't get me wrong... you have to register to get beta stuff here, but it's not like Chris dive bomb's the list on every update to drum up members either. I've been on some other lists where the fella would have gotten ruthlessly called out as a spammer on principal (even though I don't think that was the intention).
i will not drop e-mail bombs for the users, i promise :)
That's why one of my email addresses is just for forums. ;) Dudes and corps alike just can't help themselves. I've read online newsletter marketing directives that claim customers forget who you are unless you email at least every fortnight.
I remember seeing the previous US Administration every day – doesn't mean I was buying their bs.
It is ace. Flikr slide shows in combination with the refraction comp and that's just for starters. Top notch.
not till now, seems to work with the example posted, i tried with my joomla site. it just renders the site im not sure if there is any inherent flash interactivity work but its a great idea sort of going the reverse approach to using webkit inside quartz composer. i can see all kinds of fun things happening with this plugin. the first thing im going to do is put my website underwater.
to our defense, we don't use the email addresses we get unless we need to contact someone for clarification on a bug and sending custom builds. We reciprocate by providing email addresses at the bottom of each page (info@kineme.net actually goes directly to myself, smokris, and another person), so it's not like we're harvesting info without returning it.
Also, for us it's a simple test to see who's human and who's not. We've had so few spam-posters that I can count them on 2 hands (and possibly 1?). That save smokris and I a ton of time (otherwise we'd have to moderate, or babysit a moderation plugin etc). So in this case, it actually is to provide better service/lower overhead (and all the other TCO buzzwords people fling about ;)
(I don't think you were suggesting that we abuse it, but that people/companies in general have a tendency to do so -- on that point we don't disagree at all ;)
Have you given any thought to providing some way to control Flash files in something like VDMX, .lov (I mean other than through mouse-interaction).
a|x
Like I said, I'm familiar with you, and I doubted that was your intention :) Just sayin'.
Love love love :)
To clarify (guess I'm going to have to try it myself though)... you aren't seeing swf files on your website, just with the example swf? Hmmm. I'm hoping this adds swf via web, without having to do any safety stuff, or else it's just duplicate function of the web-to-image plug.
Time to stop yapping and actually try it I guess...
edit-
Been trying it. Got some kind of glitchy text bottom of screen on the default web url on the test, but it disappeared by the time I tried to take a screen shot.
The scroll thing seems a little fussy, but then again, I'm really used to using a modified version of "pdf zoom" with web-to-image for this stuff... which I feel is less fluttery as far as control of the page goes, but it's probably more that it's what I'm used to.... nah... this scroll thing is driving me crazy actually :) When I want to hover over an area, the page moves away from me! Yoinks.
It doesn't line up stuff quite correctly... check out www.beastieboys.com . The part that says "36 remastered tracks" lays over the menu tabs, which doesn't happen in Safari (or browsers in general). On a BIG plus, it is getting audio, which is WILD.
Yeah, I get that image glitch out on a few pages... I get it on the CoGe website and Youtube. You basically see remnants of the image that is directly the the left, laying over the image to the right. Kind of like when your old NES cartridges would get dusty, and you would try to blow them out to make them look right.
Hmm, i'm not a big flash guru, what do you want to control? Maybe the standard stop, rewind, etc., features works with javascripting, i'll test it.
flosc works with upd etc... or flash open sound control... i don't actually use vdmx its something else i have to learn, i thought resolume avenue supported quartz composer with its gpu rendering but it dosent i guess vdmx is the best choice for a qc host ? ? ?
not sure if you know about this its in alpha right now its some sort of cloud based online flash node binding stuff but has some awesome links to flash 3d projects etc... could be useful. if you figure out how to get an invite please invite me. i guess i got to twitter no way getting around it. he says he has finished but cant create an account. so don't bother filling out the form the guy dosent email you any confirmation trust i have tried ten times but the project still excites me, i used to love flash now it qc love but looks like the two will have things in common soon.
http://sourcebinder.org/
the hover thing is a bit wierd. at first i thought my actual hover settings got messed up cause its crazy large the hover zone set up with this plugin. i use like 1/4 inch hover scroll on my system, not to detract from this plugin because there is lots more investigation to be done, but how are you doing this thing with a pdf george? i have seen the url to string patch from kineme but where to you find the web to image patch.
What a brilliant plugin :-)
That is like totally unbelievable !
Sweet.
interesting : it render java embed processing comp :)
i installed the nightly build of webkit to see if that makes any difference not sure yet going to check the plugin out. here is kineme's site underwater with refraction spheres.
I'm loving this - nice touch that you get audio through n all
Any idea if its possible to use javascript to target something like a fullscreen button on youtube?
would be nice to pipe quartz composers mouse movement to interactiv sites like this one: http://toxi.co.uk/p5/perlin/. is it possible via js?
Thanks for the bug founding and for the advises! I think the plugin needs a lots of work and very buggy now - but hey, it's just a beta release :)
At the moment vimeo converting a new demo vid with Youtube JS api, check it later. I'll upload the used composition the the plugin's forum.
awesome comp, love it!
your welcome this plugin is providing me some entertainment today
Thanks for the plugin!
I think that glitch stuff I was describing goes hand in hand with scrolling back and forth.
I have some setup where I use an image transform, but also change the pixel size of the web image, to effect a solid scroll when you "grab" the screen, but there was some kind of math I had to pull off with the web to image plugin pixel values to make it work right. It's on an HD that has a kind of crappy power supply connection, that I haven't sat down and backed everything up off of yet.... I start backing up and it loses power, etc...
...but I digress.
Nice - really amusing
Correct. not pointing the finger at Kineme. Opposite. That's why you have my higher level email address(s) for notifications, not my 50%-spam email address ;)
Guess that makes Kineme !== a dude or a corp according to my venn diagram?!
I took the source and re-arranged things, fixed some bugs, Optimized the hell OpenGl pipeline and made a multithreaded renderer out of it.
You can now have 2 to 3x faster rendering. I gave the code back to Tamas, who is going to do some more things with it.
I found another potential candidate framework based on googles Chromium branch of webkit, called Awesomium, which is made to do off screen rendering. It has some niceties like easy to use handles for passing in mouse/keyboard events as well as a rendering callback so you dont have to spit out an image every frame, which really optimizes the hell out of it. Unfortunately it requires a static library of the new Chromium webkit/webcore, but it is very fast, and supports some important gotchas like not making pop up windows come out of no-where (it traps them back to your main offscreen drawing destination).
Only issue is Flash support under OS X is currently dinky. I have it running as a plugin and its fast, and you can interact with pages and actually browse, but its touchy and a tad crashy.
Anyway, I think its good to have options, here is the new improved Coge webkit my changes, should see a HUGE perf difference:
http://002.vade.info/downloads/CoGeWebKit.plugin.zip (link if attachment is lame)
Nice one vade.
a|x
would it be possible to post the source? I could try integrating some of the incomplete event handling stuff I had in our unreleased webkit plugin if I have some downtime/idle curiosity.
Thanks, that really is very generous [and useful] of you.
Absolutely improved performance level, indeed
Although, regarding the Flash content, I got this just as I waited to post this in between brewing a fresh coffee.
Process: quicklookd [941] Path: /System/Library/Frameworks/QuickLook.framework/Resources/quicklookd.app/Contents/MacOS/quicklookd Identifier: com.apple.QuickLookDaemon Version: 1.3.1 (170.9) Build Info: QuickLook-1700900~8 Code Type: X86 (Native) Parent Process: launchd [148]
Interval Since Last Report: 101988 sec Crashes Since Last Report: 12 Per-App Interval Since Last Report: 147627 sec Per-App Crashes Since Last Report: 3
Date/Time: 2009-07-03 23:52:43.431 +0100 OS Version: Mac OS X 10.5.7 (9J61) Report Version: 6 Anonymous UUID: A448D6B6-1825-4642-9516-2096E412390D
Exception Type: EXC_BAD_ACCESS (SIGSEGV) Exception Codes: KERN_INVALID_ADDRESS at 0x00000000c00fb947 Crashed Thread: 0
Error Formulating Crash Report: Library in dyld shared cache does not match version on disk. { VMUSignatureArchitecture = 0x7,0x3 32b - LittleEndian;
VMUSignaturePath = "/System/Library/Frameworks/WebKit.framework/Versions/A/Frameworks/WebCore.framework/Versions/A/WebCore";
VMUSignatureSegmentAddresses = (
__TEXT SEGMENT [0x930d8000 -> 0x93969000],
__DATA SEGMENT [0xa03bb000 -> 0xa043d000],
__OBJC SEGMENT [0xa043d000 -> 0xa045d000],
__IMPORT SEGMENT [0xa0a59000 -> 0xa0a5c000],
__LINKEDIT SEGMENT [0x97689000 -> 0x996c6000]
);
VMUSignatureType = "VMUSignatureType-Header-MachO";
VMUSignatureUUID = ;
}
0x95f470ab
0x92f8ee3b
0x000a0f5e
0x000a366b
0x000a2fb0
0x00004c64
0x00003970
0x0000a992
0x00002ea4
0x000029f1
0x90b4d03b
0x0000c254
0x90b21155
0x90b21012
Thread 0 Crashed: 0 ??? 0x92f9a688 objc_msgSend + 24 1 ??? 0x12f687de -[CoGeWebKitPlugIn dealloc] + 96 2 ??? 0x91eb1a66 __NSThreadPerformPerform + 646 3 ??? 0x95ecd5df CFRunLoopRunSpecific + 3215 4 ??? 0x95ecdc78 CFRunLoopRunInMode + 88 5 ??? 0x00004ce7 0 + 19687 6 ??? 0x00002b46 0 + 11078
Thread 1: 0 ??? 0x90b209c6 kevent + 10 1 ??? 0x91eb0e0d -[NSThread main] + 45 2 ??? 0x91eb09b4 NSThread__main + 308 3 ??? 0x90b21155 _pthread_start + 321 4 ??? 0x90b21012 thread_start + 34
Thread 2: 0 ??? 0x90af0286 mach_msg_trap + 10 1 ??? 0x90af7a7c mach_msg + 72 2 ??? 0x95ecd04e CFRunLoopRunSpecific + 1790 3 ??? 0x95ecdc78 CFRunLoopRunInMode + 88 4 ??? 0x00006815 0 + 26645 5 ??? 0x91eb0e0d -[NSThread main] + 45 6 ??? 0x91eb09b4 NSThread__main + 308 7 ??? 0x90b21155 _pthread_start + 321 8 ??? 0x90b21012 thread_start + 34
Thread 3: 0 ??? 0x90af0286 mach_msg_trap + 10 1 ??? 0x90af7a7c mach_msg + 72 2 ??? 0x95ecd04e CFRunLoopRunSpecific + 1790 3 ??? 0x95ecdcd4 CFRunLoopRun + 84 4 ??? 0x00006cd1 0 + 27857 5 ??? 0x91eb0e0d -[NSThread main] + 45 6 ??? 0x91eb09b4 NSThread__main + 308 7 ??? 0x90b21155 _pthread_start + 321 8 ??? 0x90b21012 thread_start + 34
Thread 4: 0 ??? 0x90af746e semwait_signal + 10 1 ??? 0x90b21dcd pthread_cond_wait$UNIX2003 + 73 2 ??? 0x0000a26a 0 + 41578 3 ??? 0x91eb0e0d -[NSThread main] + 45 4 ??? 0x91eb09b4 __NSThread__main + 308 5 ??? 0x90b21155 _pthread_start + 321 6 ??? 0x90b21012 thread_start + 34
Thread 5: 0 ??? 0x90af0286 mach_msg_trap + 10 1 ??? 0x90af7a7c mach_msg + 72 2 ??? 0x95ecd04e CFRunLoopRunSpecific + 1790 3 ??? 0x95ecdc78 CFRunLoopRunInMode + 88 4 ??? 0x900f3298 CFURLCacheWorkerThread(void*) + 388 5 ??? 0x90b21155 _pthread_start + 321 6 ??? 0x90b21012 thread_start + 34
Thread 6: 0 ??? 0x90af746e __semwait_signal + 10 1 ??? 0x90b21dcd pthread_cond_wait$UNIX2003 + 73 2 ??? 0x94335b32 glvmDoWork + 162 3 ??? 0x90b21155 _pthread_start + 321 4 ??? 0x90b21012 thread_start + 34
Thread 7: 0 ??? 0x90af0286 mach_msg_trap + 10 1 ??? 0x90af7a7c mach_msg + 72 2 ??? 0x95ecd04e CFRunLoopRunSpecific + 1790 3 ??? 0x95ecdc78 CFRunLoopRunInMode + 88 4 ??? 0x91f14530 +[NSURLConnection(NSURLConnectionReallyInternal) _resourceLoadLoop:] + 320 5 ??? 0x91eb0e0d -[NSThread main] + 45 6 ??? 0x91eb09b4 NSThread__main + 308 7 ??? 0x90b21155 _pthread_start + 321 8 ??? 0x90b21012 thread_start + 34
Thread 0 crashed with X86 Thread State (32-bit): eax: 0x003d03d0 ebx: 0x93f0459a ecx: 0x92fc2864 edx: 0xc00fb927 edi: 0x0010200c esi: 0x003d72f0 ebp: 0xbffff178 esp: 0xbffff148 ss: 0x0000001f efl: 0x00010202 eip: 0x92f9a688 cs: 0x00000017 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 cr2: 0xc00fb947
Binary images description not available
For plain vanilla HTML & CSS - excellent. Definitely faster scrolling, loves the might mouse input even more than coge's brilliant original. Could one get some of the event driven interface therein, I wonder. Does seem to render some sites, a little lopped off. I'm definitely in favour of publishing the width and height options. Can help with the loading of some pages.
way to go vade seems more responsive. i fixed the scroller if anybody cares. smoothed it out tweaked it a bit. the hover is better now, for some reason the example had the page going down when you hovered up ???? hope this is useful.
here is multi touch page scroll if people like that better.
I am pretty sure this is the result of loading a Flash page, specifically - Platonic Solids. Nothing wrong as such with the page loaded at all, beautiful work actually.
The report is exactly the same as previously posted, bar the time it happened.
Cool web page.
Of course :) Tomas made the source CC-NC-AT-SA 3.0, just so we are all on the same page :)
I would actually suggest (and suggested to Tomas) that there be a SVN for these if everyone is going to branch/fork it. Im actually in the process of setting up a public repo for the v002 plugins as well.. maybe it could live there but that strikes me as being a bit presumptuous on my part.
Anyway, I do feel a bit odd putting this out there as developers like to kind of put out complete and finished things on their own, but, the cats kind of out of the bag. I hope Tomas does not mind me posting it here. I know personally I might feel a bit weird about it.
I actually was going to work on adding in NSEvent support, and using freeboard to capture keypresses into an NSevent to the Webview. Chris do you mind holing off a bit on that?
In the code Ive implemented as much OpenGL optimization as I could, but there are a few things I started to set up that I did not finish, one of which was proper texture range support, as well as glFinishObject/double buffering texture submission support.
Ill also throw up a beta of v002 Awesomium soon, once I work a few other things out... its pretty cool, but I think I found the achilles heel of that framework, it does not load Java plugins at all, so no processing. Fuck!
Anyway, attached is the source.
Indeed, there definitely is something off with flash somewhere. Its certainly not a 1.0 and needs some work. Flash stuff can be tricky because sometimes it wants its own window, or even OpenGL context, according to the Netscape Plugins API docs.
This is one thing Awesomium does nicely, it handles edge cases for certain plugins and makes sure it sets the appropriate NP Plugin flags so things work. Unfortunately for now Awesomium on Mac OS X has some limitations, but im talking to the developer to get help get around them.
Thanks :)
So you tried to quick look the QC composition that had CogeWebView? I did not think Quicklook let you preview private/3rd party patches? Unless this is that Kineme Plugin letting it load the 3rd party plugins sans safe mode. I dunno, im going to shrug on this one :)
Actually I didn't try to QuickLook the QC composition that had CogeWebView.
This was simply what resulted when , if I recall correctly, closing down QC with no file actually open, after viewing a web page with Flash content in pagescroll example, sorry, multi-touch version.
Could be 3rd party sans safe mode issue, as you speculated, I will reinstall the plugin and look into that.
Tomorrow :-)
Ah, ok yea, there is a weird dealloc issue somewhere I just noticed happens sometimes.
Ill look into it. The quicklook dialog threw me off :)
I really wish Awesomium worked properly with flash, cause everything else there 'just works' :(
Ive hacked the basics of mouse input but it seems to actually expose some issues in how the offscreen rendering works. Form controls like pop ups seem to break the capturing "context". Im going to have to do a lot of investigating on this one....
okay, we just implemented some new features with vade, there is 2 ways to gets mouse interacts, supporting transparency in flash content, etc. Hope the finish is close ;)
Awesome job vade and joy... However this plugin no longer works on 10.6... I just upgraded and now it doesn't work. Do you have any idea why?
Thanks!
yep, we have a fixed version, but this also needs some more work. please be patient ;)
Cool, thanks... And I meant lov, not joy, lol :p
Beta2 out now! Check: http://coge.lovqc.hu/?p=65
great work ! thanks for sharing .lov
You're welcome! We worked a lot on this project with vade, i hope you guys will find the plugin usefully ;)
This is totally awesome :-), embedded media, .mov, .mp4, .qtz are all honoured and rendered - slick text rendering.
LOL - it just crashed on an .swf - to b expected I suppose .
crushed on an swf? What site or standalone swf file?
much .lov on the browser feature.
[edit]
ok so i have had a little time to mess this plug_in a bit. thinking i will stop by mr .lov's site to report back some issues i found.
so first off i'm really happy with the plug_in and look forward to any future updates.
i have only done a few tests but before i get to the slight quirks the java script functionality seems to be woking superb and echoing any values i change at least as far as i have tested with dashcode. i like the html source as text. although i haven't tried this yet but i imagine being able to grep through web source's to automate or identify element ID's that can be used as input.
there seems to be lots of cool possibilities. i like the image downloading. i can imagine all kinds of cool apps to help people out that can be made with a plugin like this. i mean you could combine webkit with the apple script plug i made and do some sort of itunes album art finder ?
ok some of the quirkiness. i'm going to test with a swf file so i can not report other than youtube and hulu work better in the coge webkit than youtube does in google chrome. thats so weird like google doesn't work well with google.
so an added feature that seems a must have is text field input. im sure there is easy way to populate fields with a javascript so thats not to much of an issue but. still it is a bit wierd to have a cursor show and not be able to input directly. so i realize there is the webkit view that enables this. which is cool but i don't really like it. i mean yeah its cool to have an external view open from qc view which makes me think there is all kinds of cool integration that could be done in a plug-in context i guess for people that know how to do those things.
to me its about using the plug in QC, if i wanted a web view i would open up interface builder and drop a web view add a few buttons and done. i mean its like ok in interface builder you can build a simple browser in five min's without code. thats pretty cool but now you can do it in 5 seconds with Coge webkit.
well i take that back. sorry. i'm not sure what i'm doing wrong but you can not drag this plug_in to your editor from the patch creator and make it work. thats a little messed up. i could understand if it where a template like quartz builder template that is needed for external app but out of all the bugs im pretty sure being able to drag and drop from the patch creator is essential. or at least directions on how to make it work from scratch. try it maybe its just my system ?
however the provided examples work fine. but when i try to replicate simple web browser as in adding a billboard to the webkit plugin it from the patch creator is a no go for me. i can upload a file set up the same as the example patch and there is no image. so not sure but there didn't seem to be any sort of protocol conformity or any thing. i just like to be able to make things from blank.
ok so thats it. for now. i am real excited. i just turned my multi-touch table into giant iphone(like) multi-touch full screen web browser. wicked. last webkit released inspired me to build my web-site. well my database migration didn't go as planed so now its time to rebuild. so thats inspiring.
oh yeah awesome java in QC without JNI components which seem to be out depreciated now or something. maybe java is just transparent now with java cocoa bridge just like python objc is in snow leopard. don't know will have to investigate.
i guess another thing is mr .lov if your reading this is that repository code doesn't run as its missing its pbx build files or something. i just wanted to hide your web view as i would rather have QC suppress a pop up or glitch out than to have a broken web view pop up when browsing a f!#%^ up site. i know thats a tuff one is people always find a way to pop behind or under over what ever so im not expecting .lov to add suppression. i mean if Microsoft and apple can't block all pops with all the money in the wold then im defiantly not expecting coge to do it. although i think if i could either hide or take out the web view all together QC seems to do an all right job as in it glitches out with pop ups and glitches are cool.
but yeah your your repository is missing some dependencies but at least there is code in it now as of last month it was empty. i was able to build fine by dropping in another project but there is some error that makes it not work once in qc . something to do with the cgl-ctx. which is beyond me as i'm having a hard time binding CA OpenGL Layer context to a QC Open GL context. but would be nice if your open your sourcing the project on google to be able to build the plugin so inquisitive minds like myself are able to study your and vade's code.
as you and vade are very talented but there is no use studying something that isn't the current build. maybe it is the current and im just being daft. the wierd thing is that i tried making a project called "CogeWebkit" and added your source and i get all kinds of errors now when i make a project QCWebkit and add your source and change the plugin implementation and interface names it builds without error's but doesn't work in QC.
the wierd thing is when i changed the name to QCWebkit and built it the CogeWebkit stopped working. Now I know from vades docs on his ofx qc plugin that i really want to build as well but yeah something is missing in that repository as well you can't have two plugin with the same class names ? interesting out of all the QC plugins there is namespace collisions ? I mean when I change the plugin class of webkit i still get name space collision even after changing the plugin implementation. so this means the other class files need to be unique as well. its weird i could have sworn i have used the same sub class in a plug ? maybe different for subclass.
but yeah those are some of initial thoughts. so i must say much .lov very inspiring and major improvement. i hope you don't take any of this comments as critique as this a very exciting plug_in.
;)
[/edit]
ohh, what a huge edit :)
Sorry for the quick answer, i don't have too much time yet.
The text field thing: yep, we want to do the magic, and sometimes its worked, but actually not found a solution which works stable, and i didn't want to spend more time to this thing only, because beta1 didn't worked on 10.6.
drag, replicate: works fine for me. Are there any interesting cogewebkit related console messages when you trying the drag or the replicate?
pbx: yeah, thanks for the point, i missed it. The reposity updated, check it ;) (anyway, we used sourceforge.net before goggle code, search sourceforge for cogewebkit)
yeah i remember the source forge i went there one day to see if i could just your plug_in for my machine. i was wrong. thanks for updating the google code. i want to study the code so i can see how integrate different contexts inside a qc plugin.
so as far as error there are non in the GFLog.
this is what i get in xcode debug...
2010-03-28 13:38:11.247 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:1836, bytesPerPlane:710532 2010-03-28 13:38:11.342 Quartz Composer[18742:a0f] filepath changed, reload it... 2010-03-28 13:38:11.348 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:11.348 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:11.348 Quartz Composer[18742:a0f] safe javascript :) 2010-03-28 13:38:12.355 Quartz Composer[18742:a0f] CFPropertyListCreateFromXMLData(): Old-style plist parser: missing semicolon in dictionary. 2010-03-28 13:38:12.356 Quartz Composer[18742:a0f] CFPropertyListCreateFromXMLData(): Old-style plist parser: missing semicolon in dictionary. 2010-03-28 13:38:14.697 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.071 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.289 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.339 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.424 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.474 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.507 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.560 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.608 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.658 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.708 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.758 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.811 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.859 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.909 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:17.959 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:21.334 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8 2010-03-28 13:38:22.403 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:22.721 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:22.771 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:22.922 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:22.955 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:22.989 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:23.223 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:23.240 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:23.290 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:23.324 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:23.373 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:23.542 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:24.579 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:24.613 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:24.646 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:24.697 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:24.734 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:24.780 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:24.947 Quartz Composer[18742:a0f] mouse scroll 2010-03-28 13:38:26.601 Quartz Composer[18742:a0f] bitmap data format: isPlanar:0, samplesPerPixel:4, bitsPerPixel:32, bytesPerRow:8, bytesPerPlane:8
looks like you forgot a semi colon when you where defining your in/ouputs. that easy enough to track down. i found qc plugins for me seem to run better with undefined dictionary attributes for in/out ports. meaning by using the
@property(assign)NSString* inputFoo;
and then not declaring any default attributes in the implementation usually gives me less errors. when im trying to build a plug-in. but then again no errors doesn't mean that its all good. cocoa assumes you know what you are doing which i don't although i like to think i do. i just pick things up on need to know basis but am interested in seeing how to off screen render via qc plugin, where apples offline render is maybe off screen but not the right code to be looking at to figure out off screen rendering etc...
so here im attaching a qtz its my test file from blank comp. black screen not sure what im doing wrong but im going to run one of your examples with xcode open and see if i see anything different.
thanks a bunch man this is really a great improvement. as per the onfocus input boxes and stuff that's all ready possible if you know the element ID your looking for. as in getElementById("search").value = "a qc string" works fine. i mean i would be using your plug_in for my website where i use moo fx js ext mysql php and joomla etc.. so im sure i can make a local browser for my own purposes.
but yeah you gots to keep some things magic i guess. or at least where a mask if you giving away the secrets so the other magicians don't turn you into a frog.
.lov, the site was actually an old exhibition site and that is still not working , although vimeo Flash is now working and in that previous session, .mov files [at another location online] were working, but they aren't now and Flash files are working AOK at present, but weren't on vimeo in that previous coge browser session.
Furthermore , the crashing site is trying to force a scripted window open manoeuvre & that doesn't go down too well, [does it :-)].
so what's happened to .mov support ? or is the problem client side?
The messages are not error messages, it's just log messages helping me on debug - so everything works as excepted. The blank composition is your fault (its not an offense or something bad:) ) - you using QC units for the Width/Height parameter, not in Pixels. Please re-check the attached examples with the plugin :)
Your exhibiton site works for me - if i using http instead of https. What AOK means? Vimeo and flash files working me as well.
Online .mov crashes, thanks for the point!
edit: are you on 10.6 ?
Yes, I am on 10.6.
The exhibition site url does work as a separate URL, it does for me and .swf elsewhere also works .
The crash reported previously was the result of .js asking to open a controlled browser window and QC doesn't spawn new windows [as yet] and allow for that kind of DOM referenced control to that extent which is why it is not All OK [AOK].
It would have spat its dummy out with or without Flash
Vimeo didn't seem to work in first session, but did thereafter as does Flash.
Just .mov, that used to work and now doesn't :-(
BTW, the .js browser window DOM based controls work AOK in your blank webkit example once the sizing issues are addressed in pixels not QC units, and that URL still crashes the Simple Browser example when called for by the enter link.
oh man i'm so daft i was using units not pixels. what a freaking idiot i am. yeah this thing works blank from a blank. yeah disregard half of my edit as i'm a bit ignorant. been working on getting a multi-touch table + iphone card game going for monday. my kid wakes up just as i'm going to sleep. i'm a bit fried right now. its like i'm saying i don't want pop up webkit view.
your guys magic fooled me as i have been running full screen with a hidden mouse. messing around on youtube with multi-touch inertia scrolling and other gestures which are all working fine on my table. i thought my left button click was working now i feel stupid for not reading the links i was clicking as my mouse is off screen somewhere clicking on some other random bull sh1t.
yeah damn this is cool i have had this same transparent idea to get multi-touch into apps that don't take it. brilliant. i think i'm going to have to do some java scriptscript to send my clicks though as im not using a mouse.
but yeah now that i see whats going its totally possible to get the cursor input to the qcview you just need an extra webkit view. meaning if you change the alpha of your webkit view to 0 and your pop is visible your getting cursor input but you can't see the web page as your using the webkit view to render the page.
just open your nib go to the core imaging setting of your content view get rid of the non transparent stuff then set the core imaging view to alpha 0 then run the plugin and pop up the webkit view you won't see anything but you will have text input you can't see because you need additional webkit to render and send to qc. then you will basically have a web kit view in a qc view but your not clicking the qc view ???
its the same principle of what your doing right now you just need another view. or at least it seems like it would work to me but then again im an idot and confused units for pixels and though i was left clicking just because i was jumping to another page.
i have been on the coge site clicking because my blobs highlight the buttons now i have a bunch coge website elements on my desktop from the mous im not using drag and dropping stuff that is invisible. haha.
sorry im daft sometimes. still a wicked plugin. in theory i think all you need is an additional webkit view to render to qc.
yeah, the popup windows screw up all the things just like pop-up buttons. We found a way to stop the pop-up screw up thing, but not working anymore - don't know why, maybe a sytem update cause this issue.
The .mov thing looks like a threading issue.
sidenote: Hmm, our experience: working with WebKit == Odd. Looks like the workflow different on 10.5 and 10.6.
sorry but i don't really understand this - maybe its because my english :/
We are talking about the plugin or a standalone app uses webkit?
probably explains why 10.6 Safari lumps up sometimes on vimeo [Flash & JS], but is AOK with youtube [Flash & different JS]
another candidate for tip of the year for plugin programming :-)
yeah its not your english my friend, its my poor explantation as i was pretty sleep deprived the day i wrote that. i spent some time messing with the plug-in and thought that it might be possible to have a transparent webkit on top of the qc viewer taking in events that are displayed in the qc viewer like input fields and what not. i have done a little tinkering and maybe thats not the solution. i will report back once i get some time got to run to the lab.
I've never, ever seen errors with properly programmed plugins with input port dictionary attributes. Not to be an ass, but this tells me something is going wrong somewhere in your code. If this is an issue with CogeWebKit, I will admit to not looking at it for some time, since I added threaded rendering to it. :\
no issues with the webkit as per data type declarations and default values. i just find it faster to not use the dictionary defaults while building. obviously no one does this but apples default x-code template does say its optional to declare defaults.
your not being an ass, as not declaring defaults can actually cause more problems if your using virtual inputs in the quartz file that goes along with the plugin. although when using splitters with declared data types in a quartz file that correspond to your property settings, things seems to work smoother for me.
i have only been messing with QC for a little over a year now and just started messing with plugins this summer. so i'm still a noob talking out of my ass.
actually distributing a plugin without defaults i don't think is a good idea as there would be more of a chance of breaking the plugin but while building a plugin it seems to be quicker work flow for me.
i made a slight change to the source nib of webkit2 beta. basically on launch the cogee webkit view gets launched but to the back window layer. so basically the offscreen render is on screen but at the back or first layer. so with my apple script plugin you basically tell the webkit window to select and click the back webkit view indexed window 1 and it updates the cogee webkit view in quartz. so you can browse the internet in quartz composer. here is plugin and simple qc browser. im thinking of doing the same sort of gui script for the typing via universal access. the script works best at first launch. this works with cogee beta 2 if you launch the webkit view manually and then send to the back of the qcview. i was going to add another offscreen render so i could render transparent webkit on top of the qc view. i don't know apple script that well so im sure this can be done with a minimized view as well.
sounds interesting. I'll try it asap.
yeah i'm sure there are a few other ways to do this. this way works inside QC but would need to change a bit for xcode or QB build. didn't do anything to your mouse events inside the plugin. so even if the cogee view isn't enabled you get mouse events. i could swear when i first tried the plugin clicking things was working.
i just have a different build on my system now, got to make another one and change all your class names so i can have 2 versions of the plugin on my system so i can override the mouse events with multi-touch events and hopefully get the same functionality encapsulated in one plugin. don't know what that means, but im sure this can all be done in cocoa if not java script as well.
im almost done mapping the keyboard to the universal access keyboard. actually doing the same thing as with he apple script passing in xy and select clicking by those positions the keyboard viewer. i figure if i map everything to the keyboard viewer and iterate through my touches it could act as pseudo multi-touch keyboard like on the iPhone. plus it will be very easy to switch languages using the the keyboard viewer.
i got to do more of that. i was reading the other day that its good practice to tag your NSStrings with some sort of localization command which i forget now but thats supposed to make it easy to add different languages etc.. which i have never done, or at least make it easier for someone to reverse engineer into different language which isn't really of concern as you have open repository but all the same maybe its a good practice i should start doing.
all the same i have studied your plugin, still not sure what your private cogee data format is NSBitmap ? So i appreciate you opening source as now I can see clearly how to grab things from different contexts and put into QC. i thought contexts where supposed to be sort of universal or interchangeable but i thought wrong so at least this shows how i can get any application that runs in a view to render to qc although i would think that doing some sort of context cast would be faster than off screen render for qc processing.
i will share what i make with your plugin my friend, hopefully soon but i have finals approaching. so maybe in the next few days i will upload the code for keyboard text input or override mouse events to universal coordinates i'm just mapping everything twice once for multi-touch and first for mouse or NSPoint.
actually its pretty cool although there is tiny delay when navigating hyper links i have done some testing by queue-ing the qc image and transitioning between pages, actually put the webkit texture to mesh bend and stuff pretty bizarre some of the results. not sure if people are ready for a crazy browser but i will tell you my friend you did a lot of work, and the way your getting page elements without knowing what they are is brilliant as i think making some sort of more persistent cache of website images that you visit may in conjunction with html 5 may make much better browser experience.
i guess there isn't enough time in the day because i know there are lots of amazing things that can be done with this webkit in qc, but either not enough time or man power to get all done. all the same, i still really like the new webkit view even if it bugs out sometimes, as it gives a glimpse into the future for me at least.
Are the flash stuffs working for anybody with the latest flash player plugin?
Have you had reports of problems yet? I haven't updated to the last flash b/c I've been worried functionality might get hobbled...
A picture can speak a thousand words - [ grabbed from http://www.jonathanyuen.com/main.html using the Simple Browser for CoGe] & the latest Flash plugin too.
:-)
[BTW - just noticed the neat Remove link on the file attachment section.]
No, just from my side :)
Yeah, in the browser window it works me too, but not in the image rendered. The issue happens only with Flash Plugin 10.
OT from flash:
It would be pretty damn cool if the Unity webkit rendered in CoGe (forgetting about syphon stuff). It's slick that it renders in the browser... but it would be nice if it would render in the actual output that QC provides.
I think it has the some issue like Flash. Seems to this stuffs not using the backing store of the window and that why we can't build a texture from it. Or something similar .
Actually, yeah, ditto too [ Flash 10.0 or >], the QC Viewer won't render Flash media , nor does it reliably render plain HTML neither after it has been asked to render Flash, or embedded .qtz files.
Suddenly all the previously honoured scaling goes out of the window.
Another interesting 'defect' is that when going to an embedded media site like vimeo, the sound file on the video plays, but the visual does not.
Yeah, FP10 render in a different way, seems to getting an offscreen texture from it is impossible.
Glad I didn't update.
So not surprised! Kind of reminds me of the iPhone 3G "brick" scenario.
Here is a shot from the upcoming Beta 3 version, with a faster rendering and an inputCharacter input for Kineme Freeboard patch or something else :)
http://dl.dropbox.com/u/2533/CoGeWebkit%20Beta%203.zip
Let me know what do you think!
Well, it does render text ,images & markup code nice and fast, but the text scaling can easily be knocked out of shape when seeking to scroll down a page, also the textual input only really works as a send / receive in the browser window, not in the QC viewer window [to be expected , I guess].
Definitely faster rendering, including , is my impression, within the browser window. [again, embedded media , including Flash v 10, only works fully in the browser window].
hmm, what does it mean exactly?
it works for me, for example, i can use google inside QC view - but hitting Enter doesn't working. BTW, i never deal with the browser window - its a simple WebkitView, works as expected, but if i wanna use an onscreen solution, just turn on safari and vade's screen capture plugin :)
No chance to make it working in this way. Technically, we locking focus on an offscreen NSView and generating texture from it, but according to the docs, some views just don't use window backing store - like NSMovieView and seems FP10 - well, no chance to grab a texture from it with this method. BTW, with FP9 the flash stuff works well.
Just updated the current public version as Beta 3: http://code.google.com/p/cogewebkit/
Found a method to rendering swf content with FP10 plugin installed, mouse interaction for flash files works too.
The new rendering method not renders java content, so, if you wanna play with processing content you shoud disable Force Flash Rendering.
Enjoy :)
Flash & Java side by side, same QC app, two different compositions, running concurrently, in fact the Processing stuff, if sized to take up the available space would look just as seamlessly cool as the Flash does.
Nice work.
[BTW, just my experience to date, but the Java renders without the odd mouse lag & co-ordination that I'm getting with the Flash in the QC Viewer window.
Also, don't know as yet if this also happens with Java Audio, but the Flash audio just keeps on playing even after the Flash visuals have been ceased. Stops once QC app is entirely quit.]
:-)
Interesting, could you provide me the url of the flash site tested?
http://www.jonathanyuen.com/main.html - the same Flash site as used earlier in this thread.
The Processing site is none other than processing.org.
New CoGeWebKit RC1 released with major speed up/bug fixes, included Players for CoGe and qcFX for VDMX.
http://code.google.com/p/cogewebkit/
Just updated this plugin silently, fixes the flash issue and other misc changes, please let me know if you run into any issues with it: http://code.google.com/p/cogewebkit/
CoGeWebKit new release: RC3, plus some examples: http://www.cogevj.hu/blog/2012/cogewebkit-new-release-rc3-plus-some-exam...
Completely awesome plugin. However CSS3 hardware acceleration does not seem to be functional. I can see it in the mini browser but in quartz composer its' just blank. what gives?
for example:
Just hoses the rest of the code and nothing else displays..
any ideas? is this plugin using the latest build of webkit? just can't understand why this wouldn't work Thank you!