My performance in QC

offonoll's picture

This performance I have been working, I did some video interactive scenes. You can also see kineme particle on the balls and letters, there is also a wireframe perlin noise, and some other coding in rectangle, body points, and also reacting with sound-circles. I used a sensor dress which does all motion capture.

I hope you will like it!! :D

Adding: All body 3d and particles attached to the body are made in Motion Builder.

smokris's picture
Re: My performance in QC

offonoll wrote:
This performance I have been working, I did some video interactive scenes.

Wow, this is brilliant. Interesting both compositionally and technologically, a combination I see rarely. I particularly like the way there's typically a 1:1 connection between the performer and the rendered graphics, but then partway through this relation is inverted and eventually lost entirely during the id-vs.-ego battle. Simple yet breathtaking.

Can you tell us more about the design and architecture of this project --- perhaps a scene-by-scene breakdown of what's intended conceptually and how your team represented it technically?

Besides the motion-capture input from the performer, were there other live inputs? How did you integrate the motion-capture with QC?

What technical limitations did you encounter in working with particles in QC? What new functionality would you like to see?

gtoledo3's picture
Re: My performance in QC

I'm glad to finally see this come off... the setup was ingeniously straightforward, as you explained it to me. Typical techniques used in a novel way. Big thumbs up!

cybero's picture
Re: My performance in QC

Witty, whimsical and totally awesome [ & how did you do all of that :-) ] Wonderful and amusing.

cwright's picture
you win

offonoll, I think you just won the internet with that. Incredible!

.lov.'s picture
Re: My performance in QC

whoo, awesome! Could you a bit more describe the project? What dress did you use? How to connect it to QC? etc. :)

franz's picture
Re: My performance in QC

this is brilliant ! congratulations ! are there any touring dates ?

2 beamers / 2 setups , one QC one MB ?

yanomano's picture
Re: My performance in QC

Very nice work ! Amazing mastery of interactive motion capture :)

offonoll's picture
Re: My performance in QC

Hi all! Thank you for the compliments, is important coming from you, I will try to answer all your questions soon and explain my experiences. Thank you! :)

sybot's picture
this is it

i am overwhelmed. really great performance, scene, pictures, effects, dramaturgy. this is something you try to imagine, when thinking about a way to use QC. and you just made it. big compliment to you and your team.

psonice's picture
Re: My performance in QC

Damn, that's seriously stunning work. One suggestion for 'next time' (if there is one): do it in 3d, with glasses. That would be fully mind-blowing :D

offonoll's picture
Re: My performance in QC

Ok. I will try to explain the main features in this project. I started working on this first week of July. My client wanted to use a sensor dress from another provider which they work for animation 3D. They have Xsense dress which comes with a MVN software. All sensors in the dress are same as wii remote control. They send the data to the computer through wifi-bluetooth(don't know exaclly) antenas connected to the pc (MVN installed). Their software does the position tracking in the virtual space. Here there is a sample from a 3D movie working with Motion Builder http://download.autodesk.com/us/mnevideo/third_floor/thirdfloor_long_1024x605.html The triky part was to get the information from MVN. This software sends data through UDP to any other IP computer, also any port. I had to program in MAX/MSP a small app to convert UDP to OSC, here I had many other problems regarding the way MVN sends data. From MVN I recieve a pattern X,Y,Z position of 23 points, ( dress has around 12 sensors and MVN makes a human body structure with 23 points, you can see those in the second transformation in the performance) There are some magnethic problems when the dress gets close to a metal or any other magnethic forces. Ok. Then, after I receive the data in osc, I route the importants points to my compositions. In circles and letters compositions, every point is a gravity particle to react with the scene. You can imagine how I made the other compositions. (this is what has been made in QC+Kineme | Firts dots and the body lines, Falling circles, Circle sounds, Rectangle, Falling Letters, Perling noise wireframe sphere) the 3D modeling and fire particles are made in Motion Builder.

Would be greate to have a body structure patch to attach any 3d model.

I hope this gives you an idea of the motion capture working with QC.

PD. Oh! I used VDMX, of course, to shoot the scenes-compositions.

Thank you for your comments!!!

dust's picture
Re: My performance in QC

offonoll i think this is awesome you where able to do this with sensors and even more awesome is that this technology has become a lot cheaper. i thought about doing the poor mans motion capture suit a few years ago. well maybe 5 or 6 years ago now that i think about it. that is basically some thermal underwear with a bunch led's in it attached to a lithium battery and to use shake or after effects to pull out motion tracking data. i never got to making the suite, thats why i was excited to see your patch of the guy doing a jump kick a few months back. i suppose using the data in QC is a bit difficult when you don't have bone structures and fk and ik handles to move around. i suppose maybe splitting a model up into the 23 points you are talking about might work in 3d probably it would give more of an animata look but in 3d though

offonoll's picture
Re: My performance in QC

Thank you Dust! Actually is much easier than what it seems. The suit is awesome! , but expensive, 50.000€. The sensors are same technology as wii but the sensors themself don't work. What is amazing is the software (MVN). They made a greate app that knows what means a step, if you connect the suit to the software and then grab it, move it to one meter away, what you see on the screen is a body flying-levitating 'Y' but no moving on 'X' or 'Z'. Also the virtual head never fall, that means that they made a software that understands the human behaviors and its structure.

Using the data in QC wasn't that difficult. The software mention before respects the human body points so if I recieve 23 points with its X,Y,Z, I was be able to get a structure data for 23 X's; 23 Y's; 23 Z's and plug it to a Gl point patch for each XYZ inside an Iter.

I hope this gives you a better idea.

Gracias!

gtoledo3's picture
Re: My performance in QC

Oooh, the number 23.

djanlog's picture
Re: My performance in QC

Who composed the music?

offonoll's picture
Re: My performance in QC

This is the musician: http://www.myspace.com/electrocugat