Multi-Touch Musical Instrument Interface

dust's picture

In this patch im making music based on the xy coordinate system. This territory is still unexplored but the brilliance of this type of interface is that you can not play a wrong note, which I believe gives the user or listener a much better experience. The QC patch is using the tuio protocol and some wicked tone burst sound flowers to visualize the audio spectrum that is being made by the cursors directions.

There are only three touches in this but I have mapped 2 instruments to each touch so there are a total of six instruments being played with all three touches. Im using Apples developer tools AU Lab, and Quartz composer with the concatenation of OSCulator to parse and distribute the OSC to MIDI signals needed to feedback the spectrum for the cursor touch visuals.

Im including the QC interface patch, the OSCulator patch, and Au lab Patch so you can experiment yourself.

You will more than likely need to load up some instruments into the AU lab slots from your /Library/Audio/Plug Ins/Components folder.

Also the AULab is set up to bus to soundflower for the recoding so if you see the vu meters working but don't here anything that is why. Go Au Lab preferences to change the Audio device that suites your needs.

This will most likely work in garage band but maybe not sound good because the instruments are split by midi channels. If you have QC you have Au Lab so you can just load up garage band components from your library into AU Lab so it will work the way it is supposed otherwise you will here have 24 midi notes being played on one instrument and i don't think that will sound very good but feel free to try garage band if you want.

dust's picture
Re: Multi-Touch Musical Instrument Interface

here is my daughter gretchen playing touch music for the first time. she actually gets into it pretty intensely around 48 seconds deep into the recording.

cybero's picture
Re: Multi-Touch Musical Instrument Interface

A really nice idea, reminds me in some ways of the installation , graffonic that I saw at the recent expo leeds Left Bank Leeds.

graffonic used Max / MSP & Jitter objects, reminded me one whole lot of the sort of Tiger QC iterative 'auto-graphics'and early audio interactive stuff I could get out of QC, but using a physical 'spray can' laser pointer infrared light.

Great fun, audio and graphics splurging out together.

It's really brilliant to see someone so young accessing such a deceptively simple system as yours, dust.

Nice work

dust's picture
Re: Multi-Touch Musical Instrument Interface

well the beauty here is that she can't hit a wrong note, so that makes for a much more pleasant listening experience on my part. your right it is so simple a two year old can understand it. she is really exploring or more or less discovering how things interact and how she can see response and hear reaction from the i touch. she is actually pretty smart girl for her age i have to remember she is just 2.