|
|
Speechphoneme opcode speech synth video avatar (Composition by dust)
so not really sure what to call this. its basically the speech synth plugin with phoneme opcode output and rate input. the phoneme opcode is a code that represent a phoneme. this patch maps the phoneme opcode out to video clips of the phonemes. years ago i recorded this actor reading the opcode and chopped it up... while i was searching for cross modal connections between vision and sound. http://en.wikipedia.org/wiki/McGurk_effect turned out to be more of a max headroom type of effect i guess. simple one to one map. type in text watch video speak the text. this is done all the time with animations though normally just a few key blend shapes with various weighting can produce most lip syncs. so normally people don't actually produce 42 different shapes for each phoneme. either way you have this output that can be mapped to what ever you like with a rate input to speed up or slow down the voice. speech Recognition I was wondering if there was any more information on the speech recognition patch, such as if its an abandoned project or if theres plans on updating the patch available. I was hoping to to use the speech recognition patch in a more dynamic way than currently possible with the words being hard coded in the setting tab. So, anyone got any updates?
|
