Brian writes in with the following:"I came across this program while searching for a PC version of Metasynth. It can use either live video or a picture and converts it to sound. Lots of experimental stuff too - using the mouse position as input, sonifying a URL (?!), and much more. Very cool!...
It actually uses images (either video or still pictures) to generate sound. I've attached an AVI illustrating what was generated from a wolf picture. You can apply a filter for what colors to use - kind of a spectrogram ran backwards. Speaking of, I attached another AVI illustrating what a spectorgram (made in Audacity) of me saying "funky town" sounds like after running it through vOICe. There's even a mode for entrainment of brain waves (must register to use that mode)!" Videos below.
via http://www.seeingwithsound.com/
"The vOICe vision technology for the totally blind offers the experience of live camera views through sophisticated image-to-sound renderings. In theory this use of digital senses could lead to synthetic vision with truly visual sensations ("qualia") through crossmodal sensory integration, by exploiting the existing multisensory processing and neural plasticity of the human brain through training and education. The vOICe implements a form of sensory substitution where the goal is to bind visual input to visual qualia with a minimum of training time and effort, and improve quality of life (QoL) for blind users."
Update via Brian in the comments: "I tried to sonify the Matrixsynth page URL, but I got an error of "Too many links" :)"
The vOICe Wolf
YouTube via matrixsynth | Mar 1, 2011 |
The vOICe Funkytown
