Matti from NYU and Talking Synths

video upload by The MIDI Association

"MIDItoSpeech is a set of software and tools to 'speak' the affordances on the synthesizers using a computer. Our model relies on MIDI transmission of parameters as affordances are touched on the synth. This is being designed as both a Max patch / Max4Live device as well as a website using the Web MIDI API. In both cases, there is a community-driven repository of JSON files (the ‘devices’ folder) for models of synthesizers that describe their NRPN / CC values with labels, enumerators, etc.

Manufacturers can develop these JSON files as part of their production pipeline, and community members / enthusiasts can develop them for legacy synthesizers, open source initiatives, etc. As a second-order benefit, these files can be used for translanguaging as well as access (i.e. you could have distinct JSON files for a synthesizer in English, Mandarin, Spanish, etc.).

This work is led by Luke DuBois Technology, Culture and Society Department Co-Chair; Director of Research, Integrated Design and Media; Professor and member of The MIDI Association's Music Accessibility special interest group"

Stefanie Koseff from the Tandon School at NYU explains making synthesizers more accessible.

video upload by The MIDI Association

"This work is led by Luke DuBois Technology, Culture and Society Department Co-Chair; Director of Research, Integrated Design and Media; Professor and member of The MIDI Association's Music Accessibility special interest group"

Also featuring Dina Pearlman of the Alan R Pearlman Foundation.