SPIN: AI-Music Synthesizer from Arvind on Vimeo.
SPIN is an AI music synthesizer that allows you to co-create compositions with a language model, MusicGen. It is a playful invitation to explore the nuances of algorithmic music, encouraging you to slow down and zoom in on its artifacts. It celebrates the marriage between human and machine creativity through music."
via Arvind Sanjeev
"SPIN is an AI music synthesizer that allows you to co-create compositions with a language model, MusicGen. It is a playful invitation to explore the nuances of algorithmic music, encouraging you to slow down and zoom in on its artifacts. It celebrates the marriage between human and machine creativity through music.
SPIN breaks down the process of co-composing music with an AI using a tangible interface. Enter the desired mood, genre, sounds and bpm to listen to the music come alive on an LP record. A DVS (Digital Vinyl System) allows you to slow down, zoom in, scratch and listen between the notes. Use it to create new compositions, as a simple sound synthesizer, as a playful scratch tool, or to play relaxing music in the background.
SPIN is an artifact from a future where music will be hyper-tailored to people’s tastes and preferences. It is an explorer of musical curiosities that can generate music unlike anything heard before, blending unheard-of combinations of sounds, rhythms and harmonies. This opens up exciting possibilities for pushing the boundaries of music and creating entirely new micro-genres. Who’s ready for some happy, death-metal, disco?
Under the hood, SPIN takes the input prompts in the form of button presses through an Arduino Mega. This is sent via serial to a Raspberry Pi which prompts the MusicGen API. An mp3 file is received as the output which is loaded onto a Digital Vinyl System (DVS). A transmuted Numark PT-01 and a timecoded control vinyl record serve as the turntable. The Xwax DVS package for Raspberry Pi reads the vinyl timecode through a Behringer audio driver, and the output is played via stereo speakers.
There are a lot of amazing generative music experiments, from Dadabots’s relentless death metal streaming AI on YouTube to Holly Herndon’s experiments around voice transplantations. But I realized we hit a tipping point when I stumbled upon the Riffusion music model; I was taken aback by its depth and realism, including its new update that adds lyrical voices to the output. Inspired by this, I wanted to build a platform to let me further explore and combine never-before-heard combinations of music and sounds. This laid the seed for building SPIN.
I wanted SPIN to encourage people to be playful; having a scratch interface served this purpose. A DVS (Digital Vinyl System) adds an extra dimension while listening to the generated compositions. It allows us to slow down these synthetic tunes and listen between the notes. So, I decided to combine a DVS system with the MusicGen API in the form of an old-school synthesizer."
