THE FUTURE OF MUSIC: ROBOT CONTROLLER + 3D VIDEO

YouTube Uploaded by valopornolove on May 25, 2011

"Is collaboration between humans and robots possible in music? Now the answer is yes.

This is a live performance-demonstration of an innovative research project made by Italian Institute of Technology (IIT - Advanced Robotics Department), mixing electronic music, a robot arm as a music interface, and the experience of interactive 3D projections.

The robot interacts with the artist to create and modify musical parameters during the performance. On the background, 3D figures represent the robot trajectories, figuring musical parameters.

Artist: Valerio Solari (K)
soundcloud.com/​veryelectromusic

Credits: Victor Zappi - Antonio Pistillo - Sylvain Calinon - Andrea Brogni - Darwin Caldwell iit.it

Project Abstract: "The availability of haptic interfaces in music content processing o ers interesting possibilities of interaction between human users and novel instruments and controllers for musical expression. The capability to precisely modulate haptic feedback on the user establishes a direct connection with the sonic output, which enhances the modalities of artistic content creation. The use of robots as both manipulators and actuated interfaces o ers new perspective in a combined context of human-robot interaction and music playing. With this project we investigate the use of a compliant robotic arm as a bidirectional tangible interface for musical expression. We exploited the robot capabilities to con gure a system in which a human user and the robot interact for the creation of recursive modulations of music parameters. An experimental session has been carried out with the collaboration of a musician, who performed with the robot as part of his live stage setup.""