An eyebrow-raising MIDI controller for $35

video upload by Floyd Steinberg

"Mediapipe + OpenCV caused a big stir some 4 years ago, but I never got around trying it myself. Until today, and of course I'm sharing my results with you. This Open Source software can detect gestures, poses and facial expressions and transform them to so called landmarks that can easily be used for all kinds of shenanigans (in this example: controlling your synths).

00:00 introduction: what's this?
00:38 demo 01: playing chords + bass + controlling filters
01:32 hardware needed
02:12 installation
02:56 what are OpenCV and Mediapipe?
03:55 this example explained: reading landmarks, converting to MIDI
06:35 demo 02: controlling an arpeggiator
07:37 demo 03: controlling filter cutoff frequency and pitch bend with my eyebrows
09:21 demo 04: playing pads on Akai MPC Live 3 with backing track
10:10 conclusion / do the YouTube thing!"

Where to get the stuff: [affiliate links]
Mini camera: Amazon DE | Amazon US
RasPi Zero 2: Amazon DE | Amazon US
SD card: Amazon DE | Amazon US

Installation instructions

sudo apt update
sudo apt upgrade
pip install mediapipe opencv-python --break-system-packages
git clone https://github.com/mrfloydst/eyebrowr...

then python3 ./hand.py or python3 ./eyebrow.py

HÄLP ZIS CHANNEL
https://www.patreon.com/floyd_steinberg
https://floydsteinberg.gumroad.com/
https://floydsteinberg.bandcamp.com/"