Concept:

The movements of a skate dancer act as triggers for music effects. Multiple skaters can perform at once, improvising with each other and collectively remixing a song.

How:

  1. Teachable Machine – webcam captures the live video of the dancers and PoseNet is used to track their body positions, which are then analyzed by an algorithm that has been trained to recognize distinct, common dance moves. When a certain dance move is recognized (above a certain percentage of accuracy), it triggers its designated sound effect through a Max patch into Ableton Live.

Tutorials:

April 9, 2021