Body Multi-Tracker
An app to track from one to four bodies, and to send different kinds of data.
Open the live appGitHubProximities
Body Multi-Tracker is an app to track from one to four bodies, and to send different kinds of data. A webcam watches the performers. I click the points that matter, a hand, a fingertip, the head, a knee, and the app streams that movement.
The data can go out as MIDI to Ableton Live, or to any synthesizer that accepts MIDI. The same points can go out as OSC, Open Sound Control, for other software. In Controllers mode, each point sends two control changes, X and Y. In Notes mode, height plays a pitch and speed sets the loudness.
It tracks 46 points per person, including the head, the torso, the limbs, and all five fingertips. Nothing is uploaded. The tracking happens on the computer in front of you.

