Projects

Proximities

Interactive image and sound

Instrumental Proximities, lines connecting the hands and the face
Instrumental Proximities. Lines connect the hands and the face.

Proximities is two apps for interactive image and sound. Lines are drawn across what each app tracks, and the movement makes ambient sound. The difference is what is tracked.

Instrumental Proximities tracks the face and the hands, including the lips. Lines connect those points. The height of a hand, the speed of a gesture, and the opening of the mouth each change the sound.

Body Proximities tracks the hands and the center of the body, and the extremities of the legs as well. Lines run from that center out through the hands and the legs, and the sound answers how near the hands come.

I use them sometimes in Born in Latent Space, to generate a sense of intimacy, and at the same time a relationship with the face and the lips, and with how near the hands come to the face. Both are built with p5.js, MediaPipe, and Tone.js.

Proximities. Watch on YouTube