PoseNet in Tensorflow.js

PoseNet in a machine learning model which allows for real-time human pose estimation with any webcam. In collaboration with the Google Creation lab, I open-sourced an easy to use Tensorflow.js version of the model.

NIME: The Liquisynth

The Liquisynth is a musical instrument and live performance that modulates sounds in response to the characteristics of liquids as they mix, as a combination of randomness and control.

Presence

Presence is a kinetic scultpure that use pose estimation powered by PoseNet to perceive and mimic the form of the viewer. It was shown at the 2018 Makerfaire.

The Self-Driving Human

The self-driving human is a device and performance where an intelligent portable agent makes decisions for participants in the real world. It is my masters thesis at ITP.

BodyPix in Tensorflow.js
BodyPix in an open-source machine learning model which allows for person and body-part segmentation. In collaboration with researchers at Google I open-sourced a Tensorflow.js version of the model.
The Pursuit by Equinox

The Pursuit by Equinox is a gamified group cycling class driven by 500,000 records of data per session to display a Canne’s Lion winning visual experience. 700+ classes are hosted per month at Equinox locations across the United States. I was the lead developer on this project.

Presence - Gaze Detection Version 1

Presence is a kinetic sculpture that is controlled by a viewer’s gaze. It uses a webcam and computer vision to detect where a user is looking, and alters its shape to reflect this focal point.

StarPower

StarPower is an led sculpture consisting of 12 frosted tubes placed precisely in a circle and high frame-rate addressable leds allowing for smooth animations projected onto a circle.

Voronoi Cellular Zoetrope
A physical animation generated by graphics shaders that loops seamlessly and infinitely
Audial Reality

Visualizes sound in real-time in the browser using audio, react, shaders, and procedural noise. Accessed at audialreality.com

Infinity Zoetrope

The infinity zoetrope blends reality with the imagination by transforming an analog form into something limitless. It was performed at the Museum of the Moving Image for Shantell Martin’s Drawing on Everything class. By capturing a rotating disk at the right framerate with digital means, an infinite loop can be extended into another dimension through colors and transformation.

Shadybot Art Car at Burning Man

The ShadyBot is an art car for the Robot Heart camp at Burning man.
It is shaped like a fish whos features provide a shady lounge and deck for spectactors, and at night has LEDs that project across its diffused surface. At the 2018 event, I helped build it, wire its LEDs, and was responsible for mapping and programming the visuals.

Japanese Weather Diorama
A physical twist on a Japanese Weather Diorama which reflects weather patterns and times of the day.
Mova Gallery at the Oregon Eclipse Festival - Lighting

The Mova Gallery is an installation which features visionary art and appears at different festivals around the world. During the Oregon Eclipse festival, it was built as a two-story structure, and I was in charge of the lighting.