PoseNet in Tensorflow.js

PoseNet in a machine learning model which allows for real-time human pose estimation with any webcam. In Collaboration with the Google Creation lab, I open-sourced a Tensorflow.js version, allowing for it to be tinkered with and used in the browser with just a few lines of code.

NIME: The Liquisynth

The Liquisynth is a musical instrument and live performance that was created for the NIME class at ITP and Creating for Interactive Media taught by Morton Subotnick. It modulates sounds in response to the characteristics of liquids as they mix, as a combination of randomness and control.

Presence at the MakerFaire: with PoseNet

Presence at the MakerFaire was a modification of the existing Presence kinetic scultpure to use pose estimation powered by PoseNet as a form of gestural control. It was presented at the 2018 Makerfaire, where its inaccuracies brought out entertaining behaviors from the viewers.

The Self-Driving Human

The self-driving human is a device and performance where an intelligent portable agent makes decisions for participants in the real world. It is my masters thesis at ITP.

BodyPix in Tensorflow.js

BodyPix in an open-source machine learning model which allows for person and body-part segmentation. In collaboration with researchers at Google I open-sourced a Tensorflow.js version, allowing for it to be tinkered with and used in the browser with just a few lines of code.

The Pursuit by Equinox

The Pursuit by Equinox is a gamified group cycling class driven by 500,000 records of data per session to display a Canne’s Lion winning visual experience. 700+ classes are hosted per month at Equinox locations across the United States. I was the lead developer on this project.

Presence

Presence is a kinetic sculpture that is controlled by a viewer’s gaze. It uses a webcam and computer vision to detect where a user is looking, and alters its shape to reflect this focal point.

StarPower

StarPower is an led sculpture consisting of 12 frosted tubes placed precisely in a circle and high frame-rate addressable leds allowing for smooth animations projected onto a circle.

Voronoi Cellular Zoetrope

A physical animation generated by graphics shaders that loops seamlessly and infinitely

Audial Reality

Visualizes sound in real-time in the browser using audio, react, shaders, and procedural noise. Accessed at audialreality.com

Infinity Zoetrope

The infinity zoetrope blends reality with the imagination by transforming an analog form into something limitless. It was performed at the Museum of the Moving Image for Shantell Martin’s Drawing on Everything class. By capturing a rotating disk at the right framerate with digital means, an infinite loop can be extended into another dimension through colors and transformation.

Shadybot Art Car at Burning Man

The ShadyBot is an art car for the Robot Heart camp at Burning man.
It is shaped like a fish whos features provide a shady lounge and deck for spectactors, and at night has LEDs that project across its diffused surface. At the 2018 event, I helped build it, wire its LEDs, and was responsible for mapping and programming the visuals.

Japanese Weather Diorama

A physical twist on a Japanese Weather Diorama which reflects weather patterns and times of the day.

Mova Gallery at the Oregon Eclipse Festival - Lighting

The Mova Gallery is an installation which features visionary art and appears at different festivals around the world. During the Oregon Eclipse festival, it was built as a two-story structure, and I was in charge of the lighting.