Role: Software Lead

Location: Red Hook, Brooklyn, NY

Client: A_DA

Work: Technoechophenomena is an interactive audio and light experience, based on the music and work of Moses Sumney. It was created by Sumney in concert with A_DA, the interactive arm of Listen, with technical sponsorship from Microsoft.

I contributed to the project as the Kinect Developer and Software Systems Architect. Using 4 Kinect Azure cameras, I parsed data about user location and body position. This included writing a custom pose detector using the C# Kinect Azure API. User data from each camera was then combined and unified into a single data feed.

The user data feed was then used by a custom cue management system, written in node.js. The cue manager forwards cues in real time to both the audio and lighting systems, using OSC and sACN, respectively.

Technology: C#, Kinect Azure API, Node.js, OSC, sACN

Publication: Moses Sumney’s technoechophenomena As Therapy