The experiments in the video explored what happens when you combine a Kinect camera with generative design at home, as part of an art installation and as a storefront display.

 

In the video, the application to the left is the server app which analyzes the incoming video from the Kinect, identifies the regions of interest / blobs and sends out the location of the blobs, etc. In the foreground to the right, the Presentation (client) applications receive the data from the server app. The Presentation application manages how the visuals react to the incoming data. A third application for the storefront window projections controls when and what content (immersive artwork, designs and ads created in openFrameworks, Processing and Flash Builder) based on a playlist retrieved from a database. This app monitors the health of the server and client apps, attempts to diagnose and fix any issues and keeps the admin posted on the status of the system. 

 

The Server Application
– Playing off of Theo Watson's openFrameworks (oF) Kinect magic. 
– SimpleGuiToo by Memo based off of Todd Vanderlin's magic.
– Protocol code inspired and partially sampled from the Lab @ Rockwell Group.

 

The Client Applications
Created using various apps/frameworks including Flash Builder, Processing and openFrameworks.
– At various times I used an enhanced version I made of the HYPE framework. 
– Pong game by Seb Lee-Delisle, integrated w/Kinect by Woohoo

 

The Player + Dr Application
Created using openFrameworks, PHP and MySQL

 

Music: MIA: Paper Planes