This is a quick example that explores what happens when you mix up Microsoft's Kinect with interactive video and dynamically generated audio. It's a simple mash up of several open-source code projects with a little of my own code to tie up some loose ends.
The application in the back is the server app which handles the computer vision and sends out the location of the blobs, etc. The application in the front is the client app which receives the data from the server app and manages how the visual and audio react to this info. Moving to the left of center rewinds faster. Moving to the right of center fast forwards the video. Audio is generated on-the-fly based on the location of the movement.
The Server Application
– Playing off of Theo Watson's openFrameworks (OF) Kinect magic. http://vimeo.com/16734124
– SimpleGuiToo by Memo (http://www.memo.tv/) based off of Todd Vanderlin's (http://vimeo.com/vanderlin) magic.
– Protocol code inspired and partially sampled from the Rockwell Group. http://lab.rockwellgroup.com
– Playing off of Theo Watson's openFrameworks (OF) Kinect magic. http://vimeo.com/16734124
– SimpleGuiToo by Memo (http://www.memo.tv/) based off of Todd Vanderlin's (http://vimeo.com/vanderlin) magic.
– Protocol code inspired and partially sampled from the Rockwell Group. http://lab.rockwellgroup.com
The Client Application
– Video by The Ronin. http://theronin.co.uk
– Code for controlling the interactive video plays off of OF's moviePlayerExample. Moving the center-point of my hand to the left of the frame rewinds the video. Moving my hand to the right fast forwards it. The closer my hand is to the center, the slower it reverses/fast forwards.
– Maximilian, the c++ audio synthesis library by Dr MG, with the port to OF by Arturo Castro. I love that top left corner – it reminds me of all the best video games from the 80s. http://www.maximilian.strangeloop.co.uk/
– The motion-tracking of the tops of the light poles was achieved via an old After Effects script I wrote years ago. The motion-tracking keyframes are exported as an XML out of AE. They are then imported into OF and the small circles and connecting lines on top of the light poles are drawn in real-time based on the current frame of the video, connecting to the center-point of my hand.
– Video by The Ronin. http://theronin.co.uk
– Code for controlling the interactive video plays off of OF's moviePlayerExample. Moving the center-point of my hand to the left of the frame rewinds the video. Moving my hand to the right fast forwards it. The closer my hand is to the center, the slower it reverses/fast forwards.
– Maximilian, the c++ audio synthesis library by Dr MG, with the port to OF by Arturo Castro. I love that top left corner – it reminds me of all the best video games from the 80s. http://www.maximilian.strangeloop.co.uk/
– The motion-tracking of the tops of the light poles was achieved via an old After Effects script I wrote years ago. The motion-tracking keyframes are exported as an XML out of AE. They are then imported into OF and the small circles and connecting lines on top of the light poles are drawn in real-time based on the current frame of the video, connecting to the center-point of my hand.
