Recently I put my hands on the kinect and i started to make some experiments about augmented reality applied to advertising field.
These are just prototypes of interactive applications and they just show different possibilities and functionalities.
These are just prototypes of interactive applications and they just show different possibilities and functionalities.
AR: augmented reality
Thanks to kinect depth sensor we are able to know how far away from camera is each pixel of the image, so it's quite straightforward to "extrude" the image back to the world space and reconstruct the live scene into a 3d virtual space.
Once the 3d scene is recreated, you can augment reality by placing objects:
Next sample uses the easier principle related to space: distance.
Using data from skeleton reconstruction we know in realtime where the person is and what is doing.
Once we know user position in the virtual space we can evaluate his distance from target objects and use it to trigger behaviours and graphic elements.
Once we know user position in the virtual space we can evaluate his distance from target objects and use it to trigger behaviours and graphic elements.
Here there is simple specification text associated to three objects in the room.
Another funny possibility is actually to create artificial intelligent virtual agents that behave according to user's body movements. This kind of interaction is highly addictive and playful.
Next sample shows a simple cross gesture recognition that allows the user to interact with virtual objects and change their characteristics:
VR: virtual reality
One simple experiment consists in link the virtual camera to the user's head.
You get an extension of the real world into the virtual scene.
You get an extension of the real world into the virtual scene.
Body tracking offers infinite ways to interact with the objects in the virtual scene. Imagination is the only limit...
