Combining a webcam, a Processing code and some plastic construction blocks
Kids can build virtually anything with plastic construction blocks. And what if we could build sound?
Processing, computer vision and an audio library made it possible. Whenever the camera sees a moving block, there is sound. Further, it sees the block colour and names it, added by colour feedback on screen.
This project in the concept was intended to play just tunes, but scanning the colour and saying it loud turned to be more fun. (I've tested with my kids and they loved!)
For documentation and other projects, please see hybrid.concordia.ca/m_guimar/cart212/