Technical Implementation Details
Two versions of Articulated Paint were built, differing in the type of technology used for tracking the position of the brush. V1 used an infrared-light in the brush that was tracked by a camera from behind the screen. For mobility and enhanced reliability, V2 was based on a tablet screen (Wacom Cintiq). In both cases, the brush was enhanced by a bend sensor inbetween the bristles that senses the pressure applied by the brush to the screen (V1 used the common Abrahams, and V2 the smaller and more precise Flexpoint ones).
On the software side, the sound generation and interaction control was implemented in PureData. This was largely made possible through the percolate library, a physical synthesis toolkit that simulates several instruments (in this case a clarinet). The visual feedback was programmed in Processing, communicating with PureData using the OSC protocol. The sensor was accessed using an Arduino. In V1, the camera tracking was done using vvvv.
|
