The next stage in adding assignment control the AV16-4 Pure Data experimental audio-visual instrument is to build in the ability to manipulate data provided via the Leap Motion controller. Alongside TouchOSC control and joystick manipulation this allows three interfaces to access the software without requiring access to the keyboard or mouse.
To get Pure Data to respond to data created by Leap Motion, GECO is used as a data routing application. The following gestures are created to be used within the interface:
Left and Right Position (closed right hand) – MIDI Channel 1 / MIDI Message 3
Up and Down Position (closed right hand) – MIDI Channel 1 / MIDI Message 4
Left and Right Position (open right hand) – MIDI Channel 1 / MIDI Message 5
Up and Down Position (open right hand) – MIDI Channel 1 / MIDI Message 6
Although there are many more controls to be utilised within GECO, for this experiment, definite movements are considered a priority to allow for accuracy within use of the interface. In practical usage, these assignments generate similar data to the X-axis and Y-axis parameters of the joystick. Having open and closed movements allow easy switching between two sets of data.