A Sonification & Visualisation Hub

posted by george, June 27th, 2009

Hi All

As I’ve been thinking about what physical structures I’d like to explore in the upcomming workshop – its become clear to me that most of it is all to do with tilt sensing, and to a lesser extent, accelerometers, and that these sensor could be added to any number of physical actions or objects that we could be interacting with: inversion tables, swinging ropes, hoops, high-heeled shoes etc.

Garth has discussed his work on creating an open and flexible sensor-data routing system, that could allow any one connected to access whichever stream of sensor data they want, in a flexible and dynamic way.

Given the collaborative nature of our project and the workshop at Performance Space in particular – I’d like to find some ways to implement this idea, and perhaps extend it in some other ways, so we dont end up just working away in isolation th eentire time. My focus here is on having gestural/movement data  available to the entire ensemble for comment and extension/transformation – for those of us (Garth, Somaya, myself) who work with software that can use OpenSoundControl (OSC) i.e. Max, PD etc.

The idea is to have an infrastructure for us to ‘jam’  with eachother on sonification,  visualisation and analyis work:

• A central router would enable all the senor data to be shared accros the studio;
• I have a Max object that enables you to receive OSC sensor data via simple drop down menu – that’s automatically populated by the incoming data;
• I have fuzzy logic graphic interfaces for max that enable you to build fuzzy rules to track complex movements, or just map activity within specific ranges to specific sounds or whatever; and
• I’d like to build some graphing interfaces that would enable us to observe patterns in the sensor data (i.e. body movement/orientation) – and have this data projected onto the wall so its very big (4 meters high) and easy to observe, and point at, touch, etc.

You can leave a response, or trackback from your own site.