players-10

Fensadense


Summary

An hour-long technologically enhanced children’s music show and international tour. Ten musicians’ movements were tracked in real time and fed through custom motion and audio mapping software to affect lighting and sound throughout the performance.

Press

Role

Music, Lighting, and Production Asst., Systems Developer

Budget

$300,000

Venues

Lucerne, Luxembourg, Baden

Timeline

Research (8 months), Production (3 months)

Technologies

Node.js, Objective-C, iPads, ArtNet, OSC, MusicXML, Audio DSP, Bluetooth, Myo Bands, MIDI, GrandMA, Soundcraft Vi7000, LED Moving Lights

Hyperinstrument Research

In the Fall of 2014, I began investigating ways of enhancing musical improvisation using sensing and mapping technology. My research, under the direction of Tod Machover, eventually evolved into the development of a piece for the Lucerne Music Festival in August 2015.

Musician Sensors

Myosin Sensors were used to track accelerometer, gyroscope, and orientation data which was then fed via bluetooth to an iPad placed at each musician’s station. The data was then used to augment each musician’s artistic expression.

Musician iPad Application (Music Display, Relay of Sensor Data):

I developed a stand-alone iPad application that both displayed and triggered music for each musician and relayed their sensor data to the network.

Full Show Production

Hyperproduction (Production Control and Mapping Software):

My team and I designed and built an entirely new and versatile networked mapping and control software, Hyperproduction; this system is a node-based graphical programming language that can control, map, and network hundreds of inputs to hundreds of outputs across any number of devices and systems.

Render Designer (Light and Visual Mapping and Control Software):

Led by Peter Torpey, I helped design and program the pixel mapping for the LED strips situated behind each musician. This mapping was then fed into Render Designer, a custom piece of software that allows any visual medium to be mapped across a pixel array.

Musician Platforms and Lights:

Each musician performed on their own platform, fixed with two speakers, iPad, network connection, and two LED strips that would change color, intensity, and motion in response to their playing.

Rehearsals:

Loading