Playability, as in play ability, means everything to me as a composer. Last October, I was able to perform a full orchestra using just a keyboard and my hand in the air. More recently, I discovered a very intuitive and creative way to play a virtual violin – with the help of the Leap Motion Controller, a virtual instrument, and a pen.
Why motion control?
Playing regular knobs and faders sometimes forces you into awkward positions and un-musical motions, especially if you’re trying to control more than one parameter at a time. The Leap Motion Controller allows me to control more parameters than I can actually handle with touch – all at the same time. It’s motion that transforms itself effortlessly into music.
Digging into Serenade
Chet Singer’s Serenade III is a free Reaktor ensemble – a physically modelled synthesizer that mimics bowed string instruments. The pack includes two violins, two violas, a cello, and a contrabass. Using a keyboard, the bow can be controlled through gesture using a modulation wheel or fader panel, while a key provides the bow force.
Within minutes of discovering Serenade, I realized its potential. But I quickly found I wasn’t able to control it freely and musically using a mouse or standard MIDI knobs and faders. Using the Leap Motion Controller allowed me to think and play like a violinist.
Mapping in Geco MIDI
Using the music app Geco MIDI, I used three simple parameters to control the Serenade III library. (Incidentally, if you’d like to try your hand with Geco MIDI and your existing music setup, Uwyn has some amazing tutorials on their site that help you get started.)
Left and right was applied to the bow, a very natural choice since it imitates the motion of a bow on a string. Holding a heavy pen in my hand helped me to visualize the bow and move accordingly.
Up and down was applied to the “force” of the bow on the strings. Again a realistic choice, though in my case I set it upside-down. It felt more natural to me to have more force applied while I raised my hand instead of lowering it, probably because it takes more exertion to raise my hand higher.
Forward and backward was applied to the vibrato amount.
At the same time, I controlled the pitch with my left hand using my keyboard. Much like how a real violinist controls pitch by angling the bow and pressing on the fingerboard.
5 tips for Geco MIDI beginners
Want to integrate Geco MIDI with your own setup? Here’s five tips to help you get started:
- Start with a simple template. A smaller sandbox is a great place to start playing.
- Always solo the parameter you’re focusing on. Take them one at a time and fine-tune to your needs.
- Keep it simple. Too many options can get things cluttered. Less is more.
- Go to the source. Watch all the great tutorials Geert made; they cover everything.
- Get inspired. Check out all the other Geco MIDI videos from other musicians on YouTube.
Playing strings in midair
I’m not a string player, but for the first time, I experienced bowing and got into the head of a bow player. Serenade III rendered it all so beautifully that I found myself waving my pen around for hours, embellishing my new virtual technique.
Motion control generates natural flowing curves that just feel right. For most applications that I can imagine, it does so in a way that no other physical controller could ever manifest. Endless possibilities unfold themselves in my mind, and my video demonstrates just one of them. Expect many more to come!
/ Hagai Davidoff is a film and theatre composer, solo artist, producer, and virtual orchestrator from Israel. For more info and music, check out hagaid.com.
