When the Instrument Adapts to the Musician

How technology is rethinking the relationship between body and musical instrument
When the Instrument Adapts to the Musician
A boy uses EyeHarp, software designed for people with disabilities, music therapists, and teachers

A piano has 88 keys, but using it assumes that whoever sits down in front of it has two hands. The same is true for many musical instruments. A guitar normally requires one hand on the neck and one on the strings; a violin needs one for the bow and one for the notes; many wind instruments assume that certain fingers can reach certain keys. Instruments, like all objects, are designed with certain physical characteristics in mind. But what happens when that body is different?

A famous case is that of Austrian pianist Paul Wittgenstein, who lost his right arm during the First World War. Determined to continue his career, he commissioned several major composers to write works that could be performed with the left hand alone. Among these is Maurice Ravel's Piano Concerto for the Left Hand. The piano hadn't changed. What changed was the way of playing it: the music was reimagined so that five fingers could achieve results normally entrusted to ten.

Today technology allows us to go further: it can be the instrument itself that adapts to the musician's body. With an acoustic instrument, there is a fairly rigid physical relationship between gesture and sound: you have to press a key, pluck a string, blow, or move certain fingers. Electronics, on the other hand, allow these two things to be separated. A sensor can detect a movement and turn it into a command that a computer uses to produce a sound. It thus becomes possible to start not from the movements required by the instrument, but from those the person is actually able to make.

One example is EyeHarp, a digital musical instrument developed with people with severe motor disabilities in mind. Through an eye-tracking system, the software detects where the musician is looking and turns eye movements into musical commands. The interface allows not only the selection of individual notes but also work with chords, melodies, and other elements of performance. The gaze thus takes on a function normally entrusted to the hands in traditional instruments.

20181001 200934 Hor02

A different principle underlies Soundbeam, which uses ultrasonic sensors to detect movements made in space and convert them into sounds. The system can be configured according to the motor abilities of the user: a movement of an arm, a hand, or another part of the body can become a musical action. The sensitivity of the sensors also allows for the use of very small movements, expanding the possibilities for people with reduced mobility.

 

Soundbeam 03

These technologies are changing a relationship that has remained almost taken for granted for centuries. Traditionally, learning an instrument also means training your body to make the movements that instrument requires. Digital interfaces can do the opposite: start from the movements a person can control and build a way of making music on top of them. This doesn't mean that technology erases disability or any physical limitation: rather, it opens up a range of possibilities that are still only partially explored.

Faced with a person who cannot use their hands, we can then ask what movements they can make and how to turn them into music. The difference isn't just about accessibility. It concerns the very way we conceive of the musical instrument. For centuries, it was mainly the musician's body that had to adapt to the instrument. Today, at least in some cases, we can finally ask the instrument to do the opposite.

Pierfrancesco De Paolis

Pierfrancesco De Paolis

Humanist by training and communicator by profession, he lives with the conviction that words are precision instruments. He focuses on breaking down the complexity of language to make it accessible to…

Read more →

In total 349 authors have contributed to Ombre e Luci.

Leave a comment

Your comment will be published after editorial approval. Your email will not be published.

← Back to Magazine