Interactive sound displays

As part of the research project Tangible Signals, three tangible user interfaces were developed, that use sensor technology in combination with mechanical actuators to provide an interactive physical display of sound and music data for people with visual impairments. The interfaces can be used either separately or combined as input and output devices utilizing pin-based, string-based and wheel-based interaction elements. Sound and music aspects like patterns, envelopes, volume, filter and EQ settings can be physically displayed and manipulated.

The interfaces can be used as standalone MIDI devices or as tangible representation of sound aspects in the text-based music software WELLE.

The Tangible Signals research project is funded with the DOC fellowship by the Austrian Academy of Sciences, starting June 2019.

 

Demo of the prototypes at TEI'21

 

Tangible Pins © photo by Jens Vetter
Tangible Pins © photo by Jens Vetter
Tangible String © photo by Jens Vetter
Tangible String © photo by Jens Vetter
Tangible Wheel © photo by Jens Vetter
Tangible Wheel © photo by Jens Vetter

live concert featuring the Tangible String interface and WELLE software at Phonos Barcelona during the ESPORA artist-in-residency.