PhysioSonic - Documentation/Videos
Here you may find videos to the paperPhysioSonic - Movement sonification as auditory feedback
submitted to ICAD09 for reviewing
- The first video shows creaking sounds, that are linked to deviations of the thorax. (This kind of compensatory movement is often reported for shoulder patients.)
Creaking thorax - This video shows a wood scenario, where different heights of the arm are linked to different slices, represented by auditory slices of a forest (a creek at the bottom, added and followed by frogs, crickets, pigs and finally birds and the wind in the trees). This scenario is meant to adjust the correct position of the arm together with a therapist. When the arm leaves the colateral plane, the signal is strongly filtered.
Forest Scenario - In the next example, the continuous arm movement triggers a sound file (an invention of J.S.Bach). If the movement stays inside a certain velocity range, the playback is normal. If the movement slows down, the playback gets stuck like a disk. Again, the leaving of the colateral plane leads to strong filtering.
In this example, the testing person explores the whole movement space.
Bach Trials - Finally, a training scenario links the creaking of the thorax and the movement of the arm. A pseudo-patient is shown, supposing to have difficulties in lifting the arm without moving the thorax.
Bach Patient