Localization in Audio Augmented Reality systems using binaural signals

Audio Augmented Reality systems create a for the user indiscernible synthesis of existing sounds from the environment and artificially generated sound sources. By using individualized HRTFs, the artificial sources can be placed virtually in the user´s surrounding. The resulting system consists of headphones with integrated microphones and a mixer which controls the ratio between the sounds directly routed from the microphones to the headphones and the virtual sound sources.

For the binaural synthesis of the the artificially created sound field, a precise tracking of the position and orientation of the user´s head is needed. Acoustical tracking using binaural signals in combination with anchor sources is advantageous because the needed In-Ear microphones are already part of the system and the tracking data is present at the user end.

The project focuses on creating a setup for an acoustic tracking system using binaural signals as well as measurements of position and orientation in presence of different kinds of background noise. Furthermore the impact of the ancor sources on the artistic creation of content for Audio Augmented Reality systems is being investigated.