ABSTRACT
The sense of hearing provides humans with information about their surroundings and is the primary means of communication, yet it is limited in its ability to focus on particular stimuli. To provide this ability, we designed and built S5, a mobile proof-of-concept prototype that allows Selective Sensing of Single Sound Sources. Our design consists of a head-mounted directional microphone attached to a smart-phone, which acts as controller, filter and amplifier. Users hear the selective signal through headphones and activate the device by touching their ear. To evaluate this sensory augmentation, we conducted a study with 16 participants that showed the system was appealing and perceived as useful. Based on our findings, we conclude that the proposed augmentation is feasible and we provide insights for further development of the concept.
- Robert Albrecht, Tapio Lokki, and Lauri Savioja. 2011. A Mobile Augmented Reality Audio System with Binaural Microphones. In Proceedings of Interacting with Sound Workshop: Exploring Context-Aware, Local and Social Audio Applications (IwS '11). ACM, New York, NY, USA, 7--11. Google ScholarDigital Library
- Florian Heller and Jan Borchers. 2014. AudioTorch: Using a Smartphone As Directional Microphone in Virtual Audio Spaces. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 483--488. Google ScholarDigital Library
- Florian Heller and Jan Borchers. 2015. AudioScope: Smartphones As Directional Microphones in Mobile Audio Augmented Reality Systems. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 949--952. Google ScholarDigital Library
- Syed Naseh Hussaini. 2011. Mobile SoundAR: Your Phone on Your Head. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, New York, NY, USA, 1777--1782. Google ScholarDigital Library
- Helen Sharp, Yvonne Rogers, and Jenny Preece. 2007. Interaction design: beyond human-computer interaction. (2007). Google ScholarDigital Library
- Ruiwei Shen, Tsutomu Terada, and Masahiko Tsukamoto. 2012. A System for Visualizing Sound Source Using Augmented Reality. In Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia (MoMM '12). ACM, New York, NY, USA, 97--102. Google ScholarDigital Library
Recommendations
The effect of symmetric and asymmetric directional binaural listening on speech understanding with surrounding cocktail party noise
The development of new augmenting hearing devices is reducing the separation between smart listening technologies and hearing aids. They both alter the way people perceive surrounding acoustic sources. One of their common goals is reducing the effect of ...
Interactive Auditory Mediated Reality: Towards User-defined Personal Soundscapes
DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems ConferenceMany people utilize audio equipment to escape from noises around them, leading to the desired isolation but also dangerously reduced awareness. Mediation of sounds through smarter headphones (e.g., hearables) could address this by providing non-uniform ...
Augmenting Human Hearing Through Interactive Auditory Mediated Reality
UIST '18 Adjunct: Adjunct Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyTo filter and shut out an increasingly loud environment, many resort to the use of personal audio technology. They drown out unwanted sounds, by wearing headphones. This uniform interaction with all surrounding sounds can have a negative impact on ...
Comments