HoloBand is a clinical tool for audiovisual music perception training in augmented reality (AR) using the Hololens 2 for the hard-of-hearing (HoH).

It consists of two interfaces: a spatial environment in AR for the HoH user and a computer interface to control the training for speech and language pathologists (SLP).

We adopt a participatory exploratory research approach to investigate novel ways of conducting timbre discrimination, audio localization, and pitch recognition. HoloBand is evaluated using a focus group with SLPs (n=6) and interpreted through inductive thematic analysis.

Hololens 2 shows relevant contextual, visual capabilities to enhance music perception training. However, a closer integration into the clinical workflow and a task-oriented approach is necessary to bring real-life scenarios to the clinical setting.

Paper published at AES 2022

It is available at the website.

Ivanyi, B., Tsalidis, C., Naylor, S., Tjemsland, T., Adjorlu, A., Kepp, N. E., & Serafin, S. (2022, August). HoloBand: An Augmented Reality Experience to Train Music Perception for the Hard of Hearing. In Audio Engineering Society Conference: AES 2022 International Audio for Virtual and Augmented Reality Conference. Audio Engineering Society.