Core Software
The code is provided as a GitHub repository containing individual Python tools and a complete baseline system. Tools will allow the processing of individual scenes or the bulk processing of the complete Clarity dataset. The key elements of the baseline system are the:
- Scene generator.
- Hearing aid processor baseline.
- HASPI speech intelligibility model.
Additional tools are available to use as you see fit. These include a hearing loss model, differentiable source separation and hearing aid amplification modules and an alternative intelligibility model.
A. Scene generator
Fully open-source python code for generating hearing aid inputs for each scene
- Inputs: target and interferer signals, HOA-IRs, RAVEN project (rpf) files, scene description JSON files
- Outputs: Mixed target+interferer signals for each hearing aid channel, direct path (simulating a measurement close to the eardrum). Reverberated pre-mixed signals can also be optionally generated.
B. Baseline hearing aid processor
The baseline hearing aid consists of a NAL-R fitting amplification stage [1] followed by a simple automatic gain compressor. It produces output signals in 16-bit wav format ready for HASPI or listening test evaluation.
- Inputs: Inputs for each hearing aid channel and audiograms to characterise the listeners.
- Outputs: Stereo hearing aid (HA) outputs signals.
C. HASPI Speech Intelligibility model
Python implementation of the Hearing Aid Speech Perception Index (HASPI) model which is used for objective intelligibility estimation. This will be used in the stage 1 evaluation of entrants (see Rules).
- Inputs: reference target signal (i.e., the premixed target signal convolved with the BRIR with the reflections “turned off”, specified as ‘target_anechoic’), HA output signals, audiogram, level reference (level in dB SPL which corresponds to 0 dB FS)
- Outputs: predicted intelligibility score It is important to remember that both reference target and HA output signals have to be calibrated to the same dB SPL level before calculating HASPI.
References
[1] Byrne, Denis, and Harvey Dillon. "The National Acoustic Laboratories'(NAL) new procedure for selecting the gain and frequency response of a hearing aid." Ear and hearing 7.4 (1986): 257-265.