Clarity logo
The 4th Clarity Workshop on Machine Learning Challenges for Hearing Aids (Clarity-2023)
ISCA logo

Results

Results are shown for all submitted systems. For RMSE scores, small values are best. For correlation coefficients (corr), large numbers are best. The table also identifies which systems are intrusive and which are non-intrusive. The system labeled 'prior' simply returns the training set average sentence intelligibility for all sentences. The beHASPI system is the baseline supplied by the organisers.
Rank Team Paper Intrusive? RMSE Corr
E011 [paper] No 25.1 0.78
E002 [paper] No 25.3 0.77
E009 [paper] Yes 25.4 0.78
E022 [paper] Yes 25.7 0.77
E023 [paper] No 26.4 0.76
E016 [paper] No 26.8 0.75
E025 [paper] No 27.9 0.72
beHASPI Yes 28.7 0.70
E003 [paper] No 31.1 0.64
E024 [paper] No 31.7 0.62
E015 [paper] No 35.0 0.60
E020 [paper] No 39.8 0.33
Prior No 40.0 -

Prizes


The Hearing Industry Research Consortium best system prizes were awarded to

  • 1st place: Cuervo and Marxer, Temporal-heirarchical features from noise-robust speech foundation models for non-intrusive intelligibility prediction for best performance overall performance,
  • 2nd place: Mogridge et al., Pre-training intermediate ASR features and Human memory simulation for non-intrusive speech intelligibility prediction in the Clarity Prediction Challenge 2 for 2nd best overall score.
(Note, although 1st and 2nd place systems had very similar RMSE scores, a paired t-test showed that the difference was highly significant).

Congratulations to the winners!


[TOP]