Results
The 1st Clarity Enhancement Challenge is now complete. Results are shown below along with links to the system description papers. Further information can be found on the Clarity-2021 workshop website here.
The tables below present median results on the evaluation dataset for the initial MBSTOI evaluation for noise (eval-noise) and speech (eval-speech) interferers, and the listening test results for 27 hearing-impaired listeners for noise (eval-noise) and speech (eval-speech) interferers. Links to the system reports are also provided.
| Rank | ID | Team | Paper | MBSTOI (noise) | MBSTOI (speech) | Listener (noise) | Listener (speech) |
|---|---|---|---|---|---|---|---|
| 1 | E009 | Sheffield | Link | 0.693 | 0.693 | 80.426 | 82.432 |
| 2 | E007 | Brno | Link | 0.678 | 0.678 | 75.424 | 81.498 |
| 3 | E002 | Sheffield | Link | 0.672 | 0.672 | 0 | 0 |
| 4 | E013 | ELO-SPHERES | Link | 0.653 | 0.653 | 83.613 | 82.895 |
| 5 | E010 | Music Tribe | Link | 0.639 | 0.639 | 72.222 | 77.778 |
| 6 | E003 | Googlears | Link | 0.632 | 0.632 | 85.532 | 4.444 |
| 7 | E021 | Oldenburg | Link | 0.611 | 0.611 | 84.914 | 83.929 |
| 8 | E019 | Oldenburg | Link | 0.607 | 0.607 | 86.726 | 86.885 |
| 9 | E016 | Oldenburg | Link | 0.603 | 0.603 | 0 | 0 |
| 10 | E004 | Tencent/Shenzhen | Link | 0.558 | 0.558 | 60.593 | 44.681 |
| 11 | E018 | Tencent/Shenzhen | Link | 0.524 | 0.524 | 0 | 0 |
| 12 | E005 | Hannover | Link | 0.481 | 0.481 | 0 | 0 |
| 13 | E001 | Baseline | Link | 0.282 | 0.282 | 33.202 | 51.152 |
Prizes
The Hearing Industry Research Consortium prizes were awarded as follows:
The prizes for the MBSTOI evaluation were awarded to the Brno University of Technology team (first place), the Music Tribe team (second place) and theELO-SPHERES Consortium (third place). The University of Sheffield team was not eligible to win prizes due to connections with the organisers.
The overall prizes for the listening test evaluation were awarded to the University of Oldenburg team (first place) and the ELO-SPHERES Consortium (second place). In the noise interferer category, the University of Oldenburg and Googlears teams were the best performers, while in the speech interferer category, the University of Oldenburg team and ELO-SPHERES Consortium were the best performers. For a discussion of the differences in performance for the noise and speech interferers, see the [YouTube video].
The Amazon student prizes were awarded to Katerina Zmolikova from the Brno University of Technology team (first place), Tomas Gajecki from the Medical University Hannover team (second place), and Xi Chen from Shenzhen University, who was an intern at Tencent while working on this challenge (third place).
Congratulations to all our prize the winners!