Results

The 3rd Clarity Prediction Challenge is now complete. Results are shown below along with links to the system description papers. Further information can be found on the Clarity-2025 workshop website here.

The table below reports both the RMSE and the correlation coefficient (CC) between the predicted and actual intelligibility scores. The column 'intrusive' indicates whether the system is intrusive (i.e., requires access to the clean speech signal) or not. Links to the technical reports are also provided.

Rank	System	Paper	Intrusive	Dev RMSE	Eval RMSE	Eval Corr
1	E025	Link	Yes	22.36	24.98	0.8
2	E019	Link	No	21.87	25.31	0.79
3	E011a	Link	No	22.8	25.54	0.79
4	E020a	Link	Yes	23.15	25.6	0.78
5	E014	Link	No	22.95	25.82	0.78
6	E011c	Link	No	22.89	25.83	0.79
7	E032	Link	Yes (Text)	23.6	25.99	0.78
8	E020b	Link	Yes	23.47	26.02	0.78
9	E011b	Link	No	22.89	26.12	0.78
10	E020c	Link	Yes	24.81	26.14	0.77
11	E017	Link	Yes	24.05	26.3	0.77
12	E024b	Link	No	24.74	26.58	0.77
13	E026	Link	Yes	24.64	26.9	0.76
14	E039	Link	Yes	25.61	27	0.76
15	E024a	Link	No	24.18	27.11	0.76
16	E038	Link	Yes	24.88	27.82	0.74
17	E035	Link	Yes		27.87	0.75
18	E012	Link	No	26.28	29.07	0.75
19	beHASPI		Yes	28	29.47	0.7
20	E020c-ni	Link	No	30.16	32.74	0.65
21	E022a	Link	No	31.11	33.97	0.57
22	E022b	Link	No	33.1	35.48	0.56
23	Prior		No	40.2	41.33

Prizes

The Hearing Industry Research Consortium best system prizes were awarded to the following teams.

First place prize, 1000 GPB

Hanlin Yu¹, Haoshuai Zhou², Linkai Li^2,3, Boxuan Cao², Changgeng Mo², Shan Xiang Wang³ ( ¹University of British Columbia,Canada; ²Orka Labs Inc., China; ³Stanford University, US), for their work:
Intrusive Intelligibility Prediction with ASR Encoders [Report]

Second place prize, 500 GPB

Rantu Buragohain¹, Jejariya Ajaybhai¹, Aashish Kumar Singh¹, Karan Nathwani¹, Sunil Kumar Kopparapu² ( ¹Indian Institute of Technology Jammu, India; ²Tata Consultancy Services Limited Mumbai, India), for their work:
Non-Intrusive Speech Intelligibility Prediction Using Whisper ASR and Wavelet Scattering Embeddings for Hearing-Impaired Individuals [Report]

Third place prize, 250 GPB

Ryandhimas E. Zezario¹, Szu-Wei Fu², Dyah A.M.G. Wisnu^1,3, Hsin-Min Wang¹, Yu Tsao¹ ( ¹Academia Sinica; ²NVIDIA; ³National Chengchi University), for their work:
Non-Intrusive Multi-Branch Speech Intelligibility Prediction using Multi-Stage Training [Report]

Congratulations to all our winners!

Prizes​

Prizes