A comparison study of automatic speech quality assessors sensitive to packet loss burstiness

The paper delves the behavior rating of new emerging automatic quality assessors of VoIP calls subject to bursty packet loss process. The examined speech quality assessment (SQA) algorithms are able to estimate speech quality of live VoIP calls at run-time using control information extracted from header content of received packets. They are especially designed to be sensitive to packet loss burstiness. The performance evaluation study is performed using a dedicated set-up software-based SQA framework. It offers a personalized packet killer and includes implementation of four SQA algorithms. A speech quality database, which covers a wide range of bursty packet loss conditions, has been created then thoroughly analyzed. Our important findings are the following: (1) all examined automatic bursty-loss aware speech quality assessors achieve a satisfactory correlation under upper (>;20%) and lower (<;10%) ranges of packet loss process (2) They exhibit a clear weakness to assess speech quality under a moderated packet loss process (3) The accuracy of sequence-by-sequence basis of examined SQA algorithms should be addressed in details for further precision.