On the properties of subjective ratings in video quality experiments

Author

Winkler, Stefan

Author_Institution

Symmetricom, San Jose, CA, USA

fYear

2009

fDate

29-31 July 2009

Firstpage

139

Lastpage

144

Abstract

Subjective video quality experiments are classical statistical measurements, and as such the mathematical tools for their analysis are well understood. However, there remain certain practical aspects that are rarely discussed, yet are essential to the design of efficient experiments. Using numerical simulations as well as real-life data from a multitude of subjective experiments, this paper attempts to shed more light on the distribution and variability of subjective ratings, the effects of discrete rating scales, and the number of subjects needed.

Keywords

design of experiments; statistical distributions; video signal processing; design of experiment; discrete rating scale; mathematical tool; numerical simulation; statistical distribution; statistical measurement; subjective video quality experiment; Analytical models; Data analysis; Gaussian distribution; Guidelines; History; Numerical simulation; Quality assessment; Speech processing; Statistical distributions; Video signal processing; Mean Opinion Score (MOS); Subjective experiments; video quality measurement;

fLanguage

English

Publisher

ieee

Conference_Titel

Quality of Multimedia Experience, 2009. QoMEx 2009. International Workshop on

Conference_Location

San Diego, CA

Print_ISBN

978-1-4244-4370-3

Electronic_ISBN

978-1-4244-4370-3

Type

conf

DOI

10.1109/QOMEX.2009.5246961

Filename

5246961