Title :
Gradient ascent paired-comparison subjective quality testing
Author :
Voran, Stephen ; Catellier, Andrew
Author_Institution :
Insitute for Telecommun. Sci., Boulder, CO, USA
Abstract :
Subjective testing is the most direct means of assessing audio, video, and multimedia quality as experienced by users and maximizing the information gathered while minimizing the number of trials is an important goal. We propose gradient ascent subjective testing (GAST) as an efficient way to locate optimizing sets of coding or transmission parameter values. GAST combines gradient ascent optimization techniques with paired-comparison subjective test trials to efficiently locate parameter values that maximize perceived quality. We used GAST to search a two-dimensional parameter space for the known region of maximal audio quality as proof-of-concept. That point was accurately located and we estimate that conventional testing would have required at least 27 times as many trials to generate the same results.
Keywords :
gradient methods; multimedia systems; audio assesment; gradient ascent subjective testing; information gathering; multimedia quality; proof-of-concept; two-dimensional parameter space; video assesment; Audio recording; Error correction codes; Humans; Protocols; Quality assessment; Redundancy; Robustness; Software quality; Software testing; Switches; Audio Quality; Golden Section Line Search; Gradient Ascent; Multimedia Quality; Subjective Testing; Video Quality;
Conference_Titel :
Quality of Multimedia Experience, 2009. QoMEx 2009. International Workshop on
Conference_Location :
San Diego, CA
Print_ISBN :
978-1-4244-4370-3
Electronic_ISBN :
978-1-4244-4370-3
DOI :
10.1109/QOMEX.2009.5246964