Title :
Evaluating the interrater agreement of process capability ratings
Author :
Fusaro, Pierfrancesco ; Emam, Khaled El ; Smith, Bob
Author_Institution :
Fraunho, Germany
Abstract :
The reliability of process assessments has received some study in the recent past, much of it being conducted within the context of the SPICE (Software Process Improvement and Capability dEtermination) trials. In this paper, we build upon this work by evaluating the reliability of ratings on each of the practices that make up the SPICE capability dimension. The type of reliability that we evaluate is inter-rater agreement: the agreement amongst independent assessors´ capability ratings. Inter-rater agreement was found to be generally high. We also identify one particular practice that exhibits low agreement in its ratings
Keywords :
capacity management (computers); reliability; software development management; software engineering; SPICE trials; independent assessors; inter-rater agreement evaluation; process assessment reliability; software capability determination; software process capability ratings; software process improvement; Computer architecture; Engineering management; SPICE; Software engineering;
Conference_Titel :
Software Metrics Symposium, 1997. Proceedings., Fourth International
Conference_Location :
Albuquerque, NM
Print_ISBN :
0-8186-8093-8
DOI :
10.1109/METRIC.1997.637129
