Evaluating the interrater agreement of process capability ratings

Author

Fusaro, Pierfrancesco ; Emam, Khaled El ; Smith, Bob

Author_Institution

Fraunho, Germany

fYear

1997

fDate

5-7 Nov 1997

Firstpage

2

Lastpage

11

Abstract

The reliability of process assessments has received some study in the recent past, much of it being conducted within the context of the SPICE (Software Process Improvement and Capability dEtermination) trials. In this paper, we build upon this work by evaluating the reliability of ratings on each of the practices that make up the SPICE capability dimension. The type of reliability that we evaluate is inter-rater agreement: the agreement amongst independent assessors´ capability ratings. Inter-rater agreement was found to be generally high. We also identify one particular practice that exhibits low agreement in its ratings

Keywords

capacity management (computers); reliability; software development management; software engineering; SPICE trials; independent assessors; inter-rater agreement evaluation; process assessment reliability; software capability determination; software process capability ratings; software process improvement; Computer architecture; Engineering management; SPICE; Software engineering;

fLanguage

English

Publisher

ieee

Conference_Titel

Software Metrics Symposium, 1997. Proceedings., Fourth International

Conference_Location

Albuquerque, NM

Print_ISBN

0-8186-8093-8

Type

conf

DOI

10.1109/METRIC.1997.637129

Filename

637129