DocumentCode :
2618733
Title :
Program complexity metrics and programmer opinions
Author :
Katzmarski, Bernhard ; Koschke, Rainer
Author_Institution :
Fachbereich Math. und Inf., Univ. of Bremen, Bremen, Germany
fYear :
2012
fDate :
11-13 June 2012
Firstpage :
17
Lastpage :
26
Abstract :
Various program complexity measures have been proposed to assess maintainability. Only relatively few empirical studies have been conducted to back up these assessments through empirical evidence. Researchers have mostly conducted controlled experiments or correlated metrics with indirect maintainability indicators such as defects or change frequency. This paper uses a different approach. We investigate whether metrics agree with complexity as perceived by programmers. We show that, first, programmers´ opinions are quite similar and, second, only few metrics and in only few cases reproduce complexity rankings similar to human raters. Data-flow metrics seem to better match the viewpoint of programmers than control-flow metrics, but even they are only loosely correlated. Moreover we show that a foolish metric has similar or sometimes even better correlation than other evaluated metrics, which raises the question how meaningful the other metrics really are. In addition to these results, we introduce an approach and associated statistical measures for such multi-rater investigations. Our approach can be used as a model for similar studies.
Keywords :
computational complexity; software maintenance; software metrics; complexity rankings; controlled experiments; correlated metrics; data flow metrics; empirical evidence; human raters; indirect maintainability indicators; maintainability assess; program complexity measurement; program complexity metrics; programmer opinions; Complexity theory; Correlation; Instruments; Measurement; Programming; Semantics; Strontium; control-flow metrics; data-flow metrics; program complexity;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Program Comprehension (ICPC), 2012 IEEE 20th International Conference on
Conference_Location :
Passau
ISSN :
1092-8138
Print_ISBN :
978-1-4673-1213-4
Electronic_ISBN :
1092-8138
Type :
conf
DOI :
10.1109/ICPC.2012.6240486
Filename :
6240486
Link To Document :
بازگشت