Need for multi-aspect measures to support evaluation of complex human-computer interfaces

Author

Treu, Siegfried

Author_Institution

Dept. of Comput. Sci., Pittsburgh Univ., PA, USA

fYear

1998

fDate

22-25 Mar 1998

Firstpage

182

Lastpage

191

Abstract

Inherent to the objective evaluation of a system is the use of evaluative measures. These are metrics or formulas designed to represent one or more aspects of system performance. As the system becomes more complex, it stands to reason that the measures needed to correctly reveal its performance may have to become correspondingly more complex as well. This is particularly evident when the HCl system evaluation of interest must encompass each of: (1) the system, (2) its human user and (3) the dynamic interaction between them. The paper portrays the types of measures that have been and continue to be used. Then, it characterizes the design, testing, and validation of more complex measures for use in evaluation methodology applicable to complex systems. A combination of three major evaluative aspects-synergism, efficiency, and effectiveness (SEE)-is shown to be useful in guiding the design of such measures

Keywords

human factors; interactive systems; program testing; software metrics; software performance evaluation; systems analysis; user interfaces; HCl system evaluation; complex human computer interface evaluation; dynamic interaction; evaluation methodology; evaluative measures; human user; metrics; multi aspect measures; objective evaluation; system performance; testing; validation; Computer interfaces; Computer science; Current measurement; Design methodology; Frequency measurement; Human computer interaction; Length measurement; System performance; System testing; Volume measurement;

fLanguage

English

Publisher

ieee

Conference_Titel

Human Interaction with Complex Systems, 1998. Proceedings., Fourth Annual Symposium on

Conference_Location

Dayton, OH

Print_ISBN

0-8186-8341-4

Type

conf

DOI

10.1109/HUICS.1998.659978

Filename

659978