Title :
Need for multi-aspect measures to support evaluation of complex human-computer interfaces
Author_Institution :
Dept. of Comput. Sci., Pittsburgh Univ., PA, USA
Abstract :
Inherent to the objective evaluation of a system is the use of evaluative measures. These are metrics or formulas designed to represent one or more aspects of system performance. As the system becomes more complex, it stands to reason that the measures needed to correctly reveal its performance may have to become correspondingly more complex as well. This is particularly evident when the HCl system evaluation of interest must encompass each of: (1) the system, (2) its human user and (3) the dynamic interaction between them. The paper portrays the types of measures that have been and continue to be used. Then, it characterizes the design, testing, and validation of more complex measures for use in evaluation methodology applicable to complex systems. A combination of three major evaluative aspects-synergism, efficiency, and effectiveness (SEE)-is shown to be useful in guiding the design of such measures
Keywords :
human factors; interactive systems; program testing; software metrics; software performance evaluation; systems analysis; user interfaces; HCl system evaluation; complex human computer interface evaluation; dynamic interaction; evaluation methodology; evaluative measures; human user; metrics; multi aspect measures; objective evaluation; system performance; testing; validation; Computer interfaces; Computer science; Current measurement; Design methodology; Frequency measurement; Human computer interaction; Length measurement; System performance; System testing; Volume measurement;
Conference_Titel :
Human Interaction with Complex Systems, 1998. Proceedings., Fourth Annual Symposium on
Conference_Location :
Dayton, OH
Print_ISBN :
0-8186-8341-4
DOI :
10.1109/HUICS.1998.659978