Title :
User-centered evaluation of question answering systems
Author :
Ong, Chorng-Shyong ; Day, Min-Yuh ; Chen, Kuo-Tay ; Hsu, Wen-Lian
Author_Institution :
Dept. of Inf. Manage., Nat. Taiwan Univ., Taipei
Abstract :
With the rapid growth of the Internet and database technologies in recent years, question answering systems (QAS) have emerged as important applications. As most evaluation models focus on system-centered evaluation, user-centered evaluation has attracted little attention. Although many QAS have been implemented, little work has been done on the development of a user-centered evaluation for QAS. User-centered evaluation is used to understand a userpsilas needs and identify important dimensions and factors in the development of an information system in order to improve its acceptance. The purpose of this study is to develop a user-centered evaluation model for QAS from the userpsilas perspective. The proposed user-centered evaluation model provides a framework for the design of question answering systems from the userpsilas perspective to enhance user satisfaction and acceptance of QAS.
Keywords :
Internet; information retrieval system evaluation; information systems; user centred design; Internet; database technologies; question answering system; system-centered evaluation; user satisfaction; user-centered evaluation; Artificial intelligence; Databases; Information analysis; Information science; Internet; Mutual information; Social network services; Statistical analysis; Uniform resource locators; Yarn; Evaluation; Measurement; Question answering system; User satisfaction;
Conference_Titel :
Intelligence and Security Informatics, 2008. ISI 2008. IEEE International Conference on
Conference_Location :
Taipei
Print_ISBN :
978-1-4244-2414-6
Electronic_ISBN :
978-1-4244-2415-3
DOI :
10.1109/ISI.2008.4565087