DocumentCode :
2087283
Title :
Enhancing a Free-Text Adaptive Computer Assisted Assessment System with Self-Assessment Features
Author :
Pascual-Nieto, Ismael ; Perez-Marin, Diana ; O´Donnell, Mick ; Rodriguez, Pilar
Author_Institution :
Dept. of Comput. Sci., Univ. Autonoma de Madrid, Madrid
fYear :
2008
fDate :
1-5 July 2008
Firstpage :
399
Lastpage :
401
Abstract :
Willow is a Web-based application which automatically and adaptively assesses students´ free-text answers written in Spanish and English. It is intended to help students review concepts outside of class, and provides an alternative assessment method. However, students tend to be greatly concerned by computer generated scores and, although they have been told that the system is not intended for summativepurposes and their teachers will not have access to that scores, they remain worried that the machine could make a mistake and this mistake could have a negative impact on their final course grade. Given that automatic scoring cannot assure 100% approximation to a human teacher´s assessment, we have introduced self-assessment features in Willow. Thanks to the combination of automatic free-text scoring and self-assessment, students have more control over their evaluation and, whenever they do not agree with the automatic score assigned by the system, they can change it. This new feature has been tested by 22 students reviewing a course with Willow in the 2007-2008 academic year. We observed that the students did not abuse the self-assessment feature, only modifying the score assigned in 5% of answered questions.
Keywords :
Internet; computer aided instruction; text analysis; English language; Spanish language; Web based application; Willow; automatic free-text scoring; automatic scoring; computer generated scores; free-text adaptive computer assisted assessment system self-assessment features; free-text answers; Animation; Application software; Automatic control; Computer aided analysis; Computer science; Control systems; Feedback; Humans; Psychology; Testing; Adaptive Hypermedia; Blended Learning; Free-text assessment; Natural Language Processing; Self-assessment;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Advanced Learning Technologies, 2008. ICALT '08. Eighth IEEE International Conference on
Conference_Location :
Santander, Cantabria
Print_ISBN :
978-0-7695-3167-0
Type :
conf
DOI :
10.1109/ICALT.2008.52
Filename :
4561721
Link To Document :
بازگشت