Title :
Automated Computer-Based CET4 Essay Scoring System
Author :
Xi, Yi ; Liang, Weiqian
Author_Institution :
Dept. of Electron. Eng., Tsinghua Univ., Beijing, China
Abstract :
Automated Essay Scoring is a very significant research subject for the processing of machine scoring. Computer-based College English Test (National English level test) further motivates the research of AES system for Chinese English leaner. In this paper, we introduce an effective AES system based on computer-based CET4. Features belong to three domains: language quality, content and organization, are involved in our system to figure out the feature collection with high correlation coefficient. The method of improved TF*IWF*IWF in computing term weight is used to optimize content-features. Through comparison of five scoring models based on classical text classification algorithms, we proposed an algorithm based on Adaboost, Voting and KNN to improve the accuracy of machine scoring. The exact agreement attends to 60%, and the adjacent agreement is above 95%. Moreover, we also discovered that writing patterns for Chinese English learners emphasize on fluency, lexical complexity features and two features from organization.
Keywords :
computer aided instruction; learning (artificial intelligence); natural language processing; pattern classification; text analysis; Adaboost algorithm; Chinese English leaner; KNN algorithm; TF*IWF*IWF method; automated computer-based CET4 essay scoring system; computer-based college English test; content-features optimization; language quality; machine scoring; text classification algorithms; voting algorithm; Accuracy; Classification algorithms; Complexity theory; Humans; Organizations; Text categorization; Writing;
Conference_Titel :
Circuits, Communications and System (PACCS), 2011 Third Pacific-Asia Conference on
Conference_Location :
Wuhan
Print_ISBN :
978-1-4577-0855-8
DOI :
10.1109/PACCS.2011.5990116
