Title :
Progressive modeling
Author :
Fan, Wei ; Wang, Haixun ; Yu, Philip S. ; Lo, Sha-Hwa ; Stolf, S.
Author_Institution :
IBM Thomas J. Watson Res. Center, Hawthorne, NY, USA
Abstract :
Presently, inductive learning is still performed in a frustrating batch process. The user has little interaction with the system and no control over the final accuracy and training time. If the accuracy of the produced model is too low, all the computing resources are misspent. In this paper we propose a progressive modeling framework. In progressive modeling, the learning algorithm estimates online both the accuracy of the final model and remaining training time. If the estimated accuracy is far below expectation, the user can terminate training prior to completion without wasting further resources. If the user chooses to complete the learning process, progressive modeling will compute a model with expected accuracy in expected time. We describe one implementation of progressive modeling using ensemble of classifiers.
Keywords :
data mining; interactive systems; learning by example; pattern classification; batch process; data mining; inductive learning; progressive modeling; Association rules; Computer science; Costs; Data mining; Database systems; IEC standards; ISO standards; Petroleum; Software performance; Statistics;
Conference_Titel :
Data Mining, 2002. ICDM 2003. Proceedings. 2002 IEEE International Conference on
Print_ISBN :
0-7695-1754-4
DOI :
10.1109/ICDM.2002.1183899