Title :
Ensemble of Competitive Associative Nets and Multiple K-fold Cross-Validation for Estimating Predictive Uncertainty in Environmental Modelling
Author :
Kurogi, Shuichi ; Kuwahara, Daisuke ; Tanaka, Shinya
Author_Institution :
Kyushu Inst. of Technol., Kitakyushu
Abstract :
This article describes the method which we have used for the predictive uncertainty in environmental modelling competition. The method uses competitive associative net called CAN2 embedding piecewise linear approximation scheme. With the scheme, we can naturally estimate piecewise error distribution or heteroscedastic error distribution which may be caused by the noise involved in environmental data. For improving the CAN2 with an efficient batch learning method for reducing empirical (training) error, we introduce ensemble method for more accurate prediction or less prediction (generalization) error. We also introduce multiple K-fold cross-validation for obtaining reliable predictive distribution.
Keywords :
approximation theory; learning (artificial intelligence); piecewise linear techniques; prediction theory; uncertainty handling; batch learning method; competitive associative net; ensemble method; environmental modelling competition; error distribution; heteroscedastic error distribution; multiple K-fold cross-validation; piecewise linear approximation scheme; predictive uncertainty; Approximation error; Bayesian methods; Control engineering; Function approximation; Gradient methods; Learning systems; Piecewise linear approximation; Predictive models; Uncertainty; Working environment noise;
Conference_Titel :
Neural Networks, 2006. IJCNN '06. International Joint Conference on
Conference_Location :
Vancouver, BC
Print_ISBN :
0-7803-9490-9
DOI :
10.1109/IJCNN.2006.247315