On-line learning of sequence data based on Self-Organizing Incremental Neural Network

This paper presents an on-line, continuously learning mechanism for sequence data. The proposed approach is based on SOINN-DTW method (Okada and Hasegawa, 2007), which is designed for learning of sequence data. It is based on self-organizing incremental neural network (SOINN) and dynamic time warping (DTW). Using SOINNpsilas function represents the topological structure of online input data, the output distribution of each states is represented and adapted in a self-organizing manner corresponding to online input data. Consequently, this method can train a network and estimate parameters of the output distribution using new (on-line) data continuously, based on scarce batch-training data. Through online learning, the recognition accuracy is improved continuously. To confirm the effectiveness of the on-line learning mechanism of SOINN-DTW, we present an extensive set of experiments that demonstrate how our method outperforms the online learning method of HMM in classifying phoneme data.