DocumentCode :
1797452
Title :
Locally Linear Embedding algorithm based on OMP for incremental learning
Author :
Yiqin Leng ; Li Zhang ; Jiwen Yang
Author_Institution :
Provincial Key Lab. for Comput. Inf. Process. Technol., Soochow Univ., Suzhou, China
fYear :
2014
fDate :
6-11 July 2014
Firstpage :
3100
Lastpage :
3107
Abstract :
Locally Linear Embedding (LLE) is a sort of powerful nonlinear dimensionality reduction algorithms. The basic idea behind the LLE method is that each data point and its neighbors lie on or close to a locally linear patch of the manifold if there is sufficient data. Then the local geometry of these patches is described by using linear coefficients which can reconstruct each data point from its neighbors. However, LLE operates in a batch way and its dimension reduction cannot be generalized to unseen samples. If a test sample arrives, LLE must run repeatedly and the former computational results are discarded. Thus, some incremental methods have been proposed for LLE to solve this problem. In these incremental methods, the neighbor number is globally fixed, which may result in selecting points from another linear space as neighbors. This paper presents LLE based on orthogonal matching pursuit (OMP) and applies it to classification tasks. In the classification tasks, dimensionality reduction on test samples is implemented by applying dimension reduction on training samples. The new LLE method could select a more appropriate neighbors from the selected neighbors. OMP is applied to not only LLE for training samples, but also the incremental learning of LLE for test samples. Compared with other linear incremental methods, experimental results show that the proposed method is promising.
Keywords :
learning (artificial intelligence); LLE; OMP; data point; dimension reduction; incremental learning; linear coefficients; linear patch; local geometry; locally linear embedding algorithm; nonlinear dimensionality reduction algorithms; orthogonal matching pursuit; Conferences; Joints; Neural networks;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks (IJCNN), 2014 International Joint Conference on
Conference_Location :
Beijing
Print_ISBN :
978-1-4799-6627-1
Type :
conf
DOI :
10.1109/IJCNN.2014.6889460
Filename :
6889460
Link To Document :
بازگشت