Title :
Nonlinear Dimensionality Reduction with Local Spline Embedding
Author :
Xiang, Shiming ; Nie, Feiping ; Zhang, Changshui ; Zhang, Chunxia
Author_Institution :
Dept. of Autom., Tsinghua Univ., Beijing, China
Abstract :
This paper presents a new algorithm for nonlinear dimensionality reduction (NLDR). Our algorithm is developed under the conceptual framework of compatible mapping. Each such mapping is a compound of a tangent space projection and a group of splines. Tangent space projection is estimated at each data point on the manifold, through which the data point itself and its neighbors are represented in tangent space with local coordinates. Splines are then constructed to guarantee that each of the local coordinates can be mapped to its own single global coordinate with respect to the underlying manifold. Thus, the compatibility between local alignments is ensured. In such a work setting, we develop an optimization framework based on reconstruction error analysis, which can yield a global optimum. The proposed algorithm is also extended to embed out of samples via spline interpolation. Experiments on toy data sets and real-world data sets illustrate the validity of our method.
Keywords :
error analysis; interpolation; learning (artificial intelligence); splines (mathematics); compatible mapping; data point; local spline embedding; manifold learning; nonlinear dimensionality reduction; optimization framework; reconstruction error analysis; spline interpolation; tangent space projection; General; Machine learning; Nonlinear dimensionality reduction; Pattern analysis; compatible mapping; local spline embedding; out of samples.;
Journal_Title :
Knowledge and Data Engineering, IEEE Transactions on
DOI :
10.1109/TKDE.2008.204