Title :
Manifold learning using Euclidean k-nearest neighbor graphs [image processing examples]
Author :
Costa, Jose A. ; Hero, Alfred O., III
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Michigan Univ., Ann Arbor, MI, USA
Abstract :
In the manifold learning problem one seeks to discover a smooth low dimensional surface, i.e., a manifold embedded in a higher dimensional linear vector space, based on a set of n measured sample points on the surface. In this paper, we consider the closely related problem of estimating the manifold´s intrinsic dimension and the intrinsic entropy of the sample points. Specifically, we view the sample points as realizations of an unknown multivariate density supported on an unknown smooth manifold. In previous work, we introduced a geometric probability method called the geodesic minimal spanning tree (GMST) to obtain asymptotically consistent estimates of manifold dimension and entropy. In this paper, we present a simpler method, based on the k-nearest neighbor (k-NN) graph that does not require estimation of geodesic distances on the manifold. The algorithm is applied to standard synthetic manifolds as well as real data sets consisting of images of faces.
Keywords :
entropy; graph theory; image processing; least squares approximations; method of moments; signal reconstruction; signal representation; signal sampling; Euclidean k-nearest neighbor graphs; Riemann compact manifolds; embedded manifold; face images; geodesic minimal spanning tree; higher dimensional linear vector space; image processing; k-NN graph; linear least squares procedure; manifold intrinsic dimension; manifold learning; manifold reconstruction; method of moments; regular signal class representation; sample points intrinsic entropy; smooth low dimensional surface; surface sample point measurement; synthetic manifolds; unknown multivariate density; Electric variables measurement; Entropy; Extraterrestrial measurements; Manifolds; Signal processing; Signal processing algorithms; Speech; Tree graphs; Vectors; Videos;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on
Print_ISBN :
0-7803-8484-9
DOI :
10.1109/ICASSP.2004.1326713