Title :
Angular Embedding: A Robust Quadratic Criterion
Author_Institution :
Comput. Sci. Dept., Boston Coll., Chestnut Hill, MA, USA
Abstract :
Given the size and confidence of pairwise local orderings, angular embedding (AE) finds a global ordering with a near-global optimal eigensolution. As a quadratic criterion in the complex domain, AE is remarkably robust to outliers, unlike its real domain counterpart LS, the least squares embedding. Our comparative study of LS and AE reveals that AE´s robustness is due not to the particular choice of the criterion, but to the choice of representation in the complex domain. When the embedding is encoded in the angular space, we not only have a nonconvex error function that delivers robustness, but also have a Hermitian graph Laplacian that completely determines the optimum and delivers efficiency. The high quality of embedding by AE in the presence of outliers can hardly be matched by LS, its corresponding L1 norm formulation, or their bounded versions. These results suggest that the key to overcoming outliers lies not with additionally imposing constraints on the embedding solution, but with adaptively penalizing inconsistency between measurements themselves. AE thus significantly advances statistical ranking methods by removing the impact of outliers directly without explicit inconsistency characterization, and advances spectral clustering methods by covering the entire size-confidence measurement space and providing an ordered cluster organization.
Keywords :
graph theory; least mean squares methods; statistical analysis; Hermitian graph Laplacian; angular embedding; least squares embedding; near-global optimal eigensolution; nonconvex error function; pairwise local ordering; robust quadratic criterion; size-confidence measurement space; spectral clustering method; statistical ranking method; Cluster approximation; Graph theory; Laplace equations; Least sqaures methods; Linear programming; Robustness; Statistical analysis; Surface reconstruction; Least squares methods; clustering; constrained optimization; graph algorithms; linear programming; modeling and recovery of physical attributes.; spectral methods; statistical computing;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
DOI :
10.1109/TPAMI.2011.107