Title :
Adaptive Data Embedding Framework for Multiclass Classification
Author :
Tingting Mu ; Jianmin Jiang ; Yan Wang ; Goulermas, J.Y.
Author_Institution :
Sch. of Comput. Inf. & Media, Univ. of Bradford, Bradford, UK
Abstract :
The objective of this paper is the design of an engine for the automatic generation of supervised manifold embedding models. It proposes a modular and adaptive data embedding framework for classification, referred to as DEFC, which realizes in different stages including initial data preprocessing, relation feature generation and embedding computation. For the computation of embeddings, the concepts of friend closeness and enemy dispersion are introduced, to better control at local level the relative positions of the intraclass and interclass data samples. These are shown to be general cases of the global information setup utilized in the Fisher criterion, and are employed for the construction of different optimization templates to drive the DEFC model generation. For model identification, we use a simple but effective bilevel evolutionary optimization, which searches for the optimal model and its best model parameters. The effectiveness of DEFC is demonstrated with experiments using noisy synthetic datasets possessing nonlinear distributions and real-world datasets from different application fields.
Keywords :
optimisation; parameter estimation; pattern classification; search problems; DEFC model generation; Fisher criterion; adaptive data embedding framework; automatic supervised manifold embedding model generation; bilevel evolutionary optimization; embedding computation; enemy dispersion; friend closeness concepts; global information setup; initial data preprocessing; interclass data samples; intraclass data samples; model identification; model parameters; modular framework; multiclass classification; noisy synthetic datasets; nonlinear distributions; optimal model search; optimization templates; real-world datasets; relation feature generation; Adaptive systems; Computational modeling; Data preprocessing; Learning systems; Optimization; Principal component analysis; Bilevel evolutionary optimization; classification; embedding; proximity information;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2012.2200693