Title :
An enhanced initialization method for non-negative matrix factorization
Author :
Liyun Gong ; Nandi, A.K.
Author_Institution :
Dept. of Electr. Eng. & Electron., Liverpool Univ., Liverpool, UK
Abstract :
Non-negative matrix factorization (NMF) is a dimensionality reduction tool, and has been applied to many areas such as bioinformatics, face image classification, etc. However, it often converges to some local optima because of its random initial NMF factors (W and H matrices). To solve this problem, some researchers have paid much attention to the NMF initialization problem. In this paper, we first apply the k-means clustering to initialize the factor W, and then we calculate the initial factor H using four different initialization methods (three standard and one new). The experiments were carried out on the eight real datasets and the results showed that the proposed method (EIn-NMF) achieved less error and faster convergence compared with both random initialization based NMF and the three standard methods for k-means based NMF.
Keywords :
matrix decomposition; optimisation; pattern clustering; EIn-NMF; H matrices; NMF initialization problem; W matrices; dimensionality reduction tool; enhanced initialization method; k-means clustering; local optima; nonnegative matrix factorization; random initial NMF factors; Bioinformatics; Clustering algorithms; Convergence; Educational institutions; Face; Image classification; Standards; k-means clustering; nonnegative matrix factorization;
Conference_Titel :
Machine Learning for Signal Processing (MLSP), 2013 IEEE International Workshop on
Conference_Location :
Southampton
DOI :
10.1109/MLSP.2013.6661949