Title :
A proposal of l1 regularized distance metric learning for high dimensional sparse vector space
Author :
Mikawa, Kenta ; Kobayashi, Masato ; Goto, Misako ; Hirasawa, Shoichi
Author_Institution :
Sch. of Creative Sci. & Eng., Waseda Univ., Tokyo, Japan
Abstract :
In this paper, we focus on pattern recognition based on the vector space model with the high dimensional and sparse data. One of the pattern recognition methods is metric learning which learns a metric matrix by using the iterative optimization procedure. However most of the metric learning methods tend to cause overfitting and increasing computational time for high dimensional and sparse settings. To avoid these problems, we propose the method of l1 regularized metric learning by using the algorithm of alternating direction method of multiplier (ADMM) in the supervised setting. The effectiveness of our proposed method is clarified by classification experiments by using the Japanese newspaper article and UCI machine learning repository. And we show proposed method is the special case of the statistical sparse covariance selection.
Keywords :
iterative methods; learning (artificial intelligence); optimisation; pattern classification; ADMM; Japanese newspaper article; UCI machine learning repository; alternating direction method of multiplier; classification; high dimensional data; high dimensional sparse vector space; iterative optimization procedure; l1 regularized distance metric learning; metric matrix; pattern recognition; sparse data; statistical sparse covariance selection; supervised setting; vector space model; Accuracy; Equations; Mathematical model; Measurement; Optimization; Sparse matrices; Training data;
Conference_Titel :
Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on
Conference_Location :
San Diego, CA
DOI :
10.1109/SMC.2014.6974212