Title :
Nonsmooth ICA Contrast Minimization Using a Riemannian Nelder–Mead Method
Author_Institution :
Dept. of Math. Eng., Univ. Catholique de Louvain, Louvain-la-Neuve, Belgium
Abstract :
This brief concerns the design and application of a Riemannian Nelder-Mead algorithm to minimize a Hartley-entropy-based contrast function to reliably estimate the sources from their mixtures. Despite its nondifferentiability, the contrast function is endowed with attractive properties such as discriminacy, and hence warrants an effort to be effectively handled by a derivative-free optimizer. Aside from tailoring the Nelder-Mead technique to the constraint set, namely, oblique manifold, the source separation results attained in an empirical study with quasi-correlated synthetic signals and digital images are presented, which favor the proposed method on a comparative basis.
Keywords :
entropy; image processing; independent component analysis; minimisation; Hartley entropy-based contrast function; Riemannian Nelder-Mead algorithm; Riemannian Nelder-Mead method; comparative basis; constraint set; derivative-free optimizer; digital images; nondifferentiability; nonsmooth ICA contrast minimization; oblique manifold; quasi-correlated synthetic signals; source separation; tailoring; Algorithm design and analysis; Entropy; Face; Learning systems; Manifolds; Minimization; Signal processing algorithms; Hartley entropy; Nelder--Mead algorithm; Nelder???Mead algorithm; oblique manifold; quasi-correlated sources; quasi-correlated sources.;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2014.2311036