Title :
Nonparametric density estimation and regression achieved with a learning rule for equiprobabilistic topographic map formation
Author :
Van Hulle, Marc M.
Author_Institution :
Lab. voor Neuro- en Psychofysiologie, Katholieke Univ., Leuven
Abstract :
An “online” learning rule, called the vectorial boundary adaptation rule (VBAR), is proposed for topographic map formation. Since VBAR is aimed at achieving all equiprobabilistic quantization of the input space, the weight density at convergence will be proportional to the input density. In this way, the converged map yields a nonparametric model of the input density. We use an information-theoretic measure (mutual information) to assess and compare the performance of VBAR with Kohonen´s SOM algorithm. Finally, we show that topographic map formation with VBAR in “batch” mode is equivalent to statistical kernel smoothing (nonparametric regression)
Keywords :
convergence; maximum entropy methods; optimisation; quantisation (signal); self-organising feature maps; smoothing methods; statistical analysis; unsupervised learning; convergence; equiprobabilistic quantization; equiprobabilistic topographic map; information-theoretic measure; input density; maximum entropy; nonparametric density estimation; optimisation; regression; statistical kernel smoothing; unsupervised competitive learning; vectorial boundary adaptation rule; Clustering algorithms; Convergence; Kernel; Lattices; Mutual information; Neurons; Phase estimation; Psychology; Quantization; Stationary state;
Conference_Titel :
Neural Networks for Signal Processing [1996] VI. Proceedings of the 1996 IEEE Signal Processing Society Workshop
Conference_Location :
Kyoto
Print_ISBN :
0-7803-3550-3
DOI :
10.1109/NNSP.1996.548333