Title :
Asynchronous self-organizing maps
Author :
Benson, Maurice W. ; Hu, Jie
Author_Institution :
Dept. of Comput. Sci., Lakeshead Univ., Thunder Bay, Ont., Canada
fDate :
11/1/2000 12:00:00 AM
Abstract :
A recently defined energy function which leads to a self-organizing map is used as a foundation for an asynchronous neural-network algorithm. We generalize the existing stochastic gradient approach to an asynchronous parallel stochastic gradient method for generating a topological map on a distributed computer system (MIMD). A convergence proof is presented and simulation results on a set of problems are included. A practical problem using the energy function approach is that a summation over the entire network is required during the computation of updates. Using simulations we demonstrate effective algorithms that use efficient sampling for the approximation of these sums.
Keywords :
convergence; gradient methods; parallel processing; self-organising feature maps; topology; MIMD; asynchronous neural network algorithm; asynchronous parallel stochastic gradient method; asynchronous self-organizing maps; convergence proof; distributed computer system; energy function; energy function approach; topological map; Approximation algorithms; Computational modeling; Computer networks; Concurrent computing; Convergence; Distributed computing; Gradient methods; Sampling methods; Self organizing feature maps; Stochastic systems;
Journal_Title :
Neural Networks, IEEE Transactions on