Optimizing the parSOM neural network implementation for data mining with distributed memory systems and cluster computing

The self-organizing map is a prominent unsupervised neural network model which lends itself to the analysis of high-dimensional input data and data mining applications. However, the high execution times required to train the map limit its application in many high-performance data analysis application domains. We discuss the /sub par/SOM implementation, a software-based parallel implementation of the self-organizing map, and its optimization for the analysis of high-dimensional input data using distributed memory systems and clusters. The original /sub par/SOM algorithm scales very well in a parallel execution environment with low communication latencies and exploits parallelism to cope with memory latencies. However it suffers from poor scalability on distributed memory computers. We present optimizations to further decouple the subprocesses, simplify the communication model and improve the portability of the system.