DocumentCode
1122977
Title
Self-creating and organizing neural networks
Author
Choi, Doo-Il ; Park, Sang-Hui
Author_Institution
Dept. of Electr. Eng., Yonsei Univ., Seoul, South Korea
Volume
5
Issue
4
fYear
1994
fDate
7/1/1994 12:00:00 AM
Firstpage
561
Lastpage
575
Abstract
We have developed a self-creating and organizing unsupervised learning algorithm for artificial neural networks. In this study, we introduce SCONN and SCONN2 as two versions of self-creating and organizing neural network (SCONN) algorithms. SCONN creates an adaptive uniform vector quantizer (VQ), whereas SCONN2 creates an adaptive nonuniform VQ by neural-like architecture. SCONN´s begin with only one output node, which has a sufficiently wide activation level, and the activation level decrease depending upon the time or the activation history. SCONN´s decide automatically whether to adapt the weights of existing nodes or to create a new “son node.” They are compared with two famous algorithms-the Kohonen´s self organizing feature map (SOFM) (1988) as a neural VQ and the Linde-Buzo-Gray (LBG) algorithm (1980) as a traditional VQ. The results show that SCONN´s have significant benefits over other algorithms
Keywords
self-organising feature maps; unsupervised learning; vector quantisation; SCONN; SCONN2; adaptive uniform vector quantizer; neural-like architecture; self-creating and organizing neural networks; unsupervised learning algorithm; Artificial neural networks; Cities and towns; Clustering algorithms; History; Neural networks; Organizing; Partitioning algorithms; Probability density function; Unsupervised learning; Vector quantization;
fLanguage
English
Journal_Title
Neural Networks, IEEE Transactions on
Publisher
ieee
ISSN
1045-9227
Type
jour
DOI
10.1109/72.298226
Filename
298226
Link To Document