Title :
Self-organizing reservior computing with dynamically regulated cortical neural networks
Author :
Yin, Jun ; Meng, Yan
Author_Institution :
Dept. of Electr. & Comput. Eng., Stevens Inst. of Technol., Hoboken, NJ, USA
Abstract :
Reservoir computing (RC) is an approach to design, train and analyze recurrent neural networks (RNNs). Traditional RC models use fixed, random topological reservoirs. Very little work has been conducted on adapting the structure of neural reservoirs. In this study, the lamina-specific cortical neural network is employed to construct the reservoir. Numerous experimental data show that cortical neural networks are not silent even without external inputs, but rather maintain a low spontaneous firing activity. This aspect of cortical networks is important for their computational functions, but it is difficult to reproduce this aspect in the models of cortical neural networks due to the inherently unstable property of the low-activity regime. In this paper, we propose a developmental approach to self-organize the structure and synapses of lamina-specific cortical neural networks (CNNs) based reservoir where a gene regulatory network (GRN) is employed. We call this new model as GRN-CNN-RC model. Basically, the weight plasticity, and meta-plasticity of the CNN-based RC will be regulated by the GRN, and the GRN will also be influenced by the activity of the neurons it resides in, in a closed loop. Extensive experimental results on the classical benchmark problems have demonstrated the efficiency and robustness of the proposed model for classification tasks.
Keywords :
environmental science computing; recurrent neural nets; reservoirs; CNN; GRN; RC models; RNN; computational functions; dynamical regulated cortical neural networks; gene regulatory network; lamina-specific cortical neural networks; low spontaneous firing activity; metaplasticity; neural reservoirs; random topological reservoirs; recurrent neural networks; self-organizing reservoir computing; weight plasticity; Adaptation models; Biological neural networks; Biological system modeling; Computational modeling; Mathematical model; Neurons; Reservoirs; cortical neural networks; gene regulatory network; reservoir computing; spatio-temporal signal;
Conference_Titel :
Neural Networks (IJCNN), The 2012 International Joint Conference on
Conference_Location :
Brisbane, QLD
Print_ISBN :
978-1-4673-1488-6
Electronic_ISBN :
2161-4393
DOI :
10.1109/IJCNN.2012.6252772