DocumentCode
1264258
Title
Model-free distributed learning
Author
Dembo, Amir ; Kailath, Thomas
Author_Institution
Stanford Univ., CA, USA
Volume
1
Issue
1
fYear
1990
fDate
3/1/1990 12:00:00 AM
Firstpage
58
Lastpage
70
Abstract
Model-free learning for synchronous and asynchronous quasi-static networks is presented. The network weights are continuously perturbed, while the time-varying performance index is measured and correlated with the perturbation signals; the correlation output determines the changes in the weights. The perturbation may be either via noise sources or orthogonal signals. The invariance to detailed network structure mitigates large variability between supposedly identical networks as well as implementation defects. This local, regular, and completely distributed mechanism requires no central control and involves only a few global signals. Thus, it allows for integrated, on-chip learning in large analog and optical networks
Keywords
learning systems; neural nets; performance index; perturbation techniques; learning systems; model free learning; neural networks; noise; orthogonal signals; perturbation signals; time-varying performance index; Analog computers; Centralized control; Computer architecture; Concurrent computing; Large-scale systems; Network-on-a-chip; Neural networks; Optical fiber networks; Performance analysis; Time measurement;
fLanguage
English
Journal_Title
Neural Networks, IEEE Transactions on
Publisher
ieee
ISSN
1045-9227
Type
jour
DOI
10.1109/72.80205
Filename
80205
Link To Document