• DocumentCode
    1264258
  • Title

    Model-free distributed learning

  • Author

    Dembo, Amir ; Kailath, Thomas

  • Author_Institution
    Stanford Univ., CA, USA
  • Volume
    1
  • Issue
    1
  • fYear
    1990
  • fDate
    3/1/1990 12:00:00 AM
  • Firstpage
    58
  • Lastpage
    70
  • Abstract
    Model-free learning for synchronous and asynchronous quasi-static networks is presented. The network weights are continuously perturbed, while the time-varying performance index is measured and correlated with the perturbation signals; the correlation output determines the changes in the weights. The perturbation may be either via noise sources or orthogonal signals. The invariance to detailed network structure mitigates large variability between supposedly identical networks as well as implementation defects. This local, regular, and completely distributed mechanism requires no central control and involves only a few global signals. Thus, it allows for integrated, on-chip learning in large analog and optical networks
  • Keywords
    learning systems; neural nets; performance index; perturbation techniques; learning systems; model free learning; neural networks; noise; orthogonal signals; perturbation signals; time-varying performance index; Analog computers; Centralized control; Computer architecture; Concurrent computing; Large-scale systems; Network-on-a-chip; Neural networks; Optical fiber networks; Performance analysis; Time measurement;
  • fLanguage
    English
  • Journal_Title
    Neural Networks, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1045-9227
  • Type

    jour

  • DOI
    10.1109/72.80205
  • Filename
    80205