• DocumentCode
    1160482
  • Title

    The Structures of Automata to Adapt to an Unknown Environment

  • Author

    Aso, Hirotomo ; Kimura, Masayuki

  • Issue
    7
  • fYear
    1976
  • fDate
    7/1/1976 12:00:00 AM
  • Firstpage
    494
  • Lastpage
    504
  • Abstract
    A general fixed structure automaton acting in stationary random multireaction environment is described. Some necessary conditions are shown for automata to be purposeful or adaptive in an unknown environment (to be more profitable than a no-purpose, or random, automaton). By the necessary conditions it is proved that there exists no perfectly adaptive automaton. A necessary condition for automata with minimum state space to be purposeful is obtained. This condition characterizes their structures explicitly, so that a little restriction gives a sufficient condition. Some general subclasses of automata are proposed, and necessary and sufficient conditions for such automata to be purposeful are investigated. Furthermore as properties of a purposeful automaton, the time required to adapt and the stability of adapting to the random environment are discussed.
  • Keywords
    Automatic control; Convergence; Learning automata; Machine learning; Mathematical model; Random media; Stability; State-space methods; Stochastic systems; Sufficient conditions;
  • fLanguage
    English
  • Journal_Title
    Systems, Man and Cybernetics, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9472
  • Type

    jour

  • DOI
    10.1109/TSMC.1976.4309535
  • Filename
    4309535