DocumentCode
1160482
Title
The Structures of Automata to Adapt to an Unknown Environment
Author
Aso, Hirotomo ; Kimura, Masayuki
Issue
7
fYear
1976
fDate
7/1/1976 12:00:00 AM
Firstpage
494
Lastpage
504
Abstract
A general fixed structure automaton acting in stationary random multireaction environment is described. Some necessary conditions are shown for automata to be purposeful or adaptive in an unknown environment (to be more profitable than a no-purpose, or random, automaton). By the necessary conditions it is proved that there exists no perfectly adaptive automaton. A necessary condition for automata with minimum state space to be purposeful is obtained. This condition characterizes their structures explicitly, so that a little restriction gives a sufficient condition. Some general subclasses of automata are proposed, and necessary and sufficient conditions for such automata to be purposeful are investigated. Furthermore as properties of a purposeful automaton, the time required to adapt and the stability of adapting to the random environment are discussed.
Keywords
Automatic control; Convergence; Learning automata; Machine learning; Mathematical model; Random media; Stability; State-space methods; Stochastic systems; Sufficient conditions;
fLanguage
English
Journal_Title
Systems, Man and Cybernetics, IEEE Transactions on
Publisher
ieee
ISSN
0018-9472
Type
jour
DOI
10.1109/TSMC.1976.4309535
Filename
4309535
Link To Document