DocumentCode
1743879
Title
The averaging principle for perturbations of continuous time control problems with fast controlled jump parameters
Author
El Azouzi, Rachid ; Altman, Eitan ; Gaitsgory, Vladimir
Volume
1
fYear
2000
fDate
2000
Firstpage
730
Abstract
We consider a class of singularly perturbed zero-sum differential games with piecewise deterministic dynamics, where the changes from one structure (for the dynamics) to another are governed by a finite-state Markov process. Player 1 controls the continuous dynamics, whereas Player 2 controls the rate of transition for the finite-state Markov process; both have access to the states of both processes. Player 1 wishes to minimize a given quantity. For player 2, we consider two possible scenarios: one in which it wishes to minimize the same quantity (team framework), and one in which it wishes to maximize it (zero sum game). The transition rates of the Markov process are fast, of the order of 1/ε. To solve the above problem, we use the dynamic programming approach. In particular, we study the asymptotic properties of the underlying system for sufficiently small ε. The viscosity solution method is employed to verify the convergence of the value function, which allows us to obtain the convergence in a general setting and helps us to characterize the structure of the limit system. We apply this to the special case of linear quadratic games with jump parameters, which allows us to obtain an explicit solution for the limiting problem
Keywords
Markov processes; continuous time systems; convergence; differential games; dynamic programming; state-space methods; asymptotic properties; averaging principle; continuous time control problems; fast controlled jump parameters; finite-state Markov process; limit system; linear quadratic games; piecewise deterministic dynamics; singularly perturbed zero-sum differential games; value function; viscosity solution method; Aging; Australia; Control systems; Costs; Dynamic programming; Equations; Markov processes; Mathematics; Process control; Viscosity;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control, 2000. Proceedings of the 39th IEEE Conference on
Conference_Location
Sydney, NSW
ISSN
0191-2216
Print_ISBN
0-7803-6638-7
Type
conf
DOI
10.1109/CDC.2000.912855
Filename
912855
Link To Document