• DocumentCode
    114623
  • Title

    Generic uniqueness of the bias vector of mean payoff zero-sum games

  • Author

    Akian, Marianne ; Gaubert, Stephane ; Hochart, Antoine

  • Author_Institution
    INRIA Saclay-Ile-de-France, Paris, France
  • fYear
    2014
  • fDate
    15-17 Dec. 2014
  • Firstpage
    1581
  • Lastpage
    1587
  • Abstract
    Zero-sum mean payoff games can be studied by means of a nonlinear spectral problem. When the state space is finite, the latter consists in finding an eigenpair (u; λ) solution of T(u) = λ1 + u where T:ℝn → ℝn is the Shapley (dynamic programming) operator, λ is a scalar, 1 is the unit vector, and u ∈ ℝn. The scalar λ yields the mean payoff per time unit, and the vector u, called the bias, allows one to determine optimal stationary strategies. The existence of the eigenpair (u; λ) is generally related to ergodicity conditions. A basic issue is to understand for which classes of games the bias vector is unique (up to an additive constant). In this paper, we consider perfect information zero-sum stochastic games with finite state and action spaces, thinking of the transition payments as variable parameters, transition probabilities being fixed. We identify structural conditions on the support of the transition probabilities which guarantee that the spectral problem is solvable for all values of the transition payments. Then, we show that the bias vector, thought of as a function of the transition payments, is generically unique (up to an additive constant). The proof uses techniques of max-plus (tropical) algebra and nonlinear Perron-Frobenius theory.
  • Keywords
    dynamic programming; eigenvalues and eigenfunctions; stochastic games; vectors; Shapley operator; bias vector; dynamic programming; eigenpair; ergodicity condition; max-plus algebra; mean payoff zero-sum games; nonlinear Perron-Frobenius theory; nonlinear spectral problem; optimal stationary strategy; transition probability; zero-sum stochastic game; Additives; Eigenvalues and eigenfunctions; Equations; Game theory; Games; Vectors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control (CDC), 2014 IEEE 53rd Annual Conference on
  • Conference_Location
    Los Angeles, CA
  • Print_ISBN
    978-1-4799-7746-8
  • Type

    conf

  • DOI
    10.1109/CDC.2014.7039625
  • Filename
    7039625