• DocumentCode
    2849206
  • Title

    Regression-based LP solver for chance-constrained finite horizon optimal control with nonconvex constraints

  • Author

    Banerjee, A.G. ; Ono, M. ; Roy, N. ; Williams, B.C.

  • Author_Institution
    MIT, Cambridge, MA, USA
  • fYear
    2011
  • fDate
    June 29 2011-July 1 2011
  • Firstpage
    131
  • Lastpage
    138
  • Abstract
    This paper presents a novel algorithm for finite-horizon optimal control problems subject to additive Gaussian-distributed stochastic disturbance and chance constraints that are defined over feasible, non-convex state spaces. Our previous work [1] proposed a branch and bound-based algorithm that can find a near-optimal solution by iteratively solving non-linear convex optimization problems, as well as their LP relaxations called Fixed Risk Relaxation (FRR) problems. The aim of this work is to significantly reduce the computation time of the previous algorithm so that it can be applied to practical problems, such as a path planning with multiple obstacles. Our approach is to use machine learning to efficiently estimate the objective function values of FRRs within an error bound that is fixed for a given problem domain and choice of model complexity. We exploit the fact that all the FRR problems associated with the branch-and-bound tree nodes are similar to each other, both in terms of the solutions as well as the objective function and constraint coefficients. A standard optimizer is first used to generate a training data set in the form of optimal FRR solutions. Matrix transformations and boosting trees are then applied to generate learning models; fast inference is performed at run-time for new but similar FRR problems that occur when the system dynamics and/or the environment changes slightly. By using this regression technique to estimate the lower bound of the cost function value, and subsequently solving the convex optimization problems exactly at the leaf nodes of the branch-and-bound tree, we achieve 10-35 times reduction in the computation time without compromising the optimality of the solution.
  • Keywords
    Gaussian distribution; concave programming; convex programming; iterative methods; learning (artificial intelligence); optimal control; regression analysis; state-space methods; stochastic systems; tree searching; FRR problem; Gaussian-distributed stochastic disturbance; LP relaxation; boosting tree; branch-and-bound tree node; chance-constrained finite horizon optimal control; cost function value; fixed risk relaxation problem; machine learning; matrix transformation; model complexity; nonconvex constraint; nonconvex state space; nonlinear convex optimization problem; objective function value; regression technique; regression-based LP solver; Nickel; Optimal control; Optimization; Path planning; Programming; Regression tree analysis; Training;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    American Control Conference (ACC), 2011
  • Conference_Location
    San Francisco, CA
  • ISSN
    0743-1619
  • Print_ISBN
    978-1-4577-0080-4
  • Type

    conf

  • DOI
    10.1109/ACC.2011.5990937
  • Filename
    5990937