Title :
Fast Evaluation of Quadratic Control-Lyapunov Policy
Author :
Wang, Yang ; Boyd, Stephen
Author_Institution :
Dept. of Electr. Eng., Stanford Univ., Stanford, CA, USA
fDate :
7/1/2011 12:00:00 AM
Abstract :
The evaluation of a control-Lyapunov policy, with quadratic Lyapunov function, requires the solution of a quadratic program (QP) at each time step. For small problems this QP can be solved explicitly; for larger problems an online optimization method can be used. For this reason the control-Lyapunov control policy is considered a computationally intensive control law, as opposed to an “analytical” control law, such as conventional linear state feedback, linear quadratic Gaussian control, or H∞, too complex or slow to be used in high speed control applications. In this note we show that by precomputing certain quantities, the control-Lyapunov policy can be evaluated extremely efficiently. We will show that when the number of inputs is on the order of the square-root of the state dimension, the cost of evaluating a control-Lyapunov policy is on the same order as the cost of evaluating a simple linear state feedback policy, and less (in order) than the cost of updating a Kalman filter state estimate. To give an idea of the speeds involved, for a problem with 100 states and 10 inputs, the control-Lyapunov policy can be evaluated in around 67 μs, on a 2 GHz AMD processor; the same processor requires 40 μs to carry out a Kalman filter update.
Keywords :
Gaussian processes; H∞ control; Lyapunov methods; quadratic programming; state feedback; H∞ control; QP; linear quadratic Gaussian control; online optimization method; quadratic Lyapunov function; quadratic control lyapunov policy; quadratic program; state feedback; Cost function; Dynamic programming; Linear feedback control systems; Lyapunov method; Optimization methods; Quadratic programming; State estimation; State feedback; Stochastic processes; Velocity control; Approximate dynamic programming; model predictive control (MPC); optimization-based control; real-time convex optimization; stochastic control;
Journal_Title :
Control Systems Technology, IEEE Transactions on
DOI :
10.1109/TCST.2010.2056371