Title :
Online near optimal control of unknown nonaffine systems with application to HCCI engines
Author :
Zargarzadeh, H. ; Jagannathan, S. ; Drallmeier, J.
Author_Institution :
Dept of Electr. & Comput. Eng., Missouri Univ. of Sci. & Technol., Rolla, MO, USA
Abstract :
Multi-input and multi-output (MIMO) optimal control of unknown nonaffine nonlinear systems is a challenging problem due to the presence of control inputs inside the unknown nonlinearity. In this paper, the optimal control of MIMO nonlinear nonaffine discrete-time systems in input-output form is considered when the internal dynamics are unknown. First, the nonaffine nonlinear system is converted into an affine-like equivalent nonlinear system under the assumption that the higher-order terms are bounded. Next, a forward-in-time Hamilton-Jaccobi-Bellman (HJB) equation-based optimal approach is developed to control the affine-like nonlinear system using neural network (NN). To overcome the need to know the control gain matrix of the affine-like system for the optimal controller, an online identifier is introduced. Lyapunov stability of the overall system including the online identifier shows that the approximate control input approaches the optimal control with a bounded error. Finally, the optimal control approach is applied to the cycle-by-cycle discrete-time representation of the experimentally validated HCCI engine which is represented as a nonaffine nonlinear system. Simulation results are included to demonstrate the efficacy of the approach in presence of actuator disturbances.
Keywords :
Jacobian matrices; Lyapunov methods; MIMO systems; control nonlinearities; discrete time systems; internal combustion engines; neurocontrollers; nonlinear control systems; optimal control; stability; HCCI engines; Lyapunov stability o; MIMO control; actuator disturbance; affine-like equivalent nonlinear system; bounded error; control gain matrix; cycle-by-cycle discrete-time representation; discrete-time systems; forward-in-time Hamilton-Jaccobi-Bellman equation; input-output form; internal dynamics; multiinput multioutput control; neural network; online near optimal control; unknown nonaffine nonlinear system; unknown nonlinearity; Artificial neural networks; Convergence; Cost function; Engines; MIMO; Nonlinear systems; Optimal control; Homogeneous Charge Compression Ignition; Neural Network Control; Online Nonlinear Optimal Control; System Identification;
Conference_Titel :
Adaptive Dynamic Programming And Reinforcement Learning (ADPRL), 2011 IEEE Symposium on
Conference_Location :
Paris
Print_ISBN :
978-1-4244-9887-1
DOI :
10.1109/ADPRL.2011.5967382