location: Current position: Home >> Scientific Research >> Paper Publications

Finite convergence of value iteration algorithm for discounted infinite horizon optimal control of stochastic logical systems

Hits:

Indexed by:会议论文

Date of Publication:2016-07-27

Included Journals:EI、Scopus

Volume:2016-August

Page Number:216-222

Abstract:This paper investigates the discounted infinite horizon optimal control problem for the stochastic multi-valued logical dynamical systems with finite states. After giving the equivalent descriptions of the stochastic logical dynamical system in terms of Markov decision process, the infinite horizon optimization problem is presented in an algebraic form. Based on the semi-tensor product of matrices and the increasing-dimension technique, it is proved that the optimal stationary policy is obtained by a finite horizon value iteration process, and an exact horizon length estimation for the finite horizon approach is derived. As an application, the optimization problem of Human-machine game is investigated. ? 2016 TCCT.

Pre One:H∞ control for tracking targets of aero-engines

Next One:Real-time Optimization and Control of Combustion Phase of SI Engines Using Statistical Analysis