location: Current position: Home >> Scientific Research >> Paper Publications

Finite Convergence of Value Iteration Algorithm for Discounted Innite Horizon Optimal Control of Stochastic Logical Systems

Hits:

Indexed by:会议论文

Date of Publication:2016-01-01

Included Journals:CPCI-S、SCIE

Page Number:216-222

Key Words:Boolean control networks; Logical networks; Semi-tensor product; Optimal control; Stochastic logical dynamics

Abstract:This paper investigates the discounted in nite horizon optimal control problem for the stochastic multi-valued logical dynamical systems with nite states. After giving the equivalent descriptions of the stochastic logical dynamical system in terms of Markov decision process, the in nite horizon optimization problem is presented in an algebraic form. Based on the semitensor product of matrices and the increasing-dimension technique, it is proved that the optimal stationary policy is obtained by a nite horizon value iteration process, and an exact horizon length estimation for the nite horizon approach is derived. As an application, the optimization problem of Human-machine game is investigated.

Pre One:H-infinity Control for Tracking Targets of Aero-engines

Next One:Adaptive tracking control for uncertain switched systems under asynchronous switching