location: Current position: Home >> Scientific Research >> Paper Publications

A Finite Convergence Criterion for the Discounted Optimal Control of Stochastic Logical Networks

Hits:

Indexed by:期刊论文

Date of Publication:2018-01-01

Journal:IEEE TRANSACTIONS ON AUTOMATIC CONTROL

Included Journals:SCIE、Scopus

Volume:63

Issue:1

Page Number:262-268

ISSN No.:0018-9286

Key Words:Boolean networks; logical networks (LN); optimal control; semi-tensor product; stochastic logical networks (SLNs)

Abstract:Stochastic logical networks (SLNs) are discrete-time stochastic dynamical systems with Boolean (or multivalued) logical state variables. The discounted infinite horizon optimal control problem for SLN is addressed in this paper. By resorting to the equivalent Markov decision process description, the infinite horizon optimization problem is presented in algebraic form. Then using the increasing-dimension technique, an improved finite convergence criterion, which can find the optimal stationary policy, is derived for value iteration approach. To demonstrate the theoretical value of this approach, it is applied to the optimization problems of the human-machine game and the p53-Mdm2 gene network.

Pre One:Policy Iteration Algorithm for Optimal Control of Stochastic Logical Dynamical Systems

Next One:Monostability and Bistability of Boolean Networks using Semi-tensor Products