个人信息Personal Information
教授
博士生导师
硕士生导师
主要任职:控制科学与工程学院院长
性别:男
毕业院校:哈尔滨工业大学
学位:博士
所在单位:控制科学与工程学院
学科:控制理论与控制工程
办公地点:海山楼A625
电子邮箱:wuyuhu@dlut.edu.cn
A Finite Convergence Criterion for the Discounted Optimal Control of Stochastic Logical Networks
点击次数:
论文类型:期刊论文
发表时间:2018-01-01
发表刊物:IEEE TRANSACTIONS ON AUTOMATIC CONTROL
收录刊物:SCIE、Scopus
卷号:63
期号:1
页面范围:262-268
ISSN号:0018-9286
关键字:Boolean networks; logical networks (LN); optimal control; semi-tensor product; stochastic logical networks (SLNs)
摘要:Stochastic logical networks (SLNs) are discrete-time stochastic dynamical systems with Boolean (or multivalued) logical state variables. The discounted infinite horizon optimal control problem for SLN is addressed in this paper. By resorting to the equivalent Markov decision process description, the infinite horizon optimization problem is presented in algebraic form. Then using the increasing-dimension technique, an improved finite convergence criterion, which can find the optimal stationary policy, is derived for value iteration approach. To demonstrate the theoretical value of this approach, it is applied to the optimization problems of the human-machine game and the p53-Mdm2 gene network.