个人信息Personal Information
教授
博士生导师
硕士生导师
主要任职:软件学院、大连理工大学-立命馆大学国际信息与软件学院院长、党委副书记
性别:男
毕业院校:西安交通大学
学位:博士
所在单位:软件学院、国际信息与软件学院
学科:软件工程. 计算数学
电子邮箱:xin.fan@dlut.edu.cn
On the Convergence of Learning-Based Iterative Methods for Nonconvex Inverse Problems
点击次数:
论文类型:期刊论文
发表时间:2021-02-02
发表刊物:IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
卷号:42
期号:12
页面范围:3027-3039
ISSN号:0162-8828
关键字:Inverse problems; Convergence; Iterative methods; Learning systems; Acceleration; Iterative algorithms; Learning systems; Statistical analysis; Nonconvex optimization; learning-based iteration; convergence guarantee; image deconvolution; rain streaks removal
摘要:Numerous tasks at the core of statistics, learning and vision areas are specific cases of ill-posed inverse problems. Recently, learning-based (e.g., deep) iterative methods have been empirically shown to be useful for these problems. Nevertheless, integrating learnable structures into iterations is still a laborious process, which can only be guided by intuitions or empirical insights. Moreover, there is a lack of rigorous analysis about the convergence behaviors of these reimplemented iterations, and thus the significance of such methods is a little bit vague. This paper moves beyond these limits and proposes Flexible Iterative Modularization Algorithm (FIMA), a generic and provable paradigm for nonconvex inverse problems. Our theoretical analysis reveals that FIMA allows us to generate globally convergent trajectories for learning-based iterative methods. Meanwhile, the devised scheduling policies on flexible modules should also be beneficial for classical numerical methods in the nonconvex scenario. Extensive experiments on real applications verify the superiority of FIMA.