Current position: Home >> Scientific Research >> Paper Publications

Boundedness and Convergence of MPN for Cyclic and Almost Cyclic Learning with Penalty

Release Time:2019-03-11  Hits:

Indexed by: Conference Paper

Date of Publication: 2011-07-31

Included Journals: Scopus、SCIE、CPCI-S、EI

Page Number: 125-132

Abstract: Weight-decay method as one of classical complexity regularizations is simple and appears to work well in some applications for multi-layer perceptron network (MPN). This paper shows results for the weak and strong convergence for cyclic and almost cyclic learning MPN with penalty term (weight-decay). The convergence is guaranteed under some relaxed conditions such as the activation functions, learning rate and the assumption for the stationary set of error function. Furthermore, the boundedness of the weights in the training procedure is obtained in a simple and clear way.

Prev One:Convergence of Cyclic and Almost-Cyclic Learning with Momentum for Feedforward Neural Networks

Next One:Deterministic convergence of conjugate gradient method for feedforward neural networks