Current position: Home >> Scientific Research >> Paper Publications

Convergence of Online gradient algorithm with Stochastic inputs for Pi-Sigma neural networks

Release Time:2019-03-11  Hits:

Indexed by: Conference Paper

Date of Publication: 2007-04-01

Included Journals: Scopus、CPCI-S、EI

Page Number: 564-+

Key Words: Pi-Sigma neural network; online gradient algorithm; stochastic input; convergence; monotonicity

Abstract: An online gradient method is presented and discussed for Pi-Sigma neural networks with stochastic inputs. The error function is proved to be monotone in the training process, and the gradient of the error function tends to zero if the weights sequence is uniformly bounded. Furthermore, after adding a moderate condition, the weights sequence itself is also proved to be convergent.

Prev One:Convergence of gradient descent algorithm for a recurrent neuron

Next One:Convergence and monotonicity of an online gradient method with penalty for neural networks