location: Current position: Home >> Scientific Research >> Paper Publications

Convergence of gradient descent algorithm for a recurrent neuron

Hits:

Indexed by:会议论文

Date of Publication:2007-06-03

Included Journals:EI、CPCI-S

Volume:4493

Issue:PART 3

Page Number:117-+

Abstract:Probabilistic convergence results of online gradient descent algorithm have been obtained by many authors for the training of recurrent neural networks with innitely many training samples. This paper proves deterministic convergence of o2ine gradient descent algorithm for a recurrent neural network with nite number of training samples. Our results can be hopefully extended to more complicated recurrent neural networks, and serve as a complementary result to the existing probability convergence results.

Pre One:Uniform approximation capabilities of sum-of-product and sigma-pi-sigma neural networks

Next One:Convergence of Online gradient algorithm with Stochastic inputs for Pi-Sigma neural networks