Current position: Home >> Scientific Research >> Paper Publications

Boundedness of a Batch Gradient Method with Penalty for Feedforward Nerual Networks

Release Time:2019-03-11  Hits:

Indexed by: Conference Paper

Date of Publication: 2008-01-01

Included Journals: CPCI-S

Page Number: 264-268

Key Words: Batch Gradient Method; Feedfoward Neural Network; Boundedness; Penalty

Abstract: This paper considers a batch gradient method with penalty for training feedforward neural networks. The role of the penalty term is to control the magnitude of the weights and to improve the generalization performance of the network. A usual penalty is considered, which is a term proportional to the norm of the weights. The boundedness of the network is proved. The bounded ness is assumed as a precondition in an existing convergence result, and thus our result improves this convergence result.

Prev One:Convergence of gradient method with momentum for back-propagation neural networks

Next One:Convergence of approximated gradient method for Elman network