location: Current position: Home >> Scientific Research >> Paper Publications

Boundedness of a Batch Gradient Method with Penalty for Feedforward Nerual Networks

Hits:

Indexed by:会议论文

Date of Publication:2008-01-01

Included Journals:CPCI-S

Page Number:264-268

Key Words:Batch Gradient Method; Feedfoward Neural Network; Boundedness; Penalty

Abstract:This paper considers a batch gradient method with penalty for training feedforward neural networks. The role of the penalty term is to control the magnitude of the weights and to improve the generalization performance of the network. A usual penalty is considered, which is a term proportional to the norm of the weights. The boundedness of the network is proved. The bounded ness is assumed as a precondition in an existing convergence result, and thus our result improves this convergence result.

Pre One:Convergence of gradient method with momentum for back-propagation neural networks

Next One:Convergence of approximated gradient method for Elman network