Hits:

Indexed by:期刊论文

Date of Publication:2012-07-15

Journal:NEUROCOMPUTING

Included Journals:SCIE、EI、Scopus

Volume:89

Page Number:141-146

ISSN No.:0925-2312

Key Words:Feedforward neural networks; Batch back-propagation algorithm; Penalty; Boundedness; Convergence

Abstract:This paper investigates the batch back-propagation algorithm with penalty for training feedforward neural networks. A usual penalty is considered, which is a term proportional to the norm of the weights. The learning rate is set to be a small constant or an adaptive series. The main contribution of this paper is to theoretically prove the boundedness of the weights in the network training process. This boundedness is then used to prove some convergence results of the algorithm, which cover both the weak and strong convergence. Simulation results are given to support the theoretical findings. (c) 2012 Elsevier B.V. All rights reserved.