Training pi-sigma network by online gradient algorithm with penalty for small weight update
点击次数：
论文类型：期刊论文
发表时间：2007-12-01
发表刊物：NEURAL COMPUTATION
收录刊物：SCIE、PubMed、Scopus
卷号：19
期号：12
页面范围：3356-3368
ISSN号：0899-7667
摘要：A pi-sigma network is a class of feedforward neural networks with product units in the output layer. An online gradient algorithm is the simplest and most often used training method for feedforward neural networks. But there arises a problem when the online gradient algorithm is used for pi-sigma networks in that the update increment of the weights may become very small, especially early in training, resulting in a very slow convergence. To overcome this difficulty, we introduce an adaptive penalty term into the error function, so as to increase the magnitude of the update increment of the weights when it is too small. This strategy brings about faster convergence as shown by the numerical experiments carried out in this letter.
发表时间：2007-12-01