点击次数：

论文类型：期刊论文

发表时间：2009-03-01

发表刊物：NEUROCOMPUTING

收录刊物：SCIE、EI、Scopus

卷号：72

期号：7-9,SI

页面范围：1732-1743

ISSN号：0925-2312

关键字：Reservoir method; Extreme learning machine; Feed-forward neural networks; Support vector machines; Kernel method

摘要：Reservoir method is applied to the feed-forward learning machines for nonlinear regression estimation. Inspired by the existing experience from extreme learning machine (ELM), the new method inherits the basic idea from support vector echo-state machines, but eliminates the internal feedback matrix to adapt for the feed-forward usage. Based on the analysis of nonlinearity in reservoir and regularization in readout weights, the parameters of input scaling and penalty regularization are taken as the hyper-parameters to characterize a static reservoir (ELM), and then a proper reservoir is identified on the gamma-C plane based on a generalization error criterion. For outlier suppression, the regularized robust regression is applied in the reservoir feature space, and it leads to an efficient algorithm for large-scale problems, which can be solved by Cholesky decomposition. The proposed method is compared with the classical kernel method and ELM method on several benchmark nonlinear regression datasets, and the results indicate the method is comparable with the existing methods. (C) 2008 Elsevier B.V. All rights reserved.