Hits:

Indexed by:期刊论文

Date of Publication:2019-03-01

Journal:IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS

Included Journals:SCIE

Volume:15

Issue:3

Page Number:1341-1349

ISSN No.:1551-3203

Key Words:Deep convolutional computation model (DCCM); incremental learning; industrial big data; tensor computation

Abstract:The deep convolutional computation model (DCCM) enabled remarkable progress in feature learning of industrial big data in Internet of Things. However, as a typical static deep learning model, it is difficult to learn features for incremental industrial big data. To solve this problem, we propose an incremental DCCM by developing two incremental algorithms, i.e., parameter-incremental algorithm and structure-incremental algorithm. The parameter-incremental algorithm aims to incrementally train the fully connected layers together with fine tuning for incorporating the new knowledge into the prior one. Then, the structure-incremental algorithm is used to transfer the previous knowledge by introducing an updating rule of the tensor convolutional, pooling, and fully connected layers. Furthermore, the dropout strategy is extended into the tensor fully connected layer to improve the robustness of the proposed model. Finally, extensive experiments are carried out on the representative datasets including CIFRA and CUAVE to justify the proposed model in terms of adaption, preservation, and convergence efficiency.