点击次数：

论文类型：期刊论文

发表时间：2018-01-01

发表刊物：IEEE ACCESS

收录刊物：SCIE

卷号：6

页面范围：44190-44198

ISSN号：2169-3536

关键字：Image annotation; label relevance; deep feature; cyber-physical-social systems

摘要：Image annotation is challenging due to the explosive increase of image data in cyber-physical-social systems. Because of the semantic gap between images and corresponding labels, it has attracted extensive attentions in recent years. However, most existing research neglects the imbalanced distribution of different classes and the internal relevance of image labels. Besides, the weak image labeling affects the annotation performance to some extent. To address these issues, we propose a learning model for image annotation through integrating deep features and label relevance of images. Specifically, we first employ a convolutional neural-network approach to extract the deep features of images and utilize the synthetic minority oversampling technique to deal with the problem of class imbalance. Furthermore, we exploit the correlations, including symbiotic and semantic relationships of labels, to compute the relevance of label sets. Then, we incorporate this relevance into one classifier to reconstruct the complete label sets, and learn the mapping from image features to the reconstructed label sets by the other classifier. In addition, a joint convex loss function is proposed, which combines the two classifiers via co-regularization and compels them to be consistent. We evaluate the proposed method on two benchmark data sets. The experimental results demonstrate that our method outperforms several state-of-the-art solutions.