点击次数：

论文类型：期刊论文

发表时间：2021-01-10

发表刊物：IEEE ACCESS

卷号：8

页面范围：218433-218443

ISSN号：2169-3536

关键字：Feature extraction; Clustering algorithms; Neural networks; Data mining; Image reconstruction; Decoding; Correlation; Multimodal clustering; unsupervised deep learning; early fusion

摘要：Multimodal clustering algorithms partitions a multimodal dataset into disjoint clusters. Common feature extraction is a key part in multimodal clustering algorithms. Recently, deep neural networks shows high performance on latent feature extraction. However, existing works did not completely explore the cross-model distribution similarity utilizing deep neural networks. We present a deep multimodal clustering framework with cross reconstruction. Feature extraction apply global cross reconstruction and local cross reconstruction respectively to enforce early fusion among different modalities. Analysis shows that the both cross reconstruction networks reduces the Wasserstein distance of latent feature distributions, which indicates that the proposed framework ensures the distribution similarity of common latent features. Experimental results on benchmark datasets demonstrate superiority beyond existing works.