location: Current position: Home >> Scientific Research >> Paper Publications

Supervised Intra- and Inter-Modality Similarity Preserving Hashing for Cross-Modal Retrieval

Hits:

Indexed by:期刊论文

Date of Publication:2018-01-01

Journal:IEEE ACCESS

Included Journals:SCIE

Volume:6

Page Number:27796-27808

ISSN No.:2169-3536

Key Words:Cross-modal retrieval; matrix factorization; similarity preserving hashing; alternative optimization

Abstract:Cross-modal hashing has drawn considerable interest in multimodal retrieval due to the explosive growth of big data on multimedia. However, the existing methods mainly focus on unified hash codes learning and investigate the local geometric structure in the original space, resulting in low-discriminative power hash code of out-of-sample instances. To address this important problem, this paper is dedicated to investigate the hashing functions learning by considering the modality correlation preserving in the expected low-dimensional common space. A cross-modal hashing method based on supervised collective matrix factorization is proposed by taking intra-modality and inter-modality similarity preserving into account. For more flexible hashing functions, label information is embedded into the hashing functions learning procedure. Specifically, we explore the intra-modality similarity preserving in the expected low-dimensional common space. In addition, a supervised shrinking scheme is used to enhance the local geometric consistency in each modality. The proposed method learns unified hash codes as well as hashing functions for different modalities; the overall objective function, consisting of collective matrix factorization and intra- and inter-modality similarity embedding, is solved using an alternative optimization in an iterative scheme. Extensive experiments on three benchmark data sets demonstrate that the proposed method is more flexible to new coming data and can achieve superior performance to the state-of-the-art supervised cross-modal hashing approaches in most of the cases.

Pre One:A Partitioning and Index Algorithm for RDF Data of Cloud-Based Robotic Systems

Next One:TCMHG: Topic-Based Cross-Modal Hypergraph Learning for Online Service Recommendations