• 更多栏目

    孙亮

    • 副教授       硕士生导师
    • 性别:男
    • 毕业院校:吉林大学
    • 学位:博士
    • 所在单位:计算机科学与技术学院
    • 学科:计算机应用技术
    • 办公地点:创新园大厦B802
    • 联系方式:15998564404
    • 电子邮箱:liangsun@dlut.edu.cn

    访问量:

    开通时间:..

    最后更新时间:..

    Two-stage Automatic Image Annotation Based on Latent Semantic Scene Classification

    点击次数:

    论文类型:会议论文

    发表时间:2021-04-18

    摘要:The rapid growth of multimedia content makes existing automatic image annotation techniques difficult to satisfy the demands of real-world applications. In this paper, we propose a two-stage automatic image annotation algorithm (TAIA) based on latent semantic scene classification. In the offline training phase, the hidden connectivity of labels is firstly excavated by a directed-weighed graph based on label co-occurrence relation matrix, and then the latent scene categories are detected among the labels by using nonnegative matrix factorization. Further, we propose a multi-view extreme learning machine (MELM) to learn the probability that the multiple visual feature maps to the semantic scenes. In the online annotation phase, the image to be annotated is fed to the scene classifier MELM to identify its relevant scenes. Then k-nearest neighbor based annotator is conducted on the relevant scenes to predict labels for the unannotated images. The TAIA is formulated in such a framework so that the relationship between labels and semantic scenes is fully considered, and the hard classification problem is solved. The experimental results on multiple datasets have demonstrated that the proposed framework TAIA is both effective and efficient.