个人信息Personal Information
教授
博士生导师
硕士生导师
性别:男
毕业院校:大连理工大学
学位:博士
所在单位:数学科学学院
学科:计算数学
办公地点:创新园大厦(海山楼)B1313
联系方式:84708351-8093
电子邮箱:zxsu@dlut.edu.cn
Learning Video-Story Composition via Recurrent Neural Network
点击次数:
论文类型:会议论文
发表时间:2018-01-01
收录刊物:CPCI-S
卷号:2018-January
页面范围:1727-1735
摘要:In this paper, we propose a learning-based method to compose a video-story from a group of video clips that describe an activity or experience. We learn the coherence between video clips from real videos via the Recurrent Neural Network (RNN) that jointly incorporates the spatial-temporal semantics and motion dynamics to generate smooth and relevant compositions. We further rearrange the results generated by the RNN to make the overall video-story compatible with the storyline structure via a submodular ranking optimization process. Experimental results on the video-story dataset show that the proposed algorithm outperforms the state-of-the-art approach.