Unsupervised video hashing by exploiting spatio-temporal feature

Publisher:
Springer
Publication Type:
Conference Proceeding
Citation:
Neural Information Processing (LNCS), 2016, 9949 pp. 511 - 518
Issue Date:
2016-01-01
Full metadata record
Files in This Item:
Filename Description Size
2016ICONIP-马潮20160512.pdfAccepted Manuscript version468.93 kB
Adobe PDF
© Springer International Publishing AG 2016.Video hashing is a common solution for content-based video retrieval by encoding high-dimensional feature vectors into short binary codes. Videos not only have spatial structure inside each frame but also have temporal correlation structure between frames, while the latter has been largely neglected by many existing methods. Therefore, in this paper we propose to perform video hashing by incorporating the temporal structure as well as the conventional spatial structure. Specifically, the spatial features of videos are obtained by utilizing Convolutional Neural Network (CNN), and the temporal features are established via Long-Short Term Memory (LSTM). The proposed spatio-temporal feature learning framework can be applied to many existing unsupervised hashing methods such as Iterative Quantization (ITQ), Spectral Hashing (SH), and others. Experimental results on the UCF-101 dataset indicate that by simultaneously employing the temporal features and spatial features, our hashing method is able to significantly improve the performance of existing methods which only deploy the spatial feature.
Please use this identifier to cite or link to this item: