VideoSM
VideoSM copied to clipboard
Video Summarization (Attention Mechanism and Hierarchical LSTM)
Code for Video Summarization
Deep Learning Related Features
C3D architecture, hierarchical LSTM, attention mechanism, Multi-layer perceptron.
Other techniques
0-1 knapsack, OpenCV video processing
Tools
Pytorch, a python-based deep learning framework
Related Papers
@inproceedings{zhang2016video,
title={Video summarization with long short-term memory},
author={Zhang, Ke and Chao, Wei-Lun and Sha, Fei and Grauman, Kristen},
booktitle={European conference on computer vision},
pages={766--782},
year={2016},
organization={Springer}
}
@inproceedings{potapov2014category,
title={Category-specific video summarization},
author={Potapov, Danila and Douze, Matthijs and Harchaoui, Zaid and Schmid, Cordelia},
booktitle={European conference on computer vision},
pages={540--555},
year={2014},
organization={Springer}
}
@inproceedings{pan2016hierarchical,
title={Hierarchical recurrent neural encoder for video representation with application to captioning},
author={Pan, Pingbo and Xu, Zhongwen and Yang, Yi and Wu, Fei and Zhuang, Yueting},
booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
pages={1029--1038},
year={2016}
}
Related Website
https://blog.heuritech.com/2016/01/20/attention-mechanism/