VideoSM icon indicating copy to clipboard operation
VideoSM copied to clipboard

Video Summarization (Attention Mechanism and Hierarchical LSTM)

Code for Video Summarization

Deep Learning Related Features

C3D architecture, hierarchical LSTM, attention mechanism, Multi-layer perceptron. 

Other techniques

0-1 knapsack, OpenCV video processing

Tools

Pytorch, a python-based deep learning framework

Related Papers

@inproceedings{zhang2016video,
  title={Video summarization with long short-term memory},
  author={Zhang, Ke and Chao, Wei-Lun and Sha, Fei and Grauman, Kristen},
  booktitle={European conference on computer vision},
  pages={766--782},
  year={2016},
  organization={Springer}
}
@inproceedings{potapov2014category,
  title={Category-specific video summarization},
  author={Potapov, Danila and Douze, Matthijs and Harchaoui, Zaid and Schmid, Cordelia},
  booktitle={European conference on computer vision},
  pages={540--555},
  year={2014},
  organization={Springer}
}
@inproceedings{pan2016hierarchical,
  title={Hierarchical recurrent neural encoder for video representation with application to captioning},
  author={Pan, Pingbo and Xu, Zhongwen and Yang, Yi and Wu, Fei and Zhuang, Yueting},
  booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
  pages={1029--1038},
  year={2016}
}

Related Website

https://blog.heuritech.com/2016/01/20/attention-mechanism/