logo

SCIENCE CHINA Information Sciences, Volume 63 , Issue 7 : 174101(2020) https://doi.org/10.1007/s11432-018-9908-4

Recursive narrative alignment for movie narrating

More info
  • ReceivedDec 24, 2018
  • AcceptedMay 6, 2019
  • PublishedSep 16, 2019

Abstract

There is no abstract available for this article.


Acknowledgment

This work was partly funded by National Natural Science Foundation of China (Grant Nos. 61872225, 61876098, 61573219), Natural Science Foundation of Shandong Province (Grant No. ZR2015FM010), Project of Science and Technology Plan of Shandong Higher Education Institutions Program (Grant No. J15LN20), and Project of Shandong Province Medical and Health Technology Development Program (Grant No. 2016WS0577).


Supplement

Videos and other supplemental documents.


References

[1] Johnson J, Hariharan B, van der Maaten L, et al. Inferring and executing programs for visual reasoning. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2017. Google Scholar

[2] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2014,. arXiv Google Scholar

[3] Ren S, He K, Girshick R. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.. IEEE Trans Pattern Anal Mach Intell, 2017, 39: 1137-1149 CrossRef PubMed Google Scholar

[4] Zhu Y K, Kiros R, Zemel R, et al. Aligning books and movies: towards story-like visual explanations by watching movies and reading books. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), 2015. Google Scholar

[5] Sutskever I, Vinyals O, Le Q V. Sequence to sequence learning with neural networks. 2014,. arXiv Google Scholar

[6] Sharma S, Asri L E, Schulz H, et al. Relevance of unsupervised metrics in task-oriented dialogue for evaluating natural language generation. 2017,. arXiv Google Scholar

  • Figure 1

    (Color online) Our recursive narrative alignment framework comprises three modules: visual cue alignment, story context alignment, and emotive style alignment. The framework recursively generates sentences to span the movie narrative in a film shot of unlimited size.

Copyright 2020 Science China Press Co., Ltd. 《中国科学》杂志社有限责任公司 版权所有

京ICP备17057255号       京公网安备11010102003388号