skip to main content
10.1145/3323873.3325047acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
short-paper

A Benchmark of Visual Storytelling in Social Media

Published:05 June 2019Publication History

ABSTRACT

Media editors in the newsroom are constantly pressed to provide a"like-being there" coverage of live events. Social media provides a disorganised collection of images and videos that media professionals need to grasp before publishing their latest news updated. Automated news visual storyline editing with social media content can be very challenging, as it not only entails the task of finding the right content but also making sure that news content evolves coherently over time. To tackle these issues, this paper proposes a benchmark for assessing social media visual storylines. The SocialStories benchmark, comprised by total of 40 curated stories covering sports and cultural events, provides the experimental setup and introduces novel quantitative metrics to perform a rigorous evaluation of visual storytelling with social media data.

References

  1. George Awad, Asad Butt, Keith Curtis, Yooyoung Lee, Jonathan Fiscus, Afzal Godil, David Joy, Andrew Delgado, Alan F. Smeaton, Yvette Graham, Wessel Kraaij, Georges Quénot, Joao Magalhaes, David Semedo, and Saverio Blasi. 2018. TRECVID 2018: Benchmarking Video Activity Detection, Video Captioning and Matching, Video Storytelling Linking and Video Search. In Proceedings of TRECVID 2018 . NIST, USA.Google ScholarGoogle Scholar
  2. Deepayan Chakrabarti and Kunal Punera. 2011. Event Summarization Using Tweets. In International AAAI Conference on Web and Social Media .Google ScholarGoogle Scholar
  3. Freddy Chong Tat Chua and Sitaram Asur. 2013. Automatic Summarization of Events from Social Media.. In ICWSM, Emre Kiciman, Nicole B. Ellison, Bernie Hogan, Paul Resnick, and Ian Soboroff (Eds.). The AAAI Press.Google ScholarGoogle Scholar
  4. Diogo Delgado, Joao Magalhaes, and Nuno Correia. 2010. Automated illustration of news stories. In 2010 IEEE Fourth International Conference on Semantic Computing. IEEE, 73--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Erika Doggett and Alejandro Cantarero. 2016. Identifying Eyewitness News-worthy Events on Twitter. In SocialNLP@EMNLP .Google ScholarGoogle Scholar
  6. Mengdie Hu, Shixia Liu, Furu Wei, Yingcai Wu, John Stasko, and Kwan-Liu Ma. 2012. Breaking News on Twitter. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Ting-Hao K. Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Aishwarya Agrawal, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, et almbox. 2016. Visual Storytelling. In 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2016) .Google ScholarGoogle Scholar
  8. Gunhee Kim, Seungwhan Moon, and Leonid Sigal. 2015. Ranking and retrieval of image sequences from multiple paragraph queries. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7--12, 2015. IEEE Computer Society, 1993--2001.Google ScholarGoogle Scholar
  9. David Laniado and Peter Mika. 2010. Making Sense of Twitter. In Proceedings of the 9th International Semantic Web Conference on The Semantic Web - Volume Part I (ISWC'10). Springer-Verlag, Berlin, Heidelberg, 470--485. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Flávio Martins, Jo ao Magalh aes, and Jamie Callan. 2016. Barbara Made the News: Mining the Behavior of Crowds for Time-Aware Learning to Rank. In Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM '16). ACM, New York, NY, USA, 667--676. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Philip J. McParlane, Andrew James McMinn, and Joemon M. Jose. 2014. "Picture the Scene...";: Visually Summarising Social Media Events. In ACM CIKM . Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Steve Paulussen and Pieter Ugille. 2008. User generated content in the newsroom: Professional and organisational constraints on participatory journalism. Westminster Papers in Communication & Culture, Vol. 5, 2 (2008).Google ScholarGoogle ScholarCross RefCross Ref
  13. Takeshi Sakaki, Makoto Okazaki, and Yutaka Matsuo. 2010. Earthquake Shakes Twitter Users: Real-time Event Detection by Social Sensors. In Proceedings of the 19th International Conference on World Wide Web (WWW '10). 10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Manos Schinas, Symeon Papadopoulos, Yiannis Kompatsiaris, and Pericles A. Mitkas. 2015. Visual Event Summarization on Social Media using Topic Modelling and Graph-based Ranking Algorithms. In Proceedings of the 5th ACM on International Conference on Multimedia Retrieval - ICMR '15 . Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Karen Simonyan and Andrew Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv preprint arXiv:1409.1556 (2014).Google ScholarGoogle Scholar
  16. Peter Tolmie, Rob Procter, Dave W. Randall, Mark Rouncefield, Christian Burger, Geraldine Wong Sak Hoi, Arkaitz Zubiaga, and Maria Liakata. 2017. Supporting the Use of User Generated Content in Journalistic Practice. In CHI . Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A Benchmark of Visual Storytelling in Social Media

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ICMR '19: Proceedings of the 2019 on International Conference on Multimedia Retrieval
        June 2019
        427 pages
        ISBN:9781450367653
        DOI:10.1145/3323873

        Copyright © 2019 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 5 June 2019

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • short-paper

        Acceptance Rates

        Overall Acceptance Rate254of830submissions,31%

        Upcoming Conference

        ICMR '24
        International Conference on Multimedia Retrieval
        June 10 - 14, 2024
        Phuket , Thailand

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader