skip to main content
10.1145/2467696.2467711acmconferencesArticle/Chapter ViewAbstractPublication PagesjcdlConference Proceedingsconference-collections
research-article

Identification of useful user comments in social media: a case study on flickr commons

Published:22 July 2013Publication History

ABSTRACT

Cultural institutions are increasingly opening up their repositories and contribute digital objects to social media platforms such as Flickr. In return they often receive user comments containing information that could be incorporated in their catalog records. Since judging the usefulness of a large number of user comments is a labor-intensive task, our aim is to provide automated support for filtering potentially useful social media comments on digital objects. In this paper, we discuss the notion of usefulness in the context of social media comments and compare it from end-users as well as expertusers perspectives. Then we present a machine-learning approach to automatically classify comments according to their usefulness. Our approach makes use of syntactic and semantic comment features and also considers user context. We present the results of an experiment we did on user comments received in six different Flickr Commons collections. They show that a few relatively straightforward features can be used to infer useful comments with up to 89% accuracy.

References

  1. E. Agichtein, C. Castillo, D. Donato, A. Gionis, G. Mishne, E. Agichtein, C. Castillo, D. Donato, A. Gionis, and G. Mishne. Finding high-quality content in social media with an application to community-based question answering. In Proceedings of WSDM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. H. Becker, D. Iter, M. Naaman, and L. Gravano. Identifying content for planned events across social media sites. In Proceedings of the fifth ACM international conference on Web search and data mining, WSDM '12. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. D. Blei, A. Ng, and M. Jordan. Latent dirichlet allocation. the Journal of machine Learning res, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. C. Castillo, M. Mendoza, and B. Poblete. Information credibility on twitter. In the 20th international conference, WWW, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. C. Danescu-Niculescu-Mizil, G. Kossinets, J. Kleinberg, and L. Lee. How opinions are received by online communities: a case study on amazon.com helpfulness votes. In Proceedings of the 18th international conference on World wide web, WWW'09, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. N. Diakopoulos, M. De Choudhury, and M. Naaman. Finding and assessing social media information sources in the context of journalism. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, CHI '12. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. A. Ghose and P. G. Ipeirotis. Designing novel review ranking systems: predicting the usefulness and impact of reviews. In ICEC '07: Proceedings of the ninth international conference on Electronic commerce, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. R. Gunning. The Technique of Clear Writing. McGraw-Hill, New York, 1952.Google ScholarGoogle Scholar
  9. C. E. Hall and M. A. Zarro. What do you call it?: a comparison of library-created and user-created tags. In Proceedings of the 11th annual international ACM/IEEE joint conference on Digital libraries, JCDL '11. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. H. Halpin, V. Robu, and H. Shepherd. The complex dynamics of collaborative tagging. In Proceedings of the 16th international conference on World Wide Web, WWW '07, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. F. M. Harper, D. Moy, and J. A. Konstan. Facts or friends?: distinguishing informational and conversational questions in social q&a sites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. B. Haslhofer, W. Robitza, C. Lagoze, and F. Guimbretiere. Semantic tagging on historical maps. In ACM Web Science 2013, Paris, France, May 2013. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Y. Kammerer, R. Nairn, P. Pirolli, and E. H. Chi. Signpost from the masses: learning effects in an exploratory social tag search browser. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '09, pages 625--634, New York, NY, USA, 2009. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S.-M. Kim, P. Pantel, T. Chklovski, and M. Pennacchiotti. Automatically assessing review helpfulness. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, EMNLP '06, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. J. Liu, Y. Cao, C. Y. Lin, Y. Huang, and M. Zhou. Low-Quality Product Review Detection in Opinion Summarization. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), 2007.Google ScholarGoogle Scholar
  16. Y. Liu, J. Bian, and E. Agichtein. Predicting information seeker satisfaction in community question answering. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Y. Lu, P. Tsaparas, A. Ntoulas, and L. Polanyi. Exploiting social context for review quality prediction. In Proceedings of the 19th international conference on World wide web, WWW '10, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. K. Seki, H. Qin, and K. Uehara. Impact and prospect of social bookmarks for bibliographic information retrieval. In Proceedings of the 10th annual joint conference on Digital libraries, JCDL '10, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. B. Sigurbjornsson and R. van Zwol. Flickr tag recommendation based on collective knowledge. In Proceedings of the 17th international conference on World Wide Web, WWW '08. ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Y. R. Tausczik and J. W. Pennebaker. The psychological meaning of words: Liwc and computerized text analysis methods. 2010.Google ScholarGoogle Scholar
  21. C. Wagner, M. Rowe, M. Strohmaier, and H. Alani. What catches your attention? an empirical study of attention patterns in community forums. In ICWSM, 2012.Google ScholarGoogle Scholar
  22. K. Q. Weinberger, M. Slaney, and R. Van Zwol. Resolving tag ambiguity. In Proceedings of the 16th ACM international conference on Multimedia, MM '08. ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. T. Wilson, J. Wiebe, and P. Hoffmann. Recognizing contextual polarity in phrase-level sentiment analysis. In Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing, HLT '05, pages 347--354, Stroudsburg, PA, USA, 2005. Association for Computational Linguistics. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Identification of useful user comments in social media: a case study on flickr commons

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        JCDL '13: Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries
        July 2013
        480 pages
        ISBN:9781450320771
        DOI:10.1145/2467696

        Copyright © 2013 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 22 July 2013

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        JCDL '13 Paper Acceptance Rate28of95submissions,29%Overall Acceptance Rate415of1,482submissions,28%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader