skip to main content
research-article

Sound and Music Recommendation with Knowledge Graphs

Published:21 October 2016Publication History
Skip Abstract Section

Abstract

The Web has moved, slowly but steadily, from a collection of documents towards a collection of structured data. Knowledge graphs have then emerged as a way of representing the knowledge encoded in such data as well as a tool to reason on them in order to extract new and implicit information. Knowledge graphs are currently used, for example, to explain search results, to explore knowledge spaces, to semantically enrich textual documents, or to feed knowledge-intensive applications such as recommender systems. In this work, we describe how to create and exploit a knowledge graph to supply a hybrid recommendation engine with information that builds on top of a collections of documents describing musical and sound items. Tags and textual descriptions are exploited to extract and link entities to external graphs such as WordNet and DBpedia, which are in turn used to semantically enrich the initial data. By means of the knowledge graph we build, recommendations are computed using a feature combination hybrid approach. Two explicit graph feature mappings are formulated to obtain meaningful item feature representations able to catch the knowledge embedded in the graph. Those content features are further combined with additional collaborative information deriving from implicit user feedback. An extensive evaluation on historical data is performed over two different datasets: a dataset of sounds composed of tags, textual descriptions, and user’s download information gathered from Freesound.org and a dataset of songs that mixes song textual descriptions with tags and user’s listening habits extracted from Songfacts.com and Last.fm, respectively. Results show significant improvements with respect to state-of-the-art collaborative algorithms in both datasets. In addition, we show how the semantic expansion of the initial descriptions helps in achieving much better recommendation quality in terms of aggregated diversity and novelty.

References

  1. Gediminas Adomavicius and YoungOk Kwon. 2012. Improving aggregate recommendation diversity using ranking-based techniques. IEEE Trans. Knowl. Data Eng. 24, 5 (2012), 896--911. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Mehdi Hosseinzadeh Aghdam, Negar Hariri, Bamshad Mobasher, and Robin D. Burke. 2015. Adapting recommendations to contextual changes using hierarchical hidden Markov models. In Proceedings of the 9th ACM Conference on Recommender Systems (RecSys’15). 241--244. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Sarabjot Singh Anand, Patricia Kearney, and Mary Shapcott. 2007. Generating semantically enriched user profiles for web personalization. ACM Trans. Internet Technol. 7, 4, Article 22 (Oct. 2007). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gleb Beliakov, Tomasa Calvo, and Simon James. 2015. Recommender Systems Handbook. Springer US, Boston, MA, Chapter Aggregation Functions for Recommender Systems, 777--808. Retrieved from http://dx.doi.org/10.1007/978-1-4899-7637-6_23 Google ScholarGoogle ScholarCross RefCross Ref
  5. Alejandro Bellogín, Iván Cantador, and Pablo Castells. 2010. A study of heterogeneity in recommendations for a social music service. In Proceedings of the 1st International Workshop on Information Heterogeneity and Fusion in Recommender Systems (HetRec’10). ACM, 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Tim Berners-Lee, James Hendler, and Ora Lassila. 2001. The semantic web: Scientific American. Sci. Am. (May 2001).Google ScholarGoogle Scholar
  7. Christian Bizer, Jens Lehmann, Georgi Kobilarov, Sören Auer, Christian Becker, Richard Cyganiak, and Sebastian Hellmann. 2009. DBpedia - A crystallization point for the web of data. Web Semant. 7 (September 2009), 154--165. Issue 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Dmitry Bogdanov, Nicolas Wack, and others. 2013. ESSENTIA: An open-source library for sound and music analysis. In Proceedings of the ACM International Conference on Multimedia (MM’13). 855--858. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Geoffray Bonnin and Dietmar Jannach. 2014. Automated generation of music playlists: Survey and experiments. ACM Comput. Surv. 47, 2, Article 26 (Nov. 2014), 35 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Robin Burke. 2002. Hybrid recommender systems: Survey and experiments. User Model. User-Adapt. Interact. 12, 4 (Nov. 2002), 331--370. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Iván Cantador, Alejandro Bellogín, and Pablo Castells. 2008. A multilayer ontology-based hybrid recommendation model. AI Commun. Special Issue on Rec. Sys. 21, 2--3 (April 2008), 203--210. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Tommaso Di Noia, Roberto Mirizzi, Vito Claudio Ostuni, and Davide Romito. 2012a. Exploiting the web of data in model-based recommender systems. In Proceedings of the 6th ACM Conference on Recommender Systems (RecSys’12). ACM, New York, NY, 253--256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Tommaso Di Noia, Roberto Mirizzi, Vito Claudio Ostuni, Davide Romito, and Markus Zanker. 2012b. Linked open data to support content-based recommender systems. In Proceedings of the 8th International Conference on Semantic Systems (I-SEMANTICS’12). ACM, New York, NY, 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Ignacio Fernández-Tobías, Iván Cantador, Marius Kaminskas, and Francesco Ricci. 2011. A generic semantic-based framework for cross-domain recommendation. In Proceedings of the 2nd International Workshop on Information Heterogeneity and Fusion in Recommender Systems (HetRec’11). ACM, New York, NY, 25--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Frederic Font and Sergio Oramas. 2014. Extending tagging ontologies with domain specific knowledge. In Proceedings of the International Semantic Web Conference (ISWC’14). 1--4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Frederic Font, Gerard Roma, Perfecto Herrera, and Xavier Serra. 2012. Characterization of the freesound online community. In Proceedings of the 2012 3rd International Workshop on Cognitive Information Processing (CIP’12). 1--6. Google ScholarGoogle ScholarCross RefCross Ref
  17. Zeno Gantner, Lucas Drumond, Christoph Freudenthaler, Steffen Rendle, and Lars Schmidt-Thieme. 2010. Learning attribute-to-feature mappings for cold-start recommendations. In Proceedings of the 2010 IEEE International Conference on Data Mining (ICDM’10). IEEE Computer Society, Washington, DC, 176--185. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Andres Garcia-Silva, Oscar Corcho, Harith Alani, and Asuncion Gomez-Perez. 2012. Review of the state of the art: Discovering and associating semantics to tags in folksonomies. Knowl. Eng. Rev. 27 (3 2012), 57--85. Issue 01. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Negar Hariri, Bamshad Mobasher, and Robin D. Burke. 2012. Context-aware music recommendation based on latenttopic sequential patterns. In Sixth ACM Conference on Recommender Systems, RecSys’12, Dublin, Ireland, September 9--13, 2012. 131--138. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Benjamin Heitmann and Conor Hayes. 2010. Using linked data to build open, collaborative recommender systems. In AAAI Spring Symposium: Linked Data Meets Artificial Intelligence.Google ScholarGoogle Scholar
  21. Chia-Hua Ho and Chih-Jen Lin. 2012. Large-scale linear support vector regression. J. Mach. Learn. Res. 13 (2012), 3323--3348. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of the 2008 8th IEEE International Conference on Data Mining (ICDM’08). 263--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Dietmar Jannach, Lukas Lerche, and Iman Kamehkhosh. 2015. Beyond “hitting the hits”: Generating coherent music playlist continuations with the right tracks. In Proceedings of the 9th ACM Conference on Recommender Systems (RecSys’15). ACM, New York, NY, 187--194. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Marius Kaminskas and Francesco Ricci. 2012. Contextual music information retrieval and recommendation: State of the art and challenges. Comput. Sci. Rev. 6, 2--3 (2012), 89--119.Google ScholarGoogle ScholarCross RefCross Ref
  25. Houda Khrouf and Raphaël Troncy. 2013. Hybrid event recommendation using linked data and user diversity. In Proceedings of the 7th ACM Conference on Recommender Systems (RecSys’13). ACM, New York, NY, 185--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Peter Knees and Markus Schedl. 2013. A survey of music similarity and recommendation from music context data. ACM Trans. Multimedia Comput. Commun. Appl. (TOMCCAP) 10, 1 (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Sean M. McNee, John Riedl, and Joseph A. Konstan. 2006. Being accurate is not enough: How accuracy metrics have hurt recommender systems. In CHI’06 Extended Abstracts on Human Factors in Computing Systems (CHI EA’06). ACM, New York, NY, 1097--1101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Stuart E. Middleton, David De Roure, and Nigel R. Shadbolt. 2009. Ontology-based recommender systems. Handb. Ontol. 32, 6 (2009), 779--796. Google ScholarGoogle ScholarCross RefCross Ref
  29. George A. Miller. 1995. WordNet: A lexical database for english. Commun. ACM 38, 11 (Nov. 1995), 39--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Bamshad Mobasher, Xin Jin, and Yanzan Zhou. 2004. Semantically enhanced collaborative filtering on the web. In Web Mining: From Web to Semantic Web, Bettina Berendt, Andreas Hotho, Dunja Mladenic, Maarten Someren, Myra Spiliopoulou, and Gerd Stumme (Eds.). Lecture Notes in Computer Science, Vol. 3209. Springer, Berlin, 57--76. Google ScholarGoogle ScholarCross RefCross Ref
  31. Andrea Moro, Alessandro Raganato, and Roberto Navigli. 2014. Entity linking meets word sense disambiguation : A unified approach. Trans. Assoc. Comput. Ling. (TACL) (2014).Google ScholarGoogle Scholar
  32. Cataldo Musto, Giovanni Semeraro, Pasquale Lops, and Marco de Gemmis. 2014. Combining distributional semantics and entity linking for context-aware content-based recommendation. In Proceedings of the 22nd International Conference on User Modeling, Adaptation, and Personalization (UMAP’14). 381--392. Google ScholarGoogle ScholarCross RefCross Ref
  33. Xia Ning and George Karypis. 2012. Sparse linear methods with side information for top-n recommendations. In Proceedings of the 6th ACM Conference on Recommender Systems (RecSys’12). 155--162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Sergio Oramas, Luis Espinosa-anke, Mohamed Sordo, Horacio Saggion, and Xavier Serra. 2016. ELMD: An automatically generated entity linking gold standard dataset in the music domain. In Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016.Google ScholarGoogle Scholar
  35. Vito Claudio Ostuni, Tommaso Di Noia, Eugenio Di Sciascio, and Roberto Mirizzi. 2013. Top-n recommendations from implicit feedback leveraging linked open data. In Proceedings of the 7th ACM Conference on Recommender Systems (RecSys’13). ACM, New York, NY, 85--92. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Vito Claudio Ostuni, Tommaso Di Noia, Roberto Mirizzi, and Eugenio Di Sciascio. 2014. A linked data recommender system using a neighborhood-based graph kernel. In Proceedings of the 15th International Conference on Electronic Commerce and Web Technologies (Lecture Notes in Business Information Processing). Springer-Verlag. Google ScholarGoogle ScholarCross RefCross Ref
  37. Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI’09). AUAI Press, Arlington, VA, 452--461. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Matthew Rowe. 2014. SemanticSVD++: Incorporating semantic taste evolution for predicting ratings. In 2014 IEEE/WIC/ACM International Conferences on Web Intelligence, WI 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Giovanni Semeraro, Pasquale Lops, Pierpaolo Basile, and Marco de Gemmis. 2009. Knowledge infusion into content-based recommender systems. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys’09). ACM, New York, NY, 301--304. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. John Shawe-Taylor and Nello Cristianini. 2004. Kernel Methods for Pattern Analysis. Cambridge University Press, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Wei Shen, Jianyong Wang, and Jiawei Han. 2015. Entity linking with a knowledge base: Issues, techniques, and solutions. IEEE Trans. Knowl. Data Eng. 27, 2 (Feb 2015), 443--460. Google ScholarGoogle ScholarCross RefCross Ref
  42. Mohamed Sordo, Sergio Oramas, and Luis Espinosa-Anke. 2015. Extracting relations from unstructured text sources for music recommendation. In Proceedings of the 20th International Conference on Applications of Natural Language to Information Systems, NLDB 2015. Springer International Publishing, Cham, 369--382. Google ScholarGoogle ScholarCross RefCross Ref
  43. Harald Steck. 2013. Evaluation of recommendations: Rating-prediction and ranking. In RecSys. 213--220. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Gabriel Vigliensoni and Ichiro Fujinaga. 2014. Identifying time zones in a large dataset of music listening logs. In Proceedings of the 1st International Workshop on Social Media Retrieval and Analysis (SoMeRA’14). ACM, New York, NY, 27--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Cai-Nicolas Ziegler, Georg Lausen, and Lars Schmidt-Thieme. 2004. Taxonomy-driven computation of product recommendations. In Proceedings of the 13th ACM International Conference on Information and Knowledge Management (CIKM’04). ACM, New York, NY, 406--415. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Sound and Music Recommendation with Knowledge Graphs

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Intelligent Systems and Technology
          ACM Transactions on Intelligent Systems and Technology  Volume 8, Issue 2
          Survey Paper, Special Issue: Intelligent Music Systems and Applications and Regular Papers
          March 2017
          407 pages
          ISSN:2157-6904
          EISSN:2157-6912
          DOI:10.1145/3004291
          • Editor:
          • Yu Zheng
          Issue’s Table of Contents

          Copyright © 2016 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 21 October 2016
          • Accepted: 1 April 2016
          • Revised: 1 February 2016
          • Received: 1 November 2015
          Published in tist Volume 8, Issue 2

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader