Skip to main content
SpringerLink
Log in

Scalable stream-based recommendations with random walks on incremental graph of sequential interactions with implicit feedback

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

Recommender systems are designed to recommend items to users based on their interests. Considering that in real-world scenarios user feedback is generated continuously at unpredictable rate, it becomes desirable to design models that learn from data streams at least as fast as data arrives, and are also able to recommend items based on up-to-date information. However, successful recommendation algorithms are not designed to adapt to continuous flow of data, raising scalability issues. In this work, we propose \(\text {IGSI}_{{\hat{\pi }}^t}\), a model designed to operate in data streams that continuously incorporates user feedback in an incremental item-graph of sequential user interactions using implicit feedback from a data stream, with the assumption that user behavior can be extracted from such sequence of interactions as time passes. \(\text {IGSI}_{{\hat{\pi }}^t}\) recommends items based on simulations of short random walks in order to allow the generation of scalable recommendations in data stream settings. We evaluated the proposed model by recommending items with different strategies, compared the results with several incremental algorithms using a prequential approach, and demonstrate that our method obtains superior accuracy with competitive update and recommendation times.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. This paper is a significant extension to our previous work presented in Schmitt and Spinosa (2020), where we evaluated the item-graph in a data stream setting with baseline algorithms and compared the proposed approach with a matrix factorization algorithm. In this paper, we recommend items in scalable manner through simulation of random walks and compare our approach with several algorithms on more datasets.

  2. https://grouplens.org/datasets/movielens/1m/.

  3. https://grouplens.org/datasets/movielens/10m/.

  4. https://last.fm.

  5. https://rdm.inesctec.pt/dataset/cs-2017-003 - playlisted_tracks.tsv.

  6. https://rdm.inesctec.pt/dataset/cs-2017-003 - listened_tracks_1.tsv.

References

  • Aggarwal, C.C., Wolf, J.L., Wu, K.L., Yu, P.S.: Horting hatches an egg: a new graph-theoretic approach to collaborative filtering. In: Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 201–212 (1999)

  • Al-Ghossein, M., Murena, P.A., Abdessalem, T., Barré, A., Cornuéjols, A.: Adaptive collaborative topic modeling for online recommendation. In: Proceedings of the 12th ACM conference on recommender systems, pp. 338–346 (2018)

  • Andersen, R., Chung, F., Lang, K.: Local graph partitioning using pagerank vectors. In: 2006 47th annual IEEE symposium on foundations of computer science (FOCS’06), pp. 475–486. IEEE (2006)

  • Anyosa, S.C., Vinagre, J., Jorge, A.M.: Incremental matrix co-factorization for recommender systems with implicit feedback. In: Companion Proceedings of the The Web Conference 2018, pp. 1413–1418 (2018)

  • Avrachenkov, K., Litvak, N., Nemirovsky, D., Osipova, N.: Monte carlo methods in pagerank computation: when one iteration is sufficient. SIAM J. Numer. Anal. 45(2), 890–904 (2007)

    Article  MathSciNet  Google Scholar 

  • Avrachenkov, K., Litvak, N., Nemirovsky, D., Smirnova, E., Sokol, M.: Quick detection of top-k personalized pagerank lists. In: International workshop on algorithms and models for the web-graph, pp. 50–61. Springer (2011)

  • Backstrom, L., Leskovec, J.: Supervised random walks: predicting and recommending links in social networks. In: Proceedings of the fourth ACM international conference on Web search and data mining, pp. 635–644 (2011)

  • Bahmani, B., Chowdhury, A., Goel, A.: Fast incremental and personalized pagerank. Proceedings of the VLDB Endowment 4(3) (2010)

  • Baluja, S., Seth, R., Sivakumar, D., Jing, Y., Yagnik, J., Kumar, S., Ravichandran, D., Aly, M.: Video suggestion and discovery for youtube: taking random walks through the view graph. In: Proceedings of the 17th international conference on World Wide Web, pp. 895–904 (2008)

  • Castells, P., Hurley, N.J., Vargas, S.: Novelty and diversity in recommender systems. In: Recommender Systems Handbook, pp. 881–918. Springer (2015)

  • Celma, O.: Music recommendation. In: Music Recommendation and Discovery, pp. 43–85. Springer (2010)

  • Chandramouli, B., Levandoski, J.J., Eldawy, A., Mokbel, M.F.: Streamrec: a real-time recommender system. In: Proceedings of the 2011 ACM SIGMOD international conference on management of data, pp. 1243–1246 (2011)

  • Christoffel, F., Paudel, B., Newell, C., Bernstein, A.: Blockbusters and wallflowers: Accurate, diverse, and scalable recommendations with random walks. In: Proceedings of the 9th ACM Conference on Recommender Systems, pp. 163–170 (2015)

  • Cooper, C., Lee, S.H., Radzik, T., Siantos, Y.: Random walks in recommender systems: exact computation and simulations. In: Proceedings of the 23rd International Conference on World Wide Web, pp. 811–816 (2014)

  • Cremonesi, P., Koren, Y., Turrin, R.: Performance of recommender algorithms on top-n recommendation tasks. In: Proceedings of the fourth ACM conference on Recommender systems, pp. 39–46 (2010)

  • Deshpande, M., Karypis, G.: Item-based top-n recommendation algorithms. ACM Trans. Inf. Syst. TOIS 22(1), 143–177 (2004)

    Article  Google Scholar 

  • Diaz-Aviles, E., Drumond, L., Schmidt-Thieme, L., Nejdl, W.: Real-time top-n recommendation in social streams. In: Proceedings of the sixth ACM conference on Recommender systems, pp. 59–66 (2012)

  • Domingos, P.M., Hulten, G.: Catching up with the data: Research issues in mining data streams. In: DMKD (2001)

  • Eksombatchai, C., Jindal, P., Liu, J.Z., Liu, Y., Sharma, R., Sugnet, C., Ulrich, M., Leskovec, J.: Pixie: A system for recommending 3+ billion items to 200+ million users in real-time. In: Proceedings of the 2018 world wide web conference, pp. 1775–1784 (2018)

  • Fogaras, D., Rácz, B., Csalogány, K., Sarlós, T.: Towards scaling fully personalized pagerank: algorithms, lower bounds, and experiments. Inter. Math. 2(3), 333–358 (2005)

    MathSciNet  MATH  Google Scholar 

  • Fouss, F., Pirotte, A., Renders, J.M., Saerens, M.: Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Trans. Knowl. Data Eng. 19(3), 355–369 (2007)

    Article  Google Scholar 

  • Frigó, E., Pálovics, R., Kelen, D., Kocsis, L., Benczúr, A.: Online ranking prediction in non-stationary environments (2017)

  • Gama, J., Sebastião, R., Rodrigues, P.P.: Issues in evaluation of stream learning algorithms. In: Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 329–338 (2009)

  • Garcin, F., Dimitrakakis, C., Faltings, B.: Personalized news recommendation with context trees. In: Proceedings of the 7th ACM conference on recommender systems, pp. 105–112 (2013)

  • Gori, M., Pucci, A.: Itemrank: a random-walk based scoring algorithm for recommender engines. In: IJCAI (2007)

  • Gupta, P., Goel, A., Lin, J., Sharma, A., Wang, D., Zadeh, R.: Wtf: The who to follow service at twitter. In: Proceedings of the 22nd international conference on World Wide Web, pp. 505–514 (2013)

  • Harper, F.M., Konstan, J.A.: The movielens datasets: history and context. Acm Trans. Interact. Intell. Syst. TIIS 5(4), 1–19 (2015)

    Google Scholar 

  • Haveliwala, T.H.: Topic-sensitive pagerank: a context-sensitive ranking algorithm for web search. IEEE Trans. Knowl. Data Eng. 15(4), 784–796 (2003)

    Article  Google Scholar 

  • He, R., McAuley, J.: Fusing similarity models with markov chains for sparse sequential recommendation. In: 2016 IEEE 16th international conference on data mMining (ICDM), pp. 191–200. IEEE (2016)

  • Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based recommendations with recurrent neural networks. In: ICLR’16 (2016)

  • Huang, Y., Cui, B., Zhang, W., Jiang, J., Xu, Y.: Tencentrec: Real-time stream recommendation in practice. In: Proceedings of the 2015 ACM SIGMOD international conference on management of data, pp. 227–238 (2015)

  • Huang, Z., Chung, W., Chen, H.: A graph model for e-commerce recommender systems. J. Am. Soc. Inform. Sci. Technol. 55(3), 259–274 (2004)

    Article  Google Scholar 

  • Jannach, D., Lerche, L., Zanker, M.: Recommending based on implicit feedback. In: Social Information Access, pp. 510–569. Springer (2018)

  • Jin, C.: Simulating random walks on graphs in the streaming model. In: 10th Innovations in theoretical computer science conference (ITCS 2019) (2019)

  • Kang, W.C., McAuley, J.: Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining (ICDM), pp. 197–206. IEEE (2018)

  • Koren, Y.: Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 447–456 (2009)

  • Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)

    Article  Google Scholar 

  • Leskovec, J., Rajaraman, A., Ullman, J.D.: Mining of Massive Data Sets. Cambridge University Press, Cambridge (2020)

    Book  Google Scholar 

  • Lovász, L., et al.: Random walks on graphs: a survey. Comb. Paul erdos is Eighty 2(1), 1–46 (1993)

    Google Scholar 

  • Matuszyk, P., Vinagre, J., Spiliopoulou, M., Jorge, A.M., Gama, J.: Forgetting methods for incremental matrix factorization in recommender systems. In: Proceedings of the 30th annual ACM symposium on applied computing, pp. 947–953 (2015)

  • McFee, B., Lanckriet, G.R.: The natural language of playlists. ISMIR 11, 537–541 (2011)

    Google Scholar 

  • Miranda, C., Jorge, A.M.: Item-based and user-based incremental collaborative filtering for web recommendations. In: Portuguese Conference on Artificial Intelligence, pp. 673–684. Springer (2009)

  • Mobasher, B., Dai, H., Luo, T., Nakagawa, M.: Using sequential and non-sequential patterns in predictive web usage mining tasks. In: 2002 IEEE International Conference on Data Mining, 2002. Proceedings., pp. 669–672. IEEE (2002)

  • Moore, J.L., Chen, S.: Taste over time: the temporal dynamics of user preferences. ISMIR 13, 401–406 (2013)

    Google Scholar 

  • Nakagawa, M., Mobasher, B.: Impact of site characteristics on recommendation models based on association rules and sequential patterns. In: Proceedings of the IJCAI, vol. 3, pp. 1–10 (2003)

  • Nasraoui, O., Cerwinske, J., Rojas, C., Gonzalez, F.: Performance of recommendation systems in dynamic streaming environments. In: Proceedings of the 2007 SIAM international conference on data mining, pp. 569–574. SIAM (2007)

  • Natarajan, N., Shin, D., Dhillon, I.S.: Which app will you use next? collaborative filtering with interactional context. In: Proceedings of the 7th ACM conference on recommender systems, pp. 201–208 (2013)

  • Nikolakopoulos, A.N., Karypis, G.: Recwalk: Nearly uncoupled random walks for top-n recommendation. In: Proceedings of the twelfth ACM international conference on web search and data mining, pp. 150–158 (2019)

  • Page, L., Brin, S., Motwani, R., Winograd, T.: The Pagerank Citation Ranking: Bringing Order to the Web. Tech. rep, Stanford InfoLab (1999)

    Google Scholar 

  • Pálovics, R., Benczúr, A.A., Kocsis, L., Kiss, T., Frigó, E.: Exploiting temporal influence in online recommendation. In: Proceedings of the 8th ACM conference on recommender systems, pp. 273–280 (2014)

  • Pan, R., Zhou, Y., Cao, B., Liu, N.N., Lukose, R., Scholz, M., Yang, Q.: One-class collaborative filtering. In: 2008 eighth IEEE international conference on data mining, pp. 502–511. IEEE (2008)

  • Papagelis, M., Rousidis, I., Plexousakis, D., Theoharopoulos, E.: Incremental collaborative filtering for highly-scalable recommendation algorithms. In: International symposium on methodologies for intelligent systems, pp. 553–561. Springer (2005)

  • Paudel, B., Christoffel, F., Newell, C., Bernstein, A.: Updatable, accurate, diverse, and scalable recommendations for interactive applications. ACM Trans. Interact. Intell. Syst. TiiS 7(1), 1–34 (2017)

    Article  Google Scholar 

  • Quadrana, M., Cremonesi, P., Jannach, D.: Sequence-aware recommender systems. ACM Comput. Surv. CSUR 51(4), 1–36 (2018)

    Google Scholar 

  • Quadrana, M., Karatzoglou, A., Hidasi, B., Cremonesi, P.: Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the eleventh ACM conference on recommender systems, pp. 130–137 (2017)

  • Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: Bpr: Bayesian personalized ranking from implicit feedback. In: Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence, pp. 452–461 (2009)

  • Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on World wide web, pp. 811–820 (2010)

  • Sarkar, P., Moore, A.W., Prakash, A.: Fast incremental proximity search in large graphs. In: Proceedings of the 25th international conference on Machine learning, pp. 896–903 (2008)

  • Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, pp. 285–295 (2001)

  • Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Incremental singular value decomposition algorithms for highly scalable recommender systems. In: Fifth international conference on computer and information science, vol. 1, pp. 27–8. Citeseer (2002)

  • Schmitt, M.F., Spinosa, E.J.: Incremental graph of sequential interactions for online recommendation with implicit feedback. In: 3rd Workshop on online recommender systems and user modeling (2020)

  • Shani, G., Heckerman, D., Brafman, R.I., Boutilier, C.: An mdp-based recommender system. J. Mach. Learn. Res. 6(9) (2005)

  • Shi, Y., Larson, M., Hanjalic, A.: Collaborative filtering beyond the user-item matrix: a survey of the state of the art and future challenges. ACM Comput. Surv. CSUR 47(1), 3 (2014)

    Google Scholar 

  • Smyth, B., McClave, P.: Similarity vs. diversity. In: International conference on case-based reasoning, pp. 347–361. Springer (2001)

  • Symeonidis, P., Kirjackaja, L., Zanker, M.: Session-aware news recommendations using random walks on time-evolving heterogeneous information networks. User modeling and user-adapted interaction pp. 1–29 (2020)

  • Takács, G., Pilászy, I., Németh, B., Tikk, D.: Scalable collaborative filtering approaches for large recommender systems. J. Mach. Learn. Res. 10, 623–656 (2009)

    Google Scholar 

  • Trevisiol, M., Aiello, L.M., Schifanella, R., Jaimes, A.: Cold-start news recommendation with domain-dependent browse graph. In: Proceedings of the 8th ACM conference on recommender systems, pp. 81–88 (2014)

  • Vahedian, F., Burke, R., Mobasher, B.: Weighted random walk sampling for multi-relational recommendation. In: Proceedings of the 25th conference on user modeling, adaptation and personalization, pp. 230–237 (2017)

  • Vinagre, J.: Scalable adaptive collaborative filtering. Ph.D. thesis, Universidade do Porto (Portugal) (2016)

  • Vinagre, J., Jorge, A., Gama, J.: Evaluation of recommender systems in streaming environments. In: Proceedings of the workshop on recommender systems evaluation: dimensions and design in conjunction with the 8th ACM conference on recommender systems (RecSys 2014) (2014)

  • Vinagre, J., Jorge, A.M., Gama, J.: Fast incremental matrix factorization for recommendation with positive-only feedback. In: International conference on user modeling, adaptation, and personalization, pp. 459–470. Springer (2014)

  • Vinagre, J., Jorge, A.M., Gama, J.: Collaborative filtering with recency-based negative feedback. In: Proceedings of the 30th annual ACM symposium on applied computing, pp. 963–965 (2015)

  • Vinagre, J., Jorge, A.M., Gama, J.: An overview on the exploitation of time in collaborative filtering. Wiley Interdiscip. Rev. Data Mining Knowl. Discov. 5(5), 195–215 (2015)

    Article  Google Scholar 

  • Xiang, L., Yuan, Q., Zhao, S., Chen, L., Zhang, X., Yang, Q., Sun, J.: Temporal recommendation on graphs via long-and short-term preference fusion. In: Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 723–732 (2010)

  • Yagci, A.M., Aytekin, T., Gurgen, F.S.: Scalable and adaptive collaborative filtering by mining frequent item co-occurrences in a user feedback stream. Eng. Appl. Artif. Intell. 58, 171–184 (2017)

    Article  Google Scholar 

  • Yin, H., Cui, B., Zhou, X., Wang, W., Huang, Z., Sadiq, S.: Joint modeling of user check-in behaviors for real-time point-of-interest recommendation. ACM Trans. Inf. Syst. TOIS 35(2), 1–44 (2016)

    Article  Google Scholar 

  • Zhang, J.D., Chow, C.Y., Li, Y.: Lore: Exploiting sequential influence for location recommendations. In: Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 103–112 (2014)

  • Zhou, B., Hui, S.C., Chang, K.: An intelligent recommender system using sequential web access patterns. In: IEEE Conference on Cybernetics and Intelligent Systems, 2004., vol. 1, pp. 393–398. IEEE (2004)

Download references

Acknowledgements

This work was partially funded by CAPES.

Author information

Authors and Affiliations

  1. Federal University of Paraná, Curitiba, Brazil

    Murilo F. L. Schmitt & Eduardo J. Spinosa

Authors
  1. Murilo F. L. Schmitt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eduardo J. Spinosa
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schmitt, M.F.L., Spinosa, E.J. Scalable stream-based recommendations with random walks on incremental graph of sequential interactions with implicit feedback. User Model User-Adap Inter 32, 543–573 (2022). https://doi.org/10.1007/s11257-021-09315-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-021-09315-6

Keywords

Search

Navigation