Skip to main content

Attention-Based High-Order Feature Interactions to Enhance the Recommender System for Web-Based Knowledge-Sharing Service

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12342))

Abstract

Providing personalized online learning services has become a hot research topic. Online knowledge-sharing services represents a popular approach to enable learners to use fragmented spare time. User asks and answers questions in the platform, and the platform also recommends relevant questions to users based on their learning interested and context. However, in the big data era, information overload is a challenge, as both online learners and learning resources are embedded in data rich environment. Offering such web services requires an intelligent recommender system to automatically filter out irrelevant information, mine underling user preference, and distil latent information. Such a recommender system needs to be able to mine complex latent information, distinguish differences between users efficiently. In this study, we refine a recommender system of a prior work for web-based knowledge sharing. The system utilizes attention-based mechanisms and involves high-order feature interactions. Our experimental results show that the system outperforms known benchmarks and has great potential to be used for the web-based learning service.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://www.quora.com/.

  2. 2.

    https://stackoverflow.com/.

  3. 3.

    https://www.zhihu.com/.

References

  1. Lin, J., et al.: From ideal to reality: segmentation, annotation, and recommendation, the vital trajectory of intelligent micro learning. World Wide Web 23(3), 1747–1767 (2019). https://doi.org/10.1007/s11280-019-00730-9

    Article  Google Scholar 

  2. Eshach, H.: Bridging in-school and out-of-school learning: formal, non-formal, and informal education. J. Sci. Educ. Technol. 16(2), 171–190 (2007). http://dx.doi.org/10.1007/s10956-006-9027-1

  3. Song, W., et al.: Autoint: automatic feature interaction learning via self-attentive neural networks. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 1161–1170. ACM (2019)

    Google Scholar 

  4. Huang, T., Zhang, Z., Zhang, J.: FiBiNET: combining feature importance and bilinear feature interaction for click-through rate prediction. In: Proceedings of the 13th ACM Conference on Recommender Systems, pp. 169–177 (2019)

    Google Scholar 

  5. Pazzani, M.J.: A framework for collaborative, content-based and demographic filtering. Artif. Intell. Rev. 13(5–6), 393-408 (1999)

    Google Scholar 

  6. Lin, J., et al.: Deep-cross-attention recommendation model for knowledge sharing micro learning service. In: Bittencourt, I.I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (eds.) AIED 2020. LNCS (LNAI), vol. 12164, pp. 168–173. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-52240-7_31

    Chapter  Google Scholar 

  7. Wu, D., Lu, J., Zhang, G.: A fuzzy tree matching-based personalized e-learning recommender system. IEEE Trans. Fuzzy Syst. 23(6), 2412–2426 (2015). https://doi.org/10.1109/TFUZZ.2015.2426201

    Article  Google Scholar 

  8. Sikka, R., Dhankhar, A., Rana, C.: A survey paper on e-learning recommender system. Int. J. Comput. Appl. 47(9), 27–30 (2012). https://doi.org/10.5120/7218-0024

    Article  Google Scholar 

  9. Hoic-Bozic, N., Dlab, M.H., Mornar, V.: Recommender system and web 2.0 tools to enhance a blended learning model. IEEE Trans. Educ. 59(1), 39–44 (2015)

    Google Scholar 

  10. Chen, W., Niu, Z., Zhao, X., Li, Y.: A hybrid recommendation algorithm adapted in e-learning environments. World Wide Web 17(2), 271–284 (2012). https://doi.org/10.1007/s11280-012-0187-z

    Article  Google Scholar 

  11. Rusak, Z.: Exploitation of micro-learning for generating personalized learning paths. In: DS 87–9 Proceedings of the 21st International Conference on Engineering Design (ICED 17), 21-25.08, 2017, vol 9, pp. 129-138. Design Education, Vancouver, Canada (2017)

    Google Scholar 

  12. Zhao, Q., Zhang, Y., Chen, J.: An improved ant colony optimization algorithm for recommendation of micro-learning path. In: 2016 IEEE International Conference on Computer and Information Technology (CIT), pp. 190–196. IEEE (2016)

    Google Scholar 

  13. Rendle, S.: Factorization machines. In: 2010 IEEE International Conference on Data Mining, pp. 995–1000. IEEE (2010)

    Google Scholar 

  14. Fischer, T., Krauss, C.: Deep learning with long short-term memory networks for financial market predictions. Eur. J. Oper. Res. 270(2), 654–669 (2018)

    Article  MathSciNet  Google Scholar 

  15. Liu, J., Chang, W.-C., Wu, Y., Yang, Y.: Deep learning for extreme multi-label text classification. In: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 115–124 (2017)

    Google Scholar 

  16. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  17. Cheng, H.-T., et al.: Wide and deep learning for recommender systems. In: Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, pp. 7–10. ACM (2016)

    Google Scholar 

  18. Guo, H., Tang, R., Ye, Y., Li, Z., He, X.: DeepFM: a factorization-machine based neural network for CTR prediction. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, pp. 1725–1731 (2017)

    Google Scholar 

  19. Lian, J., Zhou, X., Zhang, F., Chen, Z., Xie, X., Sun, G.: xDeepFM: combining explicit and implicit feature interactions for recommender systems. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1754–1763. ACM (2018)

    Google Scholar 

  20. Wang, R., Fu, B., Fu, G., Wang, M.: Deep and cross network for ad click predictions. In: Proceedings of the ADKDD’17, p. 12. ACM (2017)

    Google Scholar 

  21. Xiao, J., Ye, H., He, X., Zhang, H., Wu, F., Chua, T.-S.: Attentional factorization machines: learning the weight of feature interactions via attention networks. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, pp. 3119–3125 (2017)

    Google Scholar 

  22. Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)

    Google Scholar 

  23. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

    Google Scholar 

  24. Shan, Y., Hoens, T.R., Jiao, J., Wang, H., Yu, D., Mao, J.: Deep crossing: web-scale modeling without manually crafted combinatorial features. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 255–262. ACM (2016)

    Google Scholar 

  25. Dobozy, E.: University lecturer views on pedagogic lurking. In: 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT), pp. 1–2. IEEE (2017)

    Google Scholar 

  26. Beaudoin, M.F.: Learning or lurking?: tracking the “invisible” online student. Internet High. Educ. 5(2), 147–155 (2002)

    Google Scholar 

  27. Dennen, V.P.: Pedagogical lurking: student engagement in non-posting discussion behavior. Comput. Hum. Behav. 24(4), 1624–1633 (2008)

    Article  Google Scholar 

  28. Paszke, A., et al.: PyTorch: an imperative style, high-performance deep learning library. Adv. Neural Inf. Process. Syst., pp. 8024–8035 (2019)

    Google Scholar 

  29. Zhou, G., et al.: Deep interest evolution network for click-through rate prediction. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 5941–5948 (2019)

    Google Scholar 

Download references

Acknowledgments

This research has been carried out with the support of the Australian Research Council Discovery Project, DP180101051, and Natural Science Foundation of China, no. 61877051.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Jiayin Lin , Geng Sun , Jun Shen , Tingru Cui , David Pritchard , Dongming Xu , Li Li , Wei Wei , Ghassan Beydoun or Shiping Chen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lin, J. et al. (2020). Attention-Based High-Order Feature Interactions to Enhance the Recommender System for Web-Based Knowledge-Sharing Service. In: Huang, Z., Beek, W., Wang, H., Zhou, R., Zhang, Y. (eds) Web Information Systems Engineering – WISE 2020. WISE 2020. Lecture Notes in Computer Science(), vol 12342. Springer, Cham. https://doi.org/10.1007/978-3-030-62005-9_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-62005-9_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-62004-2

  • Online ISBN: 978-3-030-62005-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics