Abstract
Classroom teaching becomes viable and efficient based on increase in participation of the student. This can be made possible by taking needed measure by finding the emotions of the students. Many researchers worked on emotion identification of students. Now-a-days sentiment analysis using deep learning models have gained good performance. Especially ensemble Long Short-Term Memory (LSTM) with attention layers gives more attention to the influence word on the emotion. In the proposed method, input sequences of sentences are processed parallel across multi-head attention layer with fine grained embeddings (Glove and Cove) and tested with different dropout rates to increase the accuracy. Later in this paper, the information from both deep multi-layers is fused and fed as input to the LSTM layer. In this paper, we conclude that the fusion of multiple layers accompanied with LSTM improves the result over a common Natural Language Processing method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Change history
28 June 2022
This article has been retracted. Please see the Retraction Notice for more detail: https://doi.org/10.1007/s12652-022-04240-x
References
Abhishek R, Sanket M, Harshada S, Gayatri P, Pophale SS (2017) Online feedback analysis using sentiment analyzer. Int J Emerg Trends Technol Comput Sci. 6(2)
Agarwal A, Xie B, Vovsha I, Rambow O, Passonneau R (2011) Sentiment analysis of twitter data”, in Proceedings of the workshop on languages in social media, pp 30–38
An H, Moon N (2019) Design of recommendation system for tourist spot using sentiment analysis based on CNN-LSTM. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-019-01521-w
Baradwaj BK, Pal S (2011) Mining educational data to analyze students performance. Int J Adv Comput Sci Appl 2(6):63–69
Bulger SM, Mohr DJ, Wall RT (2002) Stack the deck in favor of your students by using the four aces of effective teaching. J Eff Teach 5(2):512–527
Calders T, Pechenizkiy M (2010) Introduction to the special section on educational data mining. ACM 13(2):3–6
Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. JMLR 12:2493–2537
Cummins S, Burd L, Hatch A (2010) Using feedback tags and sentiment analysis to generate sharable learning resources investigating automated sentiment analysis of feedback tags in a programming course. Adv Learn Technol (ICALT) 10:653–657
Dhandayudam P, Krishnamurthi I (2014) Rough set approach for characterizing customer behavior. Arab J Sci Eng 39(6):4565–4576
Ding J, Dong Y, Gao T, Zhang Z, Liu Y (2016) Sentiment analysis of chinese micro-blog based on classification and rich features. In: 13th Web information systems and applications conference (WISA), pp 61–66
D’mello S, Graesser A (2012) Autotutor and Affective Autotutor: Learning by talking with cognitively and emotionally intelligent computers that talk back. ACM Trans Interact Intell Syst 2(4):23–39
D’Mello S, Jackson T, Craig S et al (2008) Autotutor detects and respondstolearners affective and cognitive states. In: Workshop on emotional and cognitive issues at the international conference on intelligent tutoring systems, pp 31–43
Fu X, Yang J, Li J, Fang M, Wang H (2018) Lexicon-enhanced LSTM with attention for general sentiment analysis. IEEE Access 6:71884–71891. https://doi.org/10.1109/ACCESS.2018.2878425
Grosseck G, Holotescu C (2008) Can we use twitter for educational activities. In: The fourth international conference on eLearning and software for education, Vol. 4
He R, Lee WS, Ng HT, Dahlmeier D (2018) Effective attention modeling for aspect-level sentiment classification. Proceedings of the 27th international conference on computational linguistics, pp 1121–1131
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Keras/examples/text generation (2019) https://github.com/fchollet/keras/blob/master/examples/lstm_text_generation.p
Kumar, A, Garg G (2019) Empirical study of shallow and deep learning models for sarcasm detection using context in benchmark datasets J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-019-01419-7
Levy O, Goldberg Y, Dagan I (2015) Improving distributional similarity with lessons learned from word embeddings. TACL 3:211–225
Li J, Tu Z, Yang B, Lyu MR, Zhang T (2018) Muti-head attention with disagreement regularization. arXiv preprint arXiv:1810.10183
Machine Learning Mastery (2019) https://machinelearningmastery.com/use-word-embedding-layers-deep-learning-keras
Martin JM, Ortigosa A, Carro RM (2012) Sentbuk sentiment analysis for e-learning environments. In: International symposium on computers in education (SIIE), Vol 12, pp 212–217
Metrics to Evaluate your Machine Learning Algorithm (2018) https://towardsdatascience.com/metrics-to-evaluate-your-machine-learning-algorithm-f10ba6e38234
Moniz J, Krueger D (2017) Nested LSTMs. ACML 1801:1–15
Munezero M, Montero CS, Mozgovoy M, Sutinen E (2013) Exploiting sentiment analysis to track emotions in student learning diaries. In: Proceedings of the 13th Koli Calling international conference on computing education research, ACM, pp 145–152
Nasim Z, Rajput Q, Haider S (2017) Sentiment analysis of student feedback using machine learning and lexicon based approaches. In: International conference on research and innovation in information systems, pp 1–6
Novak J, Cowling M (2011) The implementation of social networking as a tool for improving student participation in the classroom. In: ISANA international academy association conference proceedings, vol 22. ISANA International Education, Inc., Auckland, NZ, pp 1–10
Ortigosa A, Martín JM, Carro RM (2014) Sentiment analysis in facebook and its application to e-learning. Comput Hum Beh. 31:527–541
Pak P, Paroubek P (2010) Twitter based system: using twitter for disambiguating sentiment ambiguous adjectives. In: Proceedings of the international workshop on semantic evaluation, Vol 5, pp 436–439
Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. EMNL 14:1532–1543
Petersy ME, Neumanny M, Iyyery M, Gardnery M (2018) Deep contextualized word representations. Allen Institute for Artificial Intelligence
Poulos A, Mahony MJ (2008) Effectiveness of feedback: the student’s perspective. Assess Eval High Educ 33(2):143–154
Rani S, Kumar P (2017) A sentiment analysis system to improve teaching and learning. Computer 50:36–43
Shin B, Chokshi FH, Lee T Choi JD (2017) Classification of radiology reports using neural attention models. International joint conference on neural networks (IJCNN), pp 4363–4370
Simple guide to confusion matrix terminology (2014) https://www.dataschool.io/simple-guide-to-confusion-matrix-terminology
Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. ACL. 1503:00075
Tang DY et al (2014) Learning sentiment-specific word embedding for twitter sentiment classification. ACL, pp 1555–1565
Troussas C, Virvou M, Espinosa KJ, Llaguno K, Caro J (2013) Sentiment analysis of facebook statuses using naive bayes classifier for language learning. Inf Intell Syst Appl 4:1–6
Turkoglu M, Hanbay D, Sengur A (2019) multi-model LSTM-based convolutional neural networks for detection of apple diseases and pests. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-019-01591-w
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998–6008
Van Nguyen K, Nguyen VD, Nguyen PX, Truong TT, Nguyen NLT (2018. Uit-vsfc: vietnamese students’ feedback corpus for sentiment analysis. In: 2018 10th international conference on knowledge and systems engineering (KSE), IEEE, pp 19–24
Vohra MS, Teraiya J (2013) Applications and challenges for sentiment analysis: a survey. IJERTV 2(2):1–5
Wang W, Wu J (2011) Emotion recognition based on cso&svm in e-learning. In: Seventh international conference on natural computation (ICNC), Vol 7, pp 566–570
Wikipedia precision and recall (2019) https://en.wikipedia.org/wiki/Precision_and_recal
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article has been retracted. Please see the retraction notice for more detail: https://doi.org/10.1007/s12652-022-04240-x
About this article
Cite this article
Sangeetha, K., Prabha, D. RETRACTED ARTICLE: Sentiment analysis of student feedback using multi-head attention fusion model of word and context embedding for LSTM. J Ambient Intell Human Comput 12, 4117–4126 (2021). https://doi.org/10.1007/s12652-020-01791-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-01791-9