Abstract
The application of machine learning (ML) has grown and is now used to enhance learning outcomes. In blended classroom settings, ML, emerging smartphones and wearable technologies are commonly used to improve teaching and learning. The combination of these advanced technologies and ML plays a crucial role in enhancing real-time feedback quality. However, there are abundant scopes of improvement and strong need for further careful investigations in this area. We propose an ML-based intelligent real-time feedback system to address current research challenges for blended classrooms. The proposed system provides real-time feedback to students and teachers. We build an Android application for our intelligent feedback interfaces. The user interfaces use students’ academic performance prediction models with real-time states and dynamic feedback timings based on historic feedback statistics. In addition, the feedback scheduling algorithms, choices of peripheral devices for real-time feedback, and feedback modalities to optimize fatigue make our system interfaces intelligent and novel. The end users well-received the intelligent features and technology of the proposed system. Our empirical findings indicate that unique design elements, such as dynamic timing, choice of peripheral devices, and modalities of real-time feedback, are crucial in integrating the system with blended classes. The intelligent characteristics of the proposed system have been appreciated by a large proportion of the end-users (90.90% of teachers and 84.21% of students) for use in real-time blended classroom environments. The higher comparative system usability scale (SUS) scores with benchmarks show real promise of the system design.
Similar content being viewed by others
Data availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Adam, N. R., Shafiq, B., & Staffin, R. (2012). Spatial computing and social media in the context of disaster management. IEEE Intelligent Systems, 27(6), 90–96. https://doi.org/10.1109/TLT.2014.2383611
Albert, B., & Tullis, T. (2013). Measuring the user experience: collecting, analyzing, and presenting usability metrics. Newnes.
Aldowah, H., & Al-Samarraie, H. (2019). W M Fauzy 2019 Educational data mining and learning analytics for 21stcentury higher education: A review and synthesis. Telematics and Informatics, 37, 13–49. https://doi.org/10.1016/j.tele.2019.01.007
Augusto, J.C., Nakashima, H., Aghajan, H. (2010). Ambient intelligence and smart environments: A state of the art. In: Nakashima, H., Aghajan, H., Augusto, J.C. (eds) Handbook of Ambient Intelligence and Smart Environments. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-93808-0_1
Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual sus scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3), 114–123. https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Bangor_May2009.pdf.
Batool, S., Rashid, J., Nisar, M. W., Kim, J., Kwon, H.-Y., & Hussain, A. (2023). (2023) Educational data mining to predict students’ academic performance: A survey study. Education and Information Technologies, 28(1), 905–971. https://doi.org/10.1007/s10639-022-11152-y
Bhattacharya, S., Shah, V. B., Kumar, K., & Biswas, U. (2021). A real-time interactive visualizer for large classroom. ACM Transactions on Interactive Intelligent Systems (TiiS), 11(1), 1–26. https://doi.org/10.1145/3418529
Biswas, U., & Bhattacharya, S., (2022). Multimodal peripheral alert to improve teaching-learning for blended classroom. In ICT Analysis and Applications: Proceedings of ICT4SD 2022, pages 703–713. Springer.
Boucek, G.P. Jr., Veitengrubber, J.E., & Smith, W.D (1977) Aircraft alerting systems criteria study. Volume II. Human factors guidelines for aircraft alerting systems. BOEING COMMERCIAL AIRPLANE CO SEATTLE WA. https://apps.dtic.mil/sti/pdfs/ADA043383.pdf
Braun, M. C., Beuck, S., Wölfel, M., & Scheurer, A. (2018). Investigating multimodal warnings for distracted smartphone users on the move in potentially dangerous situations. Transactions on Computational Science XXXII (pp. 1–14). Springer.
Choudhury, N., Tamarapalli, V., & Bhattacharya, S. (2015). An ict-based system to improve the learning experience in a large classroom. 2015 IEEE Seventh International Conference on Technology for Education (T4E) (pp. 27–30). IEEE. https://doi.org/10.1109/T4E.2015.1
Choudhury, N., Venkatesh, T., Bhattacharya, S., & Sarma, S. (2016). Avabodhaka: a system to analyse and facilitate interactive learning in an ict based system for large classroom. Procedia Computer Science, 84, 160–168. https://doi.org/10.1016/j.procs.2016.04.082
Fahd, K., Venkatraman, S., Miah, S. J., et al. (2022). Application of machine learning in higher education to assess student academic performance, at-risk, and attrition: A meta-analysis of literature. Education and Information Technologies, 27, 3743–3775. https://doi.org/10.1007/s10639-021-10741-7
Fernández-Delgado, M., Mucientes, M., Vázquez-Barreiros, B., & Lama, M. (2014). Learning analytics for the prediction of the educational objectives achievement. 2014 IEEE Frontiers in Education Conference (FIE) Proceedings (pp. 1–4). IEEE. https://doi.org/10.1109/FIE.2014.7044402
Fortin, P.E. (2019) Methods and interfaces for closed loop smartphone notifications. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, (pages 1–5). https://doi.org/10.1145/3338286.3344422
Ge, X., Liu, J., Qi, Q., & Chen, Z. (2011). A new prediction approach based on linear regression for collaborative filtering. 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) (Vol. 4, pp. 2586–2590). IEEE. https://doi.org/10.1109/FSKD.2011.6020007
Hellas, A., Ihantola, P., Petersen, A., Ajanovski, V.V., Gutica, M., Hynninen, T., Knutas, A., Leinonen, J., Messom, Chris., Liao, S.N. (2018) Predicting academic performance: a systematic literature review. In Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, (pages 175–199). https://doi.org/10.1145/3293881.3295783
Holstein, K., McLaren, B.M., & Aleven V. (2017). Intelligent tutors as teachers’ aides: exploring teacher needs for real-time analytics in blended classrooms. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference, (pages 257–266). https://doi.org/10.1145/3027385.3027451
Holstein, K., McLaren, B.M., Aleven, V. (2019). Designing for Complementarity: Teacher and Student Needs for Orchestration Support in AI-Enhanced Classrooms. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds) Artificial Intelligence in Education. AIED 2019. Lecture Notes in Computer Science, 11625. https://doi.org/10.1007/978-3-030-23204-7_14
Keser, S. B., & Aghalarova, S. (2022). Hela: A novel hybrid ensemble learning algorithm for predicting academic performance of students. Education and Information Technologies, 27(4), 4521–4552. https://doi.org/10.1007/s10639-021-10780-0
Ketabdar, H., Moghadam, P., & Roshandel, M. (2012). Pingu: A new miniature wearable device for ubiquitous computing environments. 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems (pp. 502–506). IEEE.
Kumar S (2014). Ubiquitous smart home system using android application. Academy and Industry Research Collaboration Center (AIRCC). International Journal of Computer Networks & Communications, 6(1), 33–43. https://doi.org/10.5121/ijcnc.2014.6103
Kushlev, K., Proulx, J., & Dunn EW (2016). Silence your phones, smartphone notifications increase inattention and hyperactivity symptoms. In Proceedings of the 2016 CHI conference on human factors in computing systems, (pages 1011–1020). https://doi.org/10.1145/2858036.2858359
Márquez-Vera, C., Cano, A., Romero, C., Noaman, A. Y. M., MousaFardoun, H., & Ventura, S. (2016). Early dropout prediction using data mining: a case study with high school students. Expert Systems, 33(1), 107–124. https://doi.org/10.1111/exsy.12135
Marshall, D. C., Lee, J. D., & Austria, P. A. (2007). Alerts for in-vehicle information systems: Annoyance, urgency, and appropriateness. Human factors, 49(1), 145–157. https://doi.org/10.1518/001872007779598145
Marshall, E., & Baker, S., (1995). Alarms in nuclear power plant control rooms: current approaches and future design. In Human factors in alarm design, (pages 183–191). https://doi.org/10.5555/212905.212916
Martinez-Maldonado, R., Clayphan, A., Yacef, K., & Kay, J. (2014). Mtfeedback: Providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Transactions on Learning Technologies, 8(2), 187–200. https://doi.org/10.1109/TLT.2014.2365027
Mathioudakis, G., Leonidis, A., Korozi, M., Margetis, G., Ntoa, S., Antona, M., & Stephanidis, C. (2014). Real-time teacher assistance in technologically-augmented smart classrooms. International Journal of Advanced Life Sciences, 6(1), 62–73.
Meredith, C., & Edworthy, J. (1995). Are there too many alarms in the intensive care unit? an overview of the problems. Journal of Advanced Nursing, 21(1), 15–20. https://doi.org/10.1046/j.1365-2648.1995.21010015.x
Pece, F., Zarate, J.J., Vechev, V., Besse, N., Gudozhnik, O., Shea H., Hilliges, O., (2017). Magtics: Flexible and thin form factor magnetic actuators for dynamic and wearable haptic feedback. In Proceedings of the 30th annual ACM symposium on User interface software and technology, (pages 143–154). https://doi.org/10.1145/3126594.3126609
Rastrollo-Guerrero, J. L., Gómez-Pulido, J. A., & Durán-Domnguez, A. (2020). Analyzing and predicting students performance by means of machine learning: A review. Applied Sciences, 10(3), 1042. https://doi.org/10.3390/app10031042
Rovira, S., Puertas, E., & Igual, L. (2017). Data-driven system to predict academic grades and dropout. PLoS one, 12(2), 207. https://doi.org/10.1371/journal.pone.0171207
Saikia, M. S. I., Kumar, P., Bhattacharya, S., & Tamarapalli, V. (2016). Estimating attention and understanding level of students in a large classroom environment. In 2016 IEEE Eighth International Conference on Technology for Education (T4E), (pages 128–131). https://doi.org/10.1109/T4E.2016.033
Singley, M.K., & Lam, R.B., (2005).The classroom sentinel: supporting data-driven decision-making in the classroom. In Proceedings of the 14th international conference on World Wide Web, (pages 315–321). https://doi.org/10.1145/1060745.1060793
Srivastava, K., & Dey, S. (2018). Role of digital technology in teaching-learning process. IOSR Journal Of Humanities And Social Science (IOSR-JHSS), 23(1), 74–79. https://sadbhavnaresearchjournal.com/wp-content/uploads/2022/08/03Mr.-B.-Babu-Pg-20-31.pdf..
Sweeney, Mack, Lester, Jaime, Rangwala, Huzefa, & Johri, Aditya. (2016). Next-Term Student Performance Prediction: A Recommender Systems Approach. Journal of Educational Data Mining, 8(1), 22–51. https://doi.org/10.5281/zenodo.3554604
Tabuenca, B., Kalz, M., Ternier, S., & Specht, M. (2014). Stop and think: Exploring mobile notifications to foster reflective practice on meta-learning. IEEE Transactions on Learning Technologies, 8(1), 124–135. https://doi.org/10.1109/TLT.2014.2383611
Talwar, J., Ranjani, S., Aras A., & Bedekar M.(2013) Intelligent classroom system for qualitative analysis of students’ conceptual understanding. In 2013 6th International Conference on Emerging Trends in Engineering and Technology, (pages 25–290. https://doi.org/10.1109/ICETET.2013.6
Tang, Y., Liang, J., Hare, R., & Wang, F.-Y. (2020). A personalized learning system for parallel intelligent education. IEEE Transactions on Computational Social Systems, 7(2), 352–361. https://doi.org/10.1109/TCSS.2020.2965198
Tikadar, S., Bhattacharya, S., (2021). Detection of affective states of the students in a blended learning environment comprising of smartphones. International Journal of Human–Computer Interaction, 37(10), 963-980. https://doi.org/10.1080/10447318.2020.1861762
Tikadar, S., Bhattacharya, S., & Tamarapalli, V., (2018). A blended learning platform to improve teaching-learning experience. In 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), (pages 87–89). IEEE, https://doi.org/10.1109/ICALT.2018.00027
Tikadar, S., (2021). Vedinkaksha: A Computational Framework for a ‘Sensitive’Blended Learning Platform. Phd thesis, Indian Institute of Technology Guwahati, 2021. Available at http://gyan.iitg.ac.in/handle/123456789/2035.
Tullis, T., & Albert, W. (2013). Measuring the User Experience, Second Edition: Collecting, Analyzing, and Presenting Usability Metrics (2nd ed.). Morgan Kaufmann Publishers Inc.
Verweij, D., Bakker S., & Eggen, Berry., (2017). Fireflies2: Interactive tangible pixels to enable distributed cognition in classroom technologies. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces, (pages 260–269). ACM, https://doi.org/10.1145/3132272.3134122.
Wang., Z, Zhu, C., Ying Z., Zhang, Y., Wang, B., Jin, X., & Yang, H., (2018). Design and implementation of early warning system based on educational big data. In 2018 5th International Conference on Systems and Informatics (ICSAI), (pages 549–553). IEEE. https://doi.org/10.1109/ICSAI.2018.8599357
Winters, B. D., Cvach, M. M., Bonafide, C. P., Hu, X., Konkani, A., O’connor, M. F., Rothschild, J. M., Selby, N. M., Pelter, M. M., McLean, B., et al. (2018). Technological distractions (part 2): a summary of approaches to manage clinical alarms with intent to reduce alarm fatigue. Critical care medicine, 46(1), 130–137. https://doi.org/10.1097/CCM.0000000000002803
Yürür, Ö., Liu, C. H., & Moreno, W. (2015). Light-weight online unsupervised posture detection by smartphone accelerometer. IEEE Internet of Things Journal, 2(4), 329–339. https://doi.org/10.1109/JIOT.2015.2404929
Yusof, R. J. R., Qazi, A., & Inayat, I. (2017). Student real-time visualization system in classroom using rfid based on utaut model. The International Journal of Information and Learning Technology. https://doi.org/10.1108/IJILT-03-2017-0018/full/pdf
Zagouras, C., Egarchou, D., Skiniotis, P., et al. (2022). Face to face or blended learning? A case study: Teacher training in the pedagogical use of ICT. Education and Information Technologies, 27, 12939–12967. https://doi.org/10.1007/s10639-022-11144-y
Author information
Authors and Affiliations
Contributions
Both authors contributed to write the final manuscript, discused about the research methods and findings.
Corresponding author
Ethics declarations
Competing interests
The authors affirm that they have no known financial or interpersonal conflicts that would have appeared to have an impact on the research presented in this study.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Biswas, U., Bhattacharya, S. ML-based intelligent real-time feedback system for blended classroom. Educ Inf Technol 29, 3923–3951 (2024). https://doi.org/10.1007/s10639-023-11949-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-023-11949-5