Skip to main content
Log in

Designing automated adaptive support to improve student helping behaviors in a peer tutoring activity

  • Published:
International Journal of Computer-Supported Collaborative Learning Aims and scope Submit manuscript

Abstract

Adaptive collaborative learning support systems analyze student collaboration as it occurs and provide targeted assistance to the collaborators. Too little is known about how to design adaptive support to have a positive effect on interaction and learning. We investigated this problem in a reciprocal peer tutoring scenario, where two students take turns tutoring each other, so that both may benefit from giving help. We used a social design process to generate three principles for adaptive collaboration assistance. Following these principles, we designed adaptive assistance for improving peer tutor help-giving, and deployed it in a classroom, comparing it to traditional fixed support. We found that the assistance improved the conceptual content of help and the use of interface features. We qualitatively examined how each design principle contributed to the effect, finding that peer tutors responded best to assistance that made them feel accountable for help they gave.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Baghaei, N., Mitrovic, A., & Irwin, W. (2007). Supporting collaborative learning and problem solving in a constraint-based CSCL environment for UML class diagrams. International Journal of Computer-Supported Collaborative Learning, 2(2–3), 159–190.

    Article  Google Scholar 

  • Barab, S., & Squire, K. (2004). Design-based research: Putting a stake in the ground. Journal of the Learning Sciences, 13(1), 1–14.

    Article  Google Scholar 

  • Bernsen, N., Dybkjær, H., & Dybkjær, L. (1997). What should your speech system say? Computer, 30(12), 25–31. Dec. 1997.

    Article  Google Scholar 

  • Beyer, H., & Holtzblatt K. (1997). Contextual Design: A Customer-Centered Approach to Systems Designs. Academic Press.

  • Booth, J. L., & Koedinger, K. R. (2008). Key misconceptions in algebraic problem solving. In B. C. Love, K. McRae, & V. M. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 571–576). Austin: Cognitive Science Society.

    Google Scholar 

  • Brusilovsky, P. (2001). Adaptive hypermedia. User Modeling and User-Adapted Interaction, 11(1/2), 111–127.

    Article  Google Scholar 

  • Brydon-Milier, M., Greenwood, D., & Maguire, P. (2003). Why action research? Action Research, 1(1), 9–28.

    Article  Google Scholar 

  • Chan, T. W., & Chou, C.-Y. (1997). Exploring the design of computer supports for reciprocal tutoring. International Journal of Artificial Intelligence in Education, 8(1), 1–29.

    Google Scholar 

  • Chaudhuri, S., Kumar, R., Howley, I., & Rosè, C. P. (2009). Engaging collaborative learners with helping agents. In V. Dimitrova, R. Mizoguchi, B. du Bulay, & A. Graesser (Eds.), Proceedings of the 14th Intl. Conf. on Artificial Intelligence in Education (AIED 2009) (pp. 365–372). Amsterdam: Ios Press.

    Google Scholar 

  • Chi, M. T. H., DeLeeuw, N., Chiu, M.-H., & LaVancher, C. (1994). Eliciting self-explanations improves understanding. Cognitive Science, 18, 439–477.

    Google Scholar 

  • Collins, A. (1999). The changing infrastructure of education research. In E. C. Lagemann & L. S. Shulman (Eds.), Issues in education research: Problems and possibilities (pp. 289–298). San Francisco: Jossey-Bass Publishers.

    Google Scholar 

  • Constantino-Gonzalez, M., Suthers, D. D., & de los Santos, J. G. (2003). Coaching Web-based collaborative learning based on problem solution differences and participation. International Journal of Artificial Intelligence In Education, 13, 2–4 (Apr. 2003), 263–299.

    Google Scholar 

  • Corbett, A. T., & Anderson, J. R. (1995). Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and User-Adapted Interaction, 4, 253–278.

    Article  Google Scholar 

  • Davidoff, S., Lee, M.K., Dey, A.K., & Zimmerman, J. (2007). Rapidly exploring application design through speed dating. In J. Krumm, G. D. Abowd, A. Seneviratrne, & T. Strang (Eds.), UbiComp 2007: Ubiquitous Computing. Proceedings of the 9th International Conference, UbiComp 2007, Innsbruck, Austria, September 16–19, 2007 (pp. 429–446). Germany: Springer-Verlag.

  • Dillenbourg, P., & Jermann, P. (2007). Designing integrative scripts. In F. Fischer, H. Mandl, J. Haake & I. Kollar (Eds.), Scripting computer-supported communication of knowledge - cognitive, computational and educational perspectives (pp. 275–301). New York: Springer.

  • Fantuzzo, J. W., Riggio, R. E., Connelly, S., & Dimeff, L. A. (1989). Effects of reciprocal peer tutoring on academic achievement and psychological adjustment: A component analysis. Journal of Educational Psychology, 81(2), 173–177.

    Article  Google Scholar 

  • Fischer, F., Mandl, H., Haake, J., & Kollar, I. (2007). Scripting computer-supported collaborative learning—cognitive, computational, and educational perspectives. Computer-supported collaborative learning series. New York: Springer.

    Google Scholar 

  • Fuchs, L., Fuchs, D., Hamlett, C., Phillips, N., Karns, K., & Dutka, S. (1997). Enhancing students’ helping behavior during peer-mediated instruction with conceptual mathematical explanations. The Elementary School Journal, 97(3), 223–249.

    Article  Google Scholar 

  • Hmelo-Silver, C. E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235–266.

    Article  Google Scholar 

  • Israel, J., & Aiken, R. (2007). Supporting collaborative learning with an intelligent web-based system. International Journal of Artificial Intelligence in Education, 17, 340.

    Google Scholar 

  • Johnson, D. W., & Johnson, R. T. (1990). Cooperative learning and achievement. In S. Sharan (Ed.), Cooperative learning: Theory and Research (pp. 23–37). NY: Praeger.

    Google Scholar 

  • King, A., Staffieri, A., & Adelgais, A. (1998). Mutual peer tutoring: Effects of structuring tutorial interaction to scaffold peer learning. Journal of Educational Psychology, 90, 134–152.

    Article  Google Scholar 

  • Koedinger, K., Anderson, J., Hadley, W., & Mark, M. (1997). Intelligent tutoring goes to school in the big city. International Journal of Artificial Intelligence in Education, 8, 30–43.

    Google Scholar 

  • Koedinger, K. R., Aleven, V., Roll, I., & Baker, R. (2009). In vivo experiments on whether supporting metacognition in intelligent tutoring systems yields robust learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of Metacognition in Education (pp. 897–964). The Educational Psychology Series. New York: Routledge.

    Google Scholar 

  • Kollar, I., Fischer, F., & Hesse, F. W. (2006). Collaboration scripts—A conceptual analysis. Educational Psychology Review, 18(2), 159–185.

    Article  Google Scholar 

  • Kollar, I., Fischer, F., & Slotta, J. D. (2005). Internal and external collaboration scripts in web-based science learning at schools. In T. Koschmann, D. Suthers, & T.-W. Chan (Eds.), Proceedings of the International Conference on Computer Support for Collaborative Learning 2005 (pp. 331–340). Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Kumar, R., Rosé, C. P., Wang, Y. C., Joshi, M., & Robinson, A. (2007). Tutorial dialogue as adaptive collaborative learning support. In R. Luckin, K. R. Koedinger, & Greer J. (Eds.), Proceedings of Artificial Intelligence in Education (pp. 383–390). IOS Press.

  • Kumar, R., Ai, H., Beuth, J. L., & Rosé, C. P. (2010). Socially-capable conversational tutors can be effective in collaborative-learning situations. Pittsburgh: Intl. Conf. on Intelligent Tutoring Systems.

    Google Scholar 

  • Lazonder, A. W., Wilhelm, P., & Ootes, S. A. W. (2003). Using sentence openers to foster student interaction in computer-mediated learning environments. Computers and Education, 41, 291–308.

    Article  Google Scholar 

  • Leelawong, K., & Biswas, G. (2008). Designing learning by teaching agents: The Bettys Brain System.International Journal of Artificial Intelligence in Education, 18(3), 181208.

    Google Scholar 

  • Lou, Y., Abrami, P. C., & d’Apollonia, S. (2001). Small group and individual learning with technology: A meta-analysis. Review of Educational Research, 71(3), 449–521.

    Article  Google Scholar 

  • McNamara, D. S., O’Reilly, T., Rowe, M., Boonthum, C., & Levinstein, I. B. (2007). iSTART: A web-based tutor that teaches self-explanation and metacognitive reading strategies. In D. S. McNamara (Ed.), Reading Comprehension Strategies: Theories, Interventions, and Technologies (pp. 397–421). Mahwah: Erlbaum.

    Google Scholar 

  • Michaels, S., O’Connor, C., & Resnick, L. B. (2008). Deliberative discourse idealized and realized: Accountable talk in the classroom and in civic life. Studies in the Philosophy of Education, 27(4), 283–297.

    Article  Google Scholar 

  • Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218.

    Article  Google Scholar 

  • Palincsar, A. S., & Brown, A. L. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 2, 117–175.

    Google Scholar 

  • Ploetzner, R., Dillenbourg, P., Preier, M., & Traum, D. (1999). Learning by explaining to oneself and to others. In P. Dillenbourg (Ed.), Collaborative Learning: Cognitive and Computational Approaches (pp. 103 – 121). Elsevier Science Publishers.

  • Prichard, J. S., Stratford, R. J., & Bizo, L. A. (2006). Team-skills training enhances collaborative learning. Learning and Instruction, 16(3), 256–265.

    Article  Google Scholar 

  • Ritter, S., Blessing, S. B., & Hadley, W. S. (2002). SBIR Phase I Final Report 2002. Department of Education. Department of Education RFP ED: 84-305 S.

  • Robinson, D. R., Schofield, J. W., & Steers-Wentzell, K. L. (2005). Peer and cross-age tutoring in math: Outcomes and their design implications. Educational Psychology, 17, 327–361.

    Article  Google Scholar 

  • Roscoe, R. D., & Chi, M. (2007). Understanding tutor learning: Knowledge-building and knowledge-telling in peer tutors’ explanations and questions. Review of Educational Research., 77(4), 534–574.

    Article  Google Scholar 

  • Rosé, C. P., & Torrey, C. (2005). Interactivity versus expectation: Eliciting learning oriented behavior with tutorial dialogue systems. In Proceedings of Interact, Springer Press.

  • Rosé, C., Wang, Y.-C., Cui, Y., Arguello, J., Stegmann, K., Weinberger, A., et al. (2008). Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning. International journal of computer-supported collaborative learning, 3(3), 237–271. doi:10.1007/s11412-007-9034-0.

    Article  Google Scholar 

  • Rummel, N., & Weinberger, A. (2008). New challenges in CSCL: Towards adaptive script support. In G. Kanselaar, Jonker, V., Kirschner, P.A., & Prins, F. (Eds.), Proceedings of the Eighth International Conference of the Learning Sciences (ICLS 2008), Vol 3 (pp. 338–345). International Society of the Learning Sciences

  • Saab, N., Van Joolingen, W. R., & Van Hout-Wolters, B. (2007). Supporting communication in a collaborative discovery learning environment: The effect of instruction. Instructional Science, 35, 73–98.

    Article  Google Scholar 

  • Schoenfeld, A. H. (1992). Learning to think mathematically: Problem-solving, metacognition, and sense making in mathematics. In D. Grouws (Ed.), Handbook for research on mathematics teaching and learning (pp. 334–370). New York: Macmillan.

    Google Scholar 

  • Soller, A., Jermann, P., Mühlenbrock, M., & Martinez, A. (2005). From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. International Journal of Artificial Intelligence in Education, 15(4), 261–290.

    Google Scholar 

  • Stahl, G. (2000). A model of collaborative knowledge building. In B. Fishman & S. O'Connor-Divelbiss (Eds.), Fourth international conference of the learning sciences (pp. 70–77). Mahwah: Erlbaum.

    Google Scholar 

  • Stahl, G. (2009). Social practices of group cognition in virtual math teams. In S. Ludvigsen, Lund, A., & Säljö, R. (Eds.), Learning in social practices. ICT and new artifacts: Transformation of social and cultural practices. Pergamon.

  • Van den Bossche, P., Gijselaers, W., Segers, M., & Kirschner, P. (2006). Social and cognitive factors driving teamwork in collaborative learning environments. Small Group Research, 37, 490–521.

    Article  Google Scholar 

  • VanLehn, K., Siler, S., Murray, C., Yamauchi, T., & Baggett, W. (2003). Why do only some events cause learning during human tutoring? Cognition and Instruction, 21(3), 209–249.

    Article  Google Scholar 

  • Vassileva, J., McCalla, G., & Greer, J. (2003). Multi-agent multi-user modeling in I-Help. User modeling and user-adapted interaction: The Journal of Personalization Research, 13, 179–210. doi:10.1023/A:1024072706526.

    Article  Google Scholar 

  • Walker, E., Rummel, N., & Koedinger, K. R. (2009). Integrating collaboration and intelligent tutoring data in the evaluation of a reciprocal peer tutoring environment. Research and Practice in Technology Enhanced Learning, 4(3), 221–251.

    Article  Google Scholar 

  • Webb, N. M. (1989). Peer interaction and learning in small groups. International Journal of Educational Research, 13, 21–40.

    Article  Google Scholar 

  • Webb, N. M., & Mastergeorge, A. (2003). Promoting effective helping behavior in peer directed groups. International Journal of Educational Research, 39, 73–97.

    Article  Google Scholar 

  • Weinberger, A., Ertl, B., Fischer, F., & Mandl, H. (2005). Epistemic and social scripts in computer-supported collaborative learning. Instructional Science, 33(1), 1–30.

    Article  Google Scholar 

Download references

Acknowledgments

This project is supported by the Pittsburgh Science of Learning Center which is funded by the National Science Foundation award number SBE-0836012. Thanks to Thomas Harris, Tristan Nixon, and Steve Ritter for their support concerning the use of the Carnegie Learning Cognitive Tutor Algebra code, and to Gail Kusbit, Christy McGuire, and the classroom teachers for their motivated involvement in the project. Finally, thanks to Carolyn Rosé, Dejana Diziol, Ido Roll, Ruth Wylie and Amy Ogan for their comments at various stages.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Erin Walker.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Walker, E., Rummel, N. & Koedinger, K.R. Designing automated adaptive support to improve student helping behaviors in a peer tutoring activity. Computer Supported Learning 6, 279–306 (2011). https://doi.org/10.1007/s11412-011-9111-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11412-011-9111-2

Keywords

Navigation