Skip to main content
SpringerLink
Log in

Assessing and Teaching 21st Century Skills: Collaborative Problem Solving as a Case Study

  • Chapter
  • First Online:
Innovative Assessment of Collaboration

Part of the book series: Methodology of Educational Measurement and Assessment ((MEMA))

Abstract

This chapter describes the assessment of collaborative problem solving using human-to-human interaction. Tasks were designed to require partners to contribute resources or skills that they uniquely controlled. Issues were task design, data capture, item and data definition, calibration, and the link to teaching intervention. The interpretation of the student performance is mapped to a criterion-referenced interpretation framework, and reports are designed to assist teachers to intervene at a Vygotsky zone of proximal development in order to promote development of the student ability in collaborative problem solving. The data analytics demonstrate how the equivalent of test items are developed and issues such a local independence are discussed.

An earlier version of this chapter was presented as a keynote lecture at the Institute of Curriculum & Instruction at East China Normal University, November 6–8, 2015, Shanghai, China.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Adams, R. J., Vista, A., Awwal, N., Scoular, C., & Griffin, P. (2014). Automatic coding procedures for collaborative problem solving. In P. Griffin & E. Care (Eds.), Assessment and teaching of 21st century skills: Methods and approach (pp. 115–132). Dordrecht, Netherlands: Springer.

    Google Scholar 

  • Adams, R. J., Wu, M., & Wilson, M. (2006). ACER conquest. ACER: Melbourne.

    Google Scholar 

  • Badia, X., Prieto, L., & Linacre, J. M. (2002). Differential item and test functioning (DIF & DTF). Rasch Measurement Transactions, 16(3), 889.

    Google Scholar 

  • Baghaei, P. (2007). Local dependency and Rasch measures. Rasch Measurement Transactions, 21(3), 1105–1106.

    Google Scholar 

  • Bentley, T., & Cazaly, C. (2015). The shared work of learning: Lifting educational achievement through collaboration. Mitchell Institute Research Report No. 03/2015. Melbourne, Australia: Mitchell Institute.

    Google Scholar 

  • Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., et al. (2012). Defining twenty-first century skills. In P. Griffin, B. McGaw, & E. Care (Eds.), Assessment and teaching of 21st century skills (pp. 17–66). Dordrecht, Netherlands: Springer.

    Google Scholar 

  • Care, E., Griffin, P., Scoular, C., Awwal, N., & Zoanetti, N. (2014). Collaborative problem solving tasks. In P. Griffin & E. Care (Eds.), Assessment and teaching of 21st century skills: Methods and approach (pp. 85–104). Dordrecht, Netherlands: Springer.

    Google Scholar 

  • Dillenbourg, P., & Traum, D. (2006). Sharing solutions: Persistence and grounding in multimodal collaborative problem solving. Journal of the Learning Sciences, 15(1), 121–151.

    Article  Google Scholar 

  • Doran, H., Bates, D., Bliese, P., & Dowling, M. (2007). Estimating the multilevel Rasch model with the lme4 package. Journal of Statistical Software, 20(2), 1–18.

    Article  Google Scholar 

  • Fischer, A., Greiff, S., & Funke, F. (2012). The process of solving complex problems. The Journal of Problem Solving, 4(1), 19–42.

    Article  Google Scholar 

  • Glaser, R. (1983). Education and thinking: The role of knowledge. Technical Report No. PDS-6. Pittsburg, PA: University of Pittsburgh.

    Google Scholar 

  • Griffin, P. (2014). Performance assessment of higher order thinking. Journal of Applied Measurement, 15(1), 53–68.

    Google Scholar 

  • Griffin, P., & Care, E. (2014). Assessment and teaching of 21st century skills: Methods and approach. Dordrecht, Netherlands: Springer.

    Google Scholar 

  • Griffin, P., Care, E., & McGaw, B. (2012). The changing role of education and schools. In P. Griffin, B. McGaw, & E. Care (Eds.), Assessment and teaching of 21st century skills (pp. 1–15). Dordrecht, Netherlands: Springer.

    Google Scholar 

  • Griffin, P., & Robertson, P. (2014). Writing assessment rubrics. In P. Griffin (Ed.), Assessment for teaching (pp. 125–155). Melbourne, Australia: Cambridge Press.

    Google Scholar 

  • Hesse, F., Care, E., Buder, J., Sassenberg, K., & Griffin, P. (2014). A framework for teachable collaborative problem solving skills. In P. Griffin & E. Care (Eds.), Assessment and teaching of 21st century skills: Methods and approach (pp. 37–56). Dordrecht, Netherlands: Springer.

    Google Scholar 

  • Kenworthy, L., & Kielstra, P. (2015). Driving the skills agenda: Preparing students for the future. Economist Intelligence Unit Report. Retrieved May 27, 2016, from http://www.economistinsights.com/analysis/driving-skills-agenda

  • Kong, S. C. (2011). An evaluation study of the use of a cognitive tool in a one-to-one classroom for promoting classroom-based dialogic interaction. Computers & Education, 57(3), 1851–1864.

    Article  Google Scholar 

  • Linacre, J. M., & Wright, B. D. (1989). Mantel-Haenszel DIF and PROX are equivalent! Rasch Measurement Transactions, 3(2), 51–53.

    Google Scholar 

  • O’Neil, H. F., Chuang, S., & Chung, G. K. W. K. (2003). Issues in the computer-based assessment of collaborative problem solving. Assessment in Education: Principles, Policy & Practice, 10, 361–373.

    Article  Google Scholar 

  • Organisation for Economic Co-operation and Development. (2013). PISA 2015: Draft collaborative problem solving framework. Paris, France: OECD. Retrieved May 27, 2016, from https://www.oecd.org/pisa/pisaproducts/Draft%20PISA%202015%20Collaborative%20Problem%20Solving%20Framework%20.pdf

  • Polya, G. (1973). How to solve it: A new aspect of mathematical method. Princeton, NJ: Princeton University Press.

    Google Scholar 

  • Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests. Chicago, IL: University of Chicago Press. Reprinted with Foreword and Afterword from Information and control by B. D. Wright, 1960. Copenhagen, Denmark: Danmarks Paedogogiske Institut.

    Google Scholar 

  • Rummel, N., & Spada, H. (2005). Learning to collaborate: An instructional approach to promoting collaborative problem solving in computer-mediated settings. The Journal of the Learning Sciences, 14(2), 201–241.

    Article  Google Scholar 

  • Verhelst, N. D., & Verstralen, H. H. F. M. (1997). Modeling sums of binary responses by the partial credit model. Cito Measurement and Research Department Report No. 97-7. Arneim, Netherlands: Cito.

    Google Scholar 

  • Vygotsky, L. (1978). Mind and society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Wilson, M. (2009). Measuring progressions: Assessment structures underlying a learning progression. Journal of Research in Science Teaching, 46(6), 716–730.

    Article  Google Scholar 

  • Woods, K., Mountain, R., & Griffin, P. (2014). Linking developmental progressions to teaching. In P. Griffin & E. Care (Eds.), Assessment and teaching of 21st century skills: Methods and approach (pp. 267–292). Dordrecht, Netherlands: Springer.

    Google Scholar 

  • Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago, IL: MESA.

    Google Scholar 

  • Wu, M., & Adams, R. (2005). Applying the Rasch model to psychosocial measurement: A practical approach. Melbourne, Australia: Educational Measurement Solutions.

    Google Scholar 

  • Zoanetti, N., & Griffin, P. (2014). Log-file data as indicators for problem-solving processes. In J. Funke & B. Csapo (Eds.), The nature of problem solving. Paris, France: OECD.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Melbourne Graduate School of Education, Parkville, Australia

    Patrick Griffin

Authors
  1. Patrick Griffin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Patrick Griffin .

Editor information

Editors and Affiliations

  1. ACT , Iowa City, Iowa, USA

    Alina A. von Davier

  2. Research and Development Division, Educational Testing Service, Princeton, New Jersey, USA

    Mengxiao Zhu

  3. Research and Development Division, Educational Testing Service, Princeton, New Jersey, USA

    Patrick C. Kyllonen

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Griffin, P. (2017). Assessing and Teaching 21st Century Skills: Collaborative Problem Solving as a Case Study. In: von Davier, A., Zhu, M., Kyllonen, P. (eds) Innovative Assessment of Collaboration. Methodology of Educational Measurement and Assessment. Springer, Cham. https://doi.org/10.1007/978-3-319-33261-1_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-33261-1_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-33259-8

  • Online ISBN: 978-3-319-33261-1

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation