ABSTRACT
The Programme for International Student Assessment (PISA) has been developed by the Organisation for Economic Co-operation and Development to provide participating nations with internationally comparative mean literacy scores in reading, mathematics, and science for students nearing the end of compulsory schooling. The number of nations from the Americas that are participating in PISA has been increasing over the past 4 administrations. This 2-part paper (a) outlines the reaction to PISA within the media of both North and South America and (b) presents an Americas-specific example of the ways in which the PISA dataset can be used for more exploratory analysis through the lens of policy and curriculum suggestions, rather than just league table comparisons. We used multilevel modeling of scientific literacy predicted on a number of school-level background variables. Results point to the importance of socioeconomic background of the student as well as the school in predicting scientific literacy across all nations in the study; however, other school-level significant predictors were more nation-specific. Interpretations of these models as well as next steps are discussed.
Similar content being viewed by others
References
Adams, R. J. (2003). Response to “Cautions on OECD’s recent educational survey (PISA)”. Oxford Review of Education, 29(3), 277–292.
Anderson, J. O., Lin, H.-S., Treagust, D. F., Ross, S. P., & Yore, L. D. (2007). Using large-scale assessment datasets for research in science and mathematics education: Programme for International Student Assessment (PISA). International Journal of Science and Mathematics Education, 5(4), 591–614.
Anderson, J. O., George, J., & Herbert, S. (2009). Factors impacting on student learning: A preliminary look at the national test of Trinidad and Tobago. Caribbean Curriculum, 16(2), 99–126.
Araujo, M. D. (2009). The influence of performance based incentives on the quality of the Chilean education system. Documento de Trabajo CPCE Nº 4, Centro de Politicas Comparada Educación. Santiago, Chile: Universidad Diego Portales.
Bentancur, N. (2007). Education reform and school performance. Some thoughts on the experiences of Argentina, Chile and Uruguay. Cuadernos DEL CLAEH, 93, 9–25.
Bybee, R., McCrae, B., & Laurie, R. (2009). PISA 2006: An assessment of scientific literacy. Journal of Research in Science Teaching, 46(8), 865–883.
Dolin, J. (2007). PISA—An example of the use and misuse of large-scale comparative tests. In S. T. Hopmann, G. Brinek, & M. Retzl (Eds.), PISA zufolge PISA—Halt Pisa, was es verspricht? [PISA according to PISA: Does PISA keep what it promises?] (pp. 93–126). Berlin, Germany: Lit Verlag.
Duru-Bellant, M., & Suchaut, B. (2005). Organization and context, efficiency and equity of educational systems: what PISA tells us. European Educational Research Journal, 4(3), 181–195.
Fukuyama, F. (2008). The Latin American experience. Journal of Democracy, 19(4), 69–79.
Gallart, M. A. (2008). Skills, productivity and employment growth: The case of Latin America. Montevideo, Chile: ILO/Cinterfor.
Godard, S. & Smith, E. (2004). An international comparison of equity in education systems. Comparative Education, 40(1), 15–31.
Government of Canada (2008). PISA Canada homepage. Retrieved August 11, 2009, from http://www.pisa.gc.ca/what_pisa.shtml.
Hanushek, E. A., & Woessman, L. (2009). Do better schools lead to more growth? Cognitive skills, economic outcomes, and causation (NBER Working Paper Series No. 14633). Cambridge, MA: National Bureau of Economic Research.
Hattie, J. A. C. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. New York: Routledge.
Hopkins, D., Ahtaridou, E., Matthews, P., & Posner, C. (2007). An analysis of the Mexican school system in light of PISA 2006. London: London Centre for Leadership in Learning, University of London.
Kerstenetzky, C. L. (2008). Development and redistribution: The case of the Bolsa Familia program in Brazil. Rio de Janeiro, Brazil: UFF/Economia, Universidade Federal Fluminense.
Koretz, D. (2009). How do American students measure up? Making sense of international comparisons. Future of Children, 19(1), 37–51.
Kyriakides, L. (2006a). Introduction international studies in educational effectiveness. Educational Research and Evaluation, 12(6), 489–497.
Kyriakides, L. (2006b). Using international comparative studies to develop the theoretical framework of educational effectiveness research: A secondary analysis of TIMSS 1999 data. Educational Research and Evaluation, 12(6), 513–534.
Luke, D. A. (2004). Multilevel modeling. Thousand Oaks, CA: Sage.
McGaw, B. (2008). The role of the OECD in international comparative studies of achievement. Assessment in Education: Principles, Policy & Practice, 15(3), 223–243.
Milne, A., & Plourde, L. A. (2006). Factors of a low-SES household: What aids academic achievement? Journal of Instructional Psychology, 33(3), 183–193.
No Child Left Behind Act of 2001. (2002). Pub. L. No. 107–110, 115 Stat. 1425.
O’Connell, A. A., & McCoach, D. B. (2008). Multilevel modeling of educational data. Charlotte, NC: Information Age Publishing.
OECD/INES/Network A (2005). Media coverage of PISA 2003 and TIMSS 2003. Review of Assessment Activities, 18, 1–20. Available from http://nces.ed.gov/surveys/international/ines/pdf/Newsletter_Issue18.pdf.
Organisation for Economic Co-operation and Development (2000). Measuring student knowledge and skill: The PISA 2000 assessment of reading, mathematical and scientific literacy. Paris: Author.
Organisation for Economic Co-operation and Development (2005). PISA 2003 technical report. Paris: Author.
Organisation for Economic Co-operation and Development (2006). Assessing scientific, reading and mathematical literacy. A framework for PISA 2006. Paris: Author.
Organisation for Economic Co-operation and Development (2007). Education at a glance. Paris: Author.
Puryear, J. (2007). Six Latin American nations’ test scores near bottom—again. Washington, DC: Inter-American Dialogue Latin American Advisor. Retrieved August 10, 2009, from http://www.thedialogue.org/page.cfm?pageID=32&pubID=1153.
Roberts, J. (2007, December 5). Chile tops Latin America in PISA education scores. The Santiago Times. Retrieved August 12, 2009, from http://www.santiagotimes.cl/index.php?option=com_content&view=article&id=12449:CHILE-TOPS-LATIN-AMERICA-IN-PISA-EDUCATION-SCORES&catid=32:features&Itemid=144.
Sammons, P. (2006). The contribution of international studies on educational effectiveness: Current and future directions. Educational Research and Evaluation, 12(6), 583–593.
Santos, M. E. (2007). Quality of education in Argentina: Determinants and distribution using PISA 2000 test scores. Well-Being and Social Policy, 3(1), 69–95.
Schneider, M. (2009, June). International benchmarking. Paper presented at the Fourth Annual Institute of Education Sciences Research Conference, Washington, DC. Abstract retrieved from http://ies.ed.gov/director/conferences/09ies_conference/slides.asp?ppt=schneider.
Stack, M. (2006). Testing, testing, read all about it: Canadian press coverage of the PISA results. Canadian Journal of Education, 29(1), 49–69.
Stack, M. (2007). Representing school success and failure: Media coverage of international test. Policy Futures in Education, 5(1), 100–111.
Turmo, A. (2004). Scientific literacy and socio-economic background among 15-year-olds—A Nordic perspective. Scandinavian Journal of Educational Research, 48(3), 287–305.
Turner, R. & Adams, R. J. (2007). The Programme for International Student Assessment: An overview. Journal of Applied Measurement, 8(3), 237–248.
Vegas, E., & Petrow, J. (2008). Raising student learning in Latin America: The challenge for the 21st century. Washington, DC: The World Bank.
Wolff, L. (2004). Educational assessment in Latin America: The state of the art. Applied Psychology: An International Review, 53(2), 192–214.
World Bank, The (2007). Toward high-quality education in Peru: Standards, accountability, and capacity building. Washington, DC: Author.
Zoido, P. (2008). Public spending on education in Latin America: Does it pay? Policy Insights (No. 80). Retrieved August 12, 2009, from http://www.oecd.org/dataoecd/19/1/41561645.pdf.
Author information
Authors and Affiliations
Corresponding author
Additional information
The Americas include the countries of North, Central, and South America, and the Caribbean.
Rights and permissions
About this article
Cite this article
Milford, T., Ross, S.P. & Anderson, J.O. AN OPPORTUNITY TO BETTER UNDERSTAND SCHOOLING: THE GROWING PRESENCE OF PISA IN THE AMERICAS*. Int J of Sci and Math Educ 8, 453–473 (2010). https://doi.org/10.1007/s10763-010-9201-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10763-010-9201-z