Skip to main content
SpringerLink
Log in

Instructors’ perspectives on the utility of student ratings of instruction

  • Published:
Instructional Science Aims and scope Submit manuscript

Abstract

This study investigates instructors’ attitudes about student ratings of instruction. The sample consisted of 357 instructors at a major Canadian university, where student evaluation is carried out in all courses at the end of each term. Instructors tend to agree that the student rating practice is an acceptable means of assessing institutional integrity, and is useful to administrators in making summative decisions. However, they consider the student evaluations only marginally valuable in their impact on enhancing instruction. Implications for the development of student ratings are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abrami, P. C., d’Apollonia, S., & Cohen, P. (1990). Validity of student ratings of instruction: What we know and what we do not. Journal of Educational Psychology, 82(2), 219–231.

    Article  Google Scholar 

  • Armstrong, J. S. (1998). Are student ratings of instruction useful? American Psychologist, 53(11), 1223–1224.

    Article  Google Scholar 

  • Arreola, R. A. (1995). Developing a comprehensive faculty evaluation system. Bolton, MA: Anker Publishing.

    Google Scholar 

  • Beran, T., Violato, C., & Collin, T. (2002). The Universal Student Ratings of Instruction Instrument at the University of Calgary: A review of a three-year pilot project. Submitted to the office of the Provost and Vice-President (Academic) at the University of Calgary.

  • Beran, T., Violato, C., Kline, D., & Frideres, J. (2005). The utility of student ratings of instruction for students, faculty, and administrators: A “consequential validity” study. The Canadian Journal of Higher Education, 35(2), 49–70.

    Google Scholar 

  • Centra, J. A. (1993). Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness. San Fransisco, CA: Jossey-Bass.

    Google Scholar 

  • Cohen, P. A. (1981). Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. Research in Higher Education, 51(3), 281–309.

    Google Scholar 

  • Cohen, J. (1987). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

    Google Scholar 

  • d’ Apollonia, S., & Abrami, P. C. (1997). Navigating student ratings of instruction. American Psychologist, 52, 1198–1208.

    Article  Google Scholar 

  • Eiszler, C. F. (2002). College students’ evaluations of teaching and grade inflation. Research in Higher Education, 43(4), 483–501.

    Article  Google Scholar 

  • Feldman, K. A. (1988). Effective college teaching from the students’ and faculty’s view: Matched or mismatched priorities? Research in Higher Education, 28(4), 291–344.

    Article  Google Scholar 

  • Feldman, K. A. (1989). The association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies. Research in Higher Education, 30, 583–645.

    Article  Google Scholar 

  • Feldman, K. A. (1993). College students’ views of male and female college teachers: Part II – evidence from students’ evaluations of their classroom teachers. Research in Higher Education, 34(2), 151–211.

    Article  Google Scholar 

  • Franklin, J., & Theall, M. (1989). Who reads ratings: Knowledge, attitudes, and practices of users of student ratings of instruction. In Paper presented at the 70th Annual Meeting of the American Educational Research Association, San Francisco.

  • Franklin, J. L., & Theall, M. (1990). Communicating student ratings to decision makers: Design for good practice. In M. Theall & J. Franklin (Eds.), Student ratings of instruction: Issues for improving practice. New Directions for Teaching and Learning (No. 43). San Francisco: Jossey Bass.

  • Gray, M., & Bergmann, B. R. (2003) Student teaching evaluations. Academe, 89(5), 44–46.

    Google Scholar 

  • Greenwald, A. G. (2002). Constructs in student ratings of instructors. In: H. I. Braun, D. N. Jackson, & D. E. Wiley (Eds.), The role of constructs in psychological and educational measurement. New York: Erlbaum.

    Google Scholar 

  • Hellman, C. M. (1998). Faculty evaluation by students: A comparison between full-time and adjunct faculty. Journal of Applied Research in the Community College, 6(1), 45–50.

    Google Scholar 

  • Marsh, H. W. (1987). Students’ evaluations of university teaching: Research findings, methodological issues, and directions for future research. International Journal of Educational Research, 11, 253–388.

    Article  Google Scholar 

  • Marsh, H. W. (1984). Student evaluation of university teaching: Dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology, 76, 707–754.

    Article  Google Scholar 

  • Marsh, H. W., & Hocevar, D. (1984). The factorial invariance of student evaluations of college teaching. American Educational Research Journal, 21(2), 341–366.

    Google Scholar 

  • Marsh, H. W., & Roche, L. A. (1997). Making students’ evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist, 52(11), 1187–1197.

    Article  Google Scholar 

  • Messick, S. (1995). Validity of psychological assessment: Validation of inferences from person’s responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.

    Article  Google Scholar 

  • Murray, H. G. (1983). Low inference classroom teaching behaviours and student ratings of college teaching effectiveness. Journal of Educational Psychology, 71, 856–865.

    Google Scholar 

  • Murray, H. G., Rushton, J. P., & Paunonen, S. V. (1990). Teacher personality traits and student instructional ratings in six types of university courses. Journal of Educational Psychology, 82(2), 250–261.

    Article  Google Scholar 

  • Nasser, F., & Fresko, B. (2002). Faculty views of student evaluation of college teaching. Assessment & Evaluation in Higher Education, 27(2), 187–198.

    Article  Google Scholar 

  • Ory, J. C., & Ryan, K. (2001). How do student ratings measure up to a new validity framework? In M. Theall, P. C. Abrami, & L. A. Mets (Eds.), New directions for institutional research (Vol. 109, pp. 27–44). San Francisco, CA: Jossey-Bass.

  • Overall, J. U., & Marsh, H. W. (1980). Students’ evaluations of instruction: A longitudinal study of their stability. Journal of Educational Psychology, 72, 321–325.

    Article  Google Scholar 

  • Schmelkin, L. P., Spencer, K. J., & Gellman, E. S. (1997). Faculty perspectives on course and teacher evaluations. Research in Higher Education, 38(5), 575–592.

    Article  Google Scholar 

  • Sherman, T. M., Armistead, L. P., Fowler, F., Barksdale, M. A., & Reif, G. (1987). The quest for excellence in university teaching. Journal of Higher Education, 48(1), 66–84.

    Article  Google Scholar 

  • Sproule, R. (2000). Student evaluation of teaching: A methodological critique of conventional practices. Education Policy Analysis Archives, 8(50). Retrieved on January 21, 2005, from http://www.epaa.asu.edu/epaa/v8n50.html

  • Theall, M., & Franklin, J. (2001). Looking for bias in all the wrong places: A search for truth or a Witch hunt in student ratings of instruction. In M. Theall, P. C. Abrami, & L. A. Mets (Eds.), New directions for institutional research (Vol. 109, pp. 45–56). San Francisco, CA: Jossey-Bass.

  • Theall, M., Abrami, P. C., & Mets, L. A. (Eds.). (2001). The student ratings debate: Are they valid? How can we best use them? New Directions for Institutional Research (Vol. 109, pp. 1–6). San Francisco, CA: Jossey-Bass.

  • Trout, P. (2000). Flunking the test: The dismal record of student evaluations. Academe, 86(4), 58–61.

    Google Scholar 

  • Wachtel, H. K. (1998). Student evaluation of college teaching effectiveness: A brief review. Assessment and Evaluation in Higher Education, 23(2), 191–212.

    Article  Google Scholar 

  • Zabaleta, F. (2007). The use and misuse of student evaluations of teaching. Teaching in Higher Education, 12(1), 55–76.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Division of Applied Psychology, University of Calgary, Calgary, AB, Canada, T2N 1N4

    Tanya N. Beran & Jennifer L. Rokosh

Authors
  1. Tanya N. Beran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jennifer L. Rokosh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tanya N. Beran.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Beran, T.N., Rokosh, J.L. Instructors’ perspectives on the utility of student ratings of instruction. Instr Sci 37, 171–184 (2009). https://doi.org/10.1007/s11251-007-9045-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11251-007-9045-2

Keywords

Search

Navigation