1. To what extent do students receive different grades based on: a) Their teacher for a particular class? b) The school the student attends? c) The student’s background characteristics? d) Specific conditions of the class?
2. How much of the variation in grades by teacher, school, student background, and class conditions can be attributed to students’ academic skills and efforts, as measured by test scores and attendance?
3. What are the factors that account for systematic differences in grades across classes, teachers, and schools?
High school course grades are a primary source of information about students’ academic readiness, yet they are often viewed as inconsistent measures of student achievement—influenced by idiosyncratic practices across schools and teachers, systematic differences in course content and structure, compositional effects of peers, and student demographics. Prior research has not quantified the extent of this variation relative to the influence of students’ academic skills and effort, or examined multiple sources of influence simultaneously.
This study employed cross-classified random-effects models with a dataset of 2.1 million grade records from 125,223 students and 11,000 teachers at 118 schools to identify sources of variation in students’ grades. Grades varied based on which teacher students had for a given class and the conditions of the class (course subject, classroom peer achievement, time of day, class size, and term). There were systematic differences in course grades by race and gender, even among students taking the same classes under the same conditions with the same test scores and attendance in the course. However, students’ effort and skills, measured through attendance and test scores, dwarfed other sources of variation. Within- and between-student variation in attendance across classes also explained a substantial portion of variation by teacher, school, and course conditions. Rather than finding large unexplained differences in grades based on which school a student attended, or which teacher they had, we found observable factors systematically explained differences in the grades that students received, particularly in students’ aggregate grade point averages.
A working paper is a work in progress intended to contribute to current conversations in research, policy, and practice in a timely manner. The findings, interpretations, and conclusions expressed herein are preliminary thoughts solely of the author(s) and shared with permission of the author(s). These preliminary findings, interpretations, and conclusions may change upon further interrogation and collaboration with UChicago Consortium colleagues and other stakeholders in our work.
