Professional Development at Scale: The Causal Effect of Obtaining an SEI Endorsement Under Massachusetts’s RETELL Initiative
Authors: Jesse Bruhn, Nathan Jones, Yasuko Kanno, & Marcus A. Winters
This project was funded by a generous grant from the William T. Grant Foundation.
Project Summary
English learners (ELs) are among the most rapidly-growing and lowest-performing student groups in American public schools. Lack of access to teachers who have been trained to serve their specific needs is one potential explanation for ELs’ unequal educational outcomes relative to non-EL students. Jesse Bruhn, Nathan Jones, Yasuko Kanno, and Marcus Winters use longitudinal data from Massachusetts to measure the causal effect of a rigorous and time-intensive professional development (PD) delivered at a nearly unprecedented scale: teachers earning an endorsement in Structured English Immersion (SEI) under the Massachusett’s Rethinking Equity in the Teaching of English Language Learners (RETELL) initiative. RETELL required that all core academic pre-service and in-service teachers who were instructing ELs obtain an endorsement in SEI, which is a common instructional strategy for teaching ELs in English-only classroom settings. Over a 5-year period, more than 35,000 in-service public school teachers throughout Massachusetts obtained the endorsement, which for most required completing a training equivalent in scope to a college-level semester-long course.
Key Findings
A teacher obtaining an SEI endorsement under RETELL had no significant effect on the average math or English language arts Massachusetts Comprehensive Assessment System (MCAS) scores of the ELs they instruct. The analysis did not detect a significant difference in the effect of a teacher completing the full, long-bridge, or short-bridge training on their student’s test scores.
However, the training did lead to: 1) increased effectiveness of teachers hired by the district within the previous 3 years (a proxy for teacher experience) in both English Language Arts (ELA) and math; 2) improvements on the ELA test for ELs with very low proficiency in English; 3) modest but statistically significant positive spillover effects on the average performance of students with disabilities and the larger group of non-EL students that the teacher instructs on the ELA test.
Implications and Recommendations
The findings have mixed implications for the use of large-scale PD generally and specifically for training teachers to instruct ELs in English-only classroom settings. Training in SEI instructional strategies did not lead to immediate improvements in a teacher’s impact on the ELs’ MCAS test scores, on average. However, the finding of a potential for positive impacts for recently hired teachers suggests that the SEI endorsement requirement could yield benefits in the longer term as new teachers continue to enter the state’s schools having completed the training during pre-service education. Further, the existence of spillovers for other students and the range of effects for teachers completing the training on the outcomes of both ELs and non-ELs suggests that the training did elicit improvements in teacher effectiveness, which is promising for the potential use of widespread PD.
Project Resources
- Published in Education Evaluation and Policy Analysis (Dec 2022)
- Working Paper