Publication Type

Teacher and Teaching Effects on Students’ Attitudes and Behaviors

2017

Research has focused predominantly on how teachers affect students’ achievement on standardized tests despite evidence that a broad range of attitudes and behaviors are equally important to their long-term success. We find that upper-elementary teachers have large effects on self-reported measures of students’ self-efficacy in math, and happiness and behavior in class. Students’ attitudes and behaviors are predicted by teaching practices most proximal to these measures, including teachers’ emotional support and classroom organization. However, teachers who are effective at improving test scores often are not equally effective at improving students’ attitudes and behaviors. These findings lend empirical evidence to well-established theory on the multidimensional nature of teaching and the need to identify strategies for improving the full range of teachers’ skills.

Suggested Citation:

Suggested citation

Blazar, D., & Kraft, M. (2017). Teacher and Teaching Effects on Students’ Attitudes and Behaviors. Educational Evaluation and Policy Analysis. https://doi.org/10.3102/0162373716670260

Share

Publication Type

Teacher applicant hiring and teacher performance: Evidence from DC public schools

2018

Selecting more productive employees among a pool of job applicants can be a cost-effective means of improving organizational performance and may be particularly important in the public sector. We study the relationship among applicant characteristics, hiring outcomes, and job performance for teachers in the Washington DC Public Schools. Applicants' academic background (e.g., undergraduate GPA) is essentially uncorrelated with hiring. Screening measures (written assessments, interviews, and sample lessons) help applicants get jobs by placing them on a list of recommended candidates, but they are only weakly associated with the likelihood of being hired conditional on making the list. Yet both academic background and screening measures strongly predict teacher job performance, suggesting considerable scope for improving schools via the selection process.

Suggested Citation:

Suggested citation

1.Jacob, B. A., Rockoff, J. E., Taylor, E. S., Lindy, B., & Rosen, R. (2018). Teacher applicant hiring and teacher performance: Evidence from DC public schools. Journal of Public Economics. https://doi.org/10.1016/j.jpubeco.2018.08.011

Share

Publication Type

Individualized Coaching to Improve Teacher Practice Across Grades and Subjects: New Experimental Evidence

2017

This article analyzes a coaching model focused on classroom management skills and instructional practices across grade levels and subject areas. We describe the design and implementation of MATCH Teacher Coaching among an initial cohort of 59 teachers working in New Orleans charter schools. We evaluate the effect of the program on teachers’ instructional practices using a block randomized trial and find that coached teachers scored 0.59 standard deviations higher on an index of effective teaching practices comprised of observation scores, principal evaluations, and student surveys. We discuss implementation challenges and make recommendations for researcher–practitioner partnerships to address key remaining questions.

Suggested Citation:

Suggested citation

Kraft, M., & Blazar, D. (2017). Individualized Coaching to Improve Teacher Practice Across Grades and Subjects: New Experimental Evidence. Educational Policy. https://doi.org/10.1177/0895904816631099

Share

Publication Type

Revisiting The Widget Effect: Teacher Evaluation Reforms and the Distribution of Teacher Effectiveness

2017

In 2009, the New Teacher Project’s The Widget Effect documented the failure of U.S. public school districts to recognize and act on differences in teacher effectiveness. We revisit these findings by compiling teacher performance ratings across 24 states that adopted major reforms to their teacher evaluation systems. In the vast majority of these states, the percentage of teachers rated unsatisfactory remains less than 1%. However, the full distributions of ratings vary widely across states, with 0.7% to 28.7% rated below proficient and 6% to 62% rated above proficient. We present original survey data from an urban district illustrating that evaluators perceive more than 3 times as many teachers in their schools to be below proficient than they rate as such. Interviews with principals reveal several potential explanations for these patterns.

Suggested Citation:

Suggested citation

Kraft, M., & Gilmour, A. (2017). Revisiting The Widget Effect: Teacher Evaluation Reforms and the Distribution of Teacher Effectiveness. Educational Researcher. https://doi.org/10.3102/0013189X17718797

Share

Publication Type

Learning lessons from instruction: Descriptive results from an observational study of urban elementary mathematics classrooms

2020

Background:
For nearly three decades, policy-makers and researchers in the United States have promoted more intellectually rigorous standards for mathematics teaching and learning. Yet, to date, we have limited descriptive evidence on the extent to which reform-oriented instruction has been enacted at scale.

Purpose:
The purpose of the study is to examine the prevalence of reform-aligned mathematics instructional practices in five U.S. school districts. We also seek to describe the range of instruction students experience by presenting case studies of teachers at high, medium and low levels of reform alignment.

Participants:
We draw on 1,735 video-recorded lessons from 329 elementary teachers in these five U.S. urban districts.

Research Design:
We present descriptive analyses of lesson scores on a mathematics-focused classroom observation instrument. We also draw upon interviews with district personnel, rater-written lesson summaries, and lesson video in order to develop case studies of instructional practice.

Findings:
We find that teachers in our sample do use reform-aligned instructional practices, but that they do so within the confines of traditional lesson formats. We also find that the implementation of these instructional practices varies in quality. Furthermore, the prevalence and strength of these practices corresponds to the coherence of district efforts at instructional reform.

Conclusions:
Our findings suggest that unlike other studies in which reform-oriented instruction rarely occurred (e.g. Kane & Staiger, 2012), reform practices do appear to some degree in study classrooms. In addition, our analyses suggest that implementation of these reform practices corresponds to the strength and coherence of district efforts to change instruction.

Suggested Citation:

Suggested citation

Hill, H.C., Erica Litke, & Lynch, K. (2020). Learning lessons from instruction: Descriptive results from an observational study of urban elementary mathematics classrooms. EdWorkingPapers.com. https://doi.org/10.26300/t6tj-wx30

Share

Publication Type

Mathematical content knowledge and knowledge for teaching: exploring their distinguishability and contribution to student learning

2019

During the last three decades, scholars have proposed several conceptual structures to represent teacher knowledge. A common denominator in this work is the assumption that disciplinary knowledge and the knowledge needed for teaching are distinct. However, empirical findings on the distinguishability of these two knowledge components, and their relationship with student outcomes, are mixed. In this replication and extension study, we explore these issues, drawing on evidence from a multi-year study of over 200 fourth- and fifth-grade US teachers. Exploratory and confirmatory factor analyses of these data suggested a single dimension for teacher knowledge. Value-added models predicting student test outcomes on both state tests and a test with cognitively challenging tasks revealed that teacher knowledge positively predicts student achievement gains. We consider the implications of these findings for teacher selection and education.

Suggested Citation:

Suggested citation

Charalambous, C. Y., Hill, C. H., Chin, M.J., & McGinn, D. (2019). Mathematical content knowledge and knowledge for teaching: exploring their distinguishability and contribution to student learning. Journal of Mathematics Teacher Education.

Share

Publication Type

Professional Development Research: Consensus, Crossroads, and Challenges

2013

Commentaries regarding appropriate methods for researching professional development have been a frequent topic in recent issues of Educational Researcher as well as other venues. In this article, the authors extend this discussion by observing that randomized trials of specific professional development programs have not enhanced our knowledge of effective program characteristics, leaving practitioners without guidance with regard to best practices. In response, the authors propose that scholars should execute more rigorous comparisons of professional development designs at the initial stages of program development and use information derived from these studies to build a professional knowledge base. The authors illustrate with examples of both a proposed study and reviews of evidence on key questions in the literature.

Suggested Citation:

Suggested citation

Hill, H. C., Beisiegel, M., & Jacob, R. (2013). Professional Development Research: Consensus, Crossroads, and Challenges. Educational Researcher. https://doi.org/10.3102/0013189X13512674

Share

Publication Type

The Impact of a Professional Development Program on Teachers' Mathematical Knowledge for Teaching, Instruction, and Student Achievement

2017

In this paper, we describe findings from a three-year evaluation of a well-developed mathematics professional development program that is commercially available on a wide scale. The professional development is designed to improve teachers' mathematical knowledge for teaching and to enable them to elicit more student thinking and reasoning during mathematics lessons. Specifically, it focused on helping teachers (a) learn more mathematics, (b) understand how children learn math, (c) use formative assessment to develop insight into what specific students know and do not know, and (d) develop effective classroom instructional strategies that enable student problem solving. Participants included 105 fourth- and fifth-grade teachers teaching in 19 low-income schools within a single district. Teachers were randomly assigned within schools either to a “business as usual” control group or to receive the professional development. The training consisted of a week-long summer institute and four to six in-service days during the school year. The training was run by full-time trained associates. We find some limited evidence of positive impacts on teachers' mathematical knowledge for teaching, but no effects on instructional practice or student outcomes.

Suggested Citation:

Suggested citation

Jacob, R.T., Hill, H.C. & Corey, D. (2017). The Impact of a Professional Development Program on Teachers' Mathematical Knowledge for Teaching, Instruction, and Student Achievement. Journal of Research on Educational Effectiveness. https://doi.org/10.1080/19345747.2016.1273411

Share

Publication Type

Learning from Teacher Observations: Challenges and Opportunities Posed by New Teacher Evaluation Systems

2013

In this article, Heather C. Hill and Pam Grossman discuss the current focus on using teacher observation instruments as part of new teacher evaluation systems being considered and implemented by states and districts. They argue that if these teacher observation instruments are to achieve the goal of supporting teachers in improving instructional practice, they must be subject-specific, involve content experts in the process of observation, and provide information that is both accurate and useful for teachers. They discuss the instruments themselves, raters and system design, and timing of and feedback from the observations. They conclude by outlining the challenges that policy makers face in designing observation systems that will work to improve instructional practice at scale.

Suggested Citation:

Suggested citation

Hill, H.C., & Grossman, P. (2013). Learning from Teacher Observations: Challenges and Opportunities Posed by New Teacher Evaluation Systems. Harvard Educational Review. https://doi.org/10.17763/haer.83.2.d11511403715u376

Share

Publication Type

Exploring Mechanisms of Effective Teacher Coaching: A Tale of Two Cohorts From a Randomized Experiment

2015

Although previous research has shown that teacher coaching can improve teaching practices and student achievement, little is known about specific features of effective coaching programs. We estimate the impact of MATCH Teacher Coaching (MTC) on a range of teacher practices using a blocked randomized trial and explore how changes in the coaching model across two cohorts are related to program effects. Findings indicate large positive effects in Cohort 1 but no effects in Cohort 2. After ruling out explanations related to the research design, a set of exploratory analyses suggest that differential treatment effects may be attributable to differences in coach effectiveness, coaching dosage, and the focus of coaching across cohorts.

Suggested Citation:

Suggested citation

Blazar, D., & Kraft, M. (2015). Exploring Mechanisms of Effective Teacher Coaching: A Tale of Two Cohorts From a Randomized Experiment. Educational Evaluation and Policy Analysis. https://doi.org/10.3102/0162373715579487

Share