This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Hamilton, L. S. Articles by Bugliari, D. Search for Related Content Social Bookmarking                         What's this?

Studying Large-Scale Reforms of Instructional Practice: An Example from Mathematics and Science

RAND

A number of challenges are encountered when evaluating a large-scale, multisite educational reform aimed at changing classroom practice. The challenges include substantial variability in implementation with little information on actual practice, lack of common, appropriate outcome measures, and the need to synthesize evaluation results across multiple study sites. This article describes an approach to addressing these challenges in the context of a study of the relationships between student achievement and instructional practices in the National Science Foundation’s Systemic Initiatives (SI) program. We gathered data from eleven SI sites and investigated relationships at the site level and pooled across sites using a planned meta-analytic approach. We found small but consistent positive relationships between teachers’ reported use of standards-based instruction and student achievement. The article also describes the ways in which we addressed the challenges discussed, as well as a number of additional obstacles that need to be addressed to improve future evaluations of large-scale reforms.

Key Words: program evaluation • student achievement • systemic reform

Educational Evaluation and Policy Analysis, Vol. 25, No. 1, 1-29 (2003)
DOI: 10.3102/01623737025001001


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				V.-N. Le, J. R. Lockwood, B. M. Stecher, L. S. Hamilton, and J. F. Martinez A Longitudinal Investigation of the Relationship between Teachers' Self-Reports of Reform-Oriented Instruction and Mathematics and Science Achievement Educational Evaluation and Policy Analysis, September 1, 2009; 31(3): 200 - 220. [Abstract] [Full Text] [PDF]

				S. W. Raudenbush The Brown Legacy and the O'Connor Challenge:Transforming Schools in the Images of Children's Potential Educational Researcher, April 1, 2009; 38(3): 169 - 180. [Abstract] [Full Text] [PDF]

				L. M. Desimone Improving Impact Studies of Teachers' Professional Development: Toward Better Conceptualizations and Measures Educational Researcher, April 1, 2009; 38(3): 181 - 199. [Abstract] [Full Text] [PDF]

				C. Ashcraft So Much More Than "Sex Ed": Teen Sexuality as Vehicle for Improving Academic Success and Democratic Education for Diverse Youth American Educational Research Journal, September 1, 2008; 45(3): 631 - 667. [Abstract] [Full Text] [PDF]

				B. Smith Deregulation and the New Leader Agenda: Outcomes and Lessons from Michigan Educational Administration Quarterly, February 1, 2008; 44(1): 30 - 65. [Abstract] [PDF]

				W. R. Penuel, B. J. Fishman, R. Yamaguchi, and L. P. Gallagher What Makes Professional Development Effective? Strategies That Foster Curriculum Implementation American Educational Research Journal, December 1, 2007; 44(4): 921 - 958. [Abstract] [Full Text] [PDF]

				B. Stecher, V.-N. Le, L. Hamilton, G. Ryan, A. Robyn, and J. R. Lockwood Using Structured Classroom Vignettes to Measure Instructional Practices in Mathematics Educational Evaluation and Policy Analysis, January 1, 2006; 28(2): 101 - 130. [Abstract] [PDF]