Value-Added Assessment in Practice Lessons from the Pennsylvania Value-Added Assessment System Pilot Project

by McCaffrey, Daniel F.; Hamilton, Laura S.

• ISBN13: 9780833042361
• ISBN10: 083304236X
• Edition: 1st
• Format: Paperback
• Copyright: 2007-12-02
• Publisher: Rand Corp

Summary

Value-added assessment (VAA) systems use statistical techniques to analyze test-score data; VAA data is intended to help educators make more informed decisions about curriculum and instruction. The authors examined the rollout of Pennsylvania's VAA program, and found that, in its pilot phase, the program had little effect on student achievement and received limited use by most principals and teachers at schools participating in the program.

Table of Contents

Preface
Figures
Tables
Summary
Acknowledgments
Abbreviations
Introduction	p. 1
Examining VAA Implementation and Effects	p. 2
Background on Pennsylvania's VAA System	p. 4
History of PVAAS	p. 5
PVAAS Reports	p. 7
PVAAS Statistical Methodology for the Pilot Program	p. 12
Organization of This Report	p. 13
Methods and Data	p. 15
Details on Matching	p. 15
Overview of Matching Approach	p. 15
Matching Variables	p. 15
Matching Methods for Cohort 1	p. 17
Matching Methods for Cohort 2	p. 19
Matching Results for Cohort 1	p. 19
Matching Results for Cohort 2	p. 21
The Pennsylvania System of School Assessment (PSSA)	p. 24
Methods for Estimating the Effects of PVAAS on PSSA Scores	p. 25
Surveys	p. 26
Survey Methods for Educators	p. 26
Effects of PVAAS on Student Achievement	p. 31
Summary	p. 35
Superintendents' Responses to PVAAS	p. 37
Actions and Opinions in PVAAS and Comparison Districts	p. 37
Use of Achievement Data	p. 37
Support for Test-Based Accountability	p. 40
Facilitators and Barriers	p. 41
Responses to PVAAS Among Participating Districts	p. 46
Responses to the PVAAS Program	p. 46
Summary	p. 52
Principals' Responses to PVAAS	p. 53
Actions and Opinions in PVAAS and Comparison Districts	p. 55
Use of Achievement Data	p. 55
Support for Test-Based Accountability	p. 57
Facilitators and Barriers	p. 58
Understanding and Interpretation of Growth Data	p. 63
Responses to PVAAS Among Principals from Participating Districts	p. 63
Summary	p. 70
Teachers' Responses to PVAAS	p. 71
Actions and Opinions of Teachers in PVMS and Comparison Districts	p. 73
Use of Achievement Data	p. 73
Facilitators and Barriers	p. 76
Responses to PVAAS Among Engaged Teachers	p. 79
Summary	p. 83
Summary and Implications	p. 85
Implications for Understanding Educators' Use of VAA Data	p. 86
Study Limitations	p. 88
Conclusion	p. 90
Matching Results Summary Tables and Figures	p. 91
References	p. 103
Table of Contents provided by Blackwell. All Rights Reserved.