This text introduces students to the process of program evaluation and the experimental and quasi-experimental approaches to evaluation. The book covers approaches to outcome evaluations, measurement, threats to internal validity, performance measurement, and benchmarking. It also introduces the basic experimental and quasi-experimental designs, presents a published article which uses each design, and offers an explanation and critique of how the authors implemented the design. Stand-alone articles invite students to explain and critique on their own.

Acknowledgments

vii

Preface

ix

PART I Introduction

1

(54)

The Process of Evaluation

3

(12)

Evaluation Designs

15

(16)

Measurement

31

(14)

Performance Measurement and Benchmarking

45

(10)

PART II Experimental Designs

55

(52)

Pretest-Posttest Control Group Design

57

(22)

Improving Cognitive Ability in Chronically Deprived Children

60

(17)

Harrison McKay

Leonardo Sinisterra

Arline McKay

Hernando Gomez

Pascuala Lloreda

Explanation and Critique

77

(2)

Solomon Four-Group Design

79

(16)

Evaluation of Multimethod Undergraduate Management Skills Development Program

80

(12)

Marian M. Extejt

Benjamin Forbes

Jonathan E. Smith

Explanation and Critique

92

(3)

Posttest/Only Control Group Design

95

(12)

Community Posthospital Follow-up Services

96

(8)

Ann Solberg

Explanation and Critique

104

(3)

PART III Quasi-Experimental Designs

107

(44)

Pretest-Posttest Comparison Group Design

109

(14)

Conservation Program Evaluations: The Control of Self-Selection Bias

110

(10)

Tim M. Newcomb

Explanation and Critique

120

(3)

Interrupted Time-Series Comparison Group Design

123

(14)

Regulatory Strategies for Workplace Injury Reduction: A Program Evaluation

126

(9)

Garrett E. Moran

Explanation and Critique

135

(2)

Posttest-Only Comparison Group Design

137

(14)

The Effects of Early Education on Children's Competence in Elementary School

138

(9)

Martha B. Bronson

Donald E. Pierson

Terrence Tivnan

Explanation and Critique

147

(4)

PART IV Reflexive Designs

151

(28)

One-Group Pretest-Posttest Design

153

(16)

Nutrition Behavior Change: Outcomes of an Educational Approach

154

(12)

Patricia K. Edwards

Alan C. Acock

Robert L. Johnson

Explanation and Critique

166

(3)

The Simple Time-Series Design

169

(10)

A Little Pregnant: The Impact of Rent Control in San Francisco

170

(5)

Edward G. Goetz

Explanation and Critique

175

(4)

PART V Cost-Benefit and Cost-Effectiveness Analysis

179

(30)

Cost-Benefit Analysis

181

(16)

The Costs and Benefits of Title XX and Title XIX Family Planning Services in Texas

182

(12)

David Malitz

Explanation and Critique

194

(3)

Cost-Effectiveness Analysis

197

(12)

A Cost-Effectiveness Analysis of Three Staffing Models for the Delivery of Low-Risk Prenatal Care

199

(8)

Elaine A. Graveley

John H. Littlefield

Explanation and Critique

207

(2)

PART VI Other Designs

209

(32)

Patched Designs

211

(14)

Attitude Change and Mental Hospital Experience

212

(10)

Jack M. Hicks

Fred E. Spaner

Explanation and Critique

222

(3)

Meta-Evaluation Designs

225

(16)

How Effective Is Drug Abuse Resistance Education? A Meta-Analysis of Project DARE Outcome Evaluations

226

(11)

S.T. Ennett

N.S. Tobler

C.L. Ringwalt

R.L. Flewelling

Explanation and Critique

237

(4)

PART VII On Your Own

241

(54)

Are Training Subsidies for Firms Effective?

243

(14)

The Michigan Experience

Harry J. Holzer

Richard N. Block

Marcus Cheatham

Jack H. Knott

Changing the Geography of Opportunity by Expanding Residential Choice

257

(26)

Lessons from the Gautreaux Program

James E. Rosenbaum

Changes in Alcohol Consumption Resulting from the Elimination of Retail Wine Monopolies

283

(12)

Results from Five U.S. States

Alexander C. Wagenaar

Harold D. Holder

PART VIII Dilemmas of Evaluation

295

(56)

Fifth-Year Report

297

(32)

Milwaukee Parental Choice Program

John F. Witte

Troy D. Sterr

Christopher A. Thorn

School Choice in Milwaukee: A Randomized Experiment

329

(16)

Jay P. Greene

Paul E. Peterson

Jiangtao Du

Two Sides of One Story

345

(6)

Chieh-Chen Bowen

Index

351

(4)

About the Authors

355

What is included with this book?

The New copy of this book will include any supplemental materials advertised. Please check the title of the book to determine if it should include any access cards, study guides, lab manuals, CDs, etc.

The Used, Rental and eBook copies of this book are not guaranteed to include any supplemental materials. Typically, only the book itself is included. This is true even if the title states it includes any access cards, study guides, lab manuals, CDs, etc.