Program Evaluation

by Royse, David D.; Thyer, Bruce A.

• ISBN13: 9780830414154
• ISBN10: 0830414150
• Edition: 2nd
• Format: Paperback
• Copyright: 1996-02-01
• Publisher: Brooks Cole

Table of Contents

Preface	ix
Introduction	1	(20)
What Is a Program?	2	(4)
Program Evaluation Defined	6	(1)
Reasons Why Programs Are Evaluated	7	(5)
Overcoming the Subjective Perspective	12	(6)
Chapter Recap	18	(3)
The Evaluation of Need: Needs Assessment	21	(30)
Planning Needs Assessments	25	(1)
Selecting a Needs Assessment Approach	26	(11)
Needs Assessment Illustration 1	37	(3)
Thinking Creatively about Needs Assessments	40	(1)
Needs Assessment Illustration 2	41	(3)
Final Thoughts	44	(7)
Qualitative Evaluation: Formative and Process Evaluation, Program Monitoring, and Quality Assurance	51	(34)
Formative Evaluation	51	(3)
Conducting a Formative Evaluation	54	(3)
Process Evaluation	57	(3)
Program Monitoring	60	(13)
Quality Assurance	73	(3)
Improving Quality---Recent Themes	76	(2)
Final Thoughts	78	(7)
Goal Attainment Scaling and Client Satisfaction Studies	85	(22)
Goal Attainment Scaling (GAS)	86	(1)
Case Example of Goal Attainment Scaling	87	(3)
GAS and Program Evaluation	90	(1)
Variations of Goal Attainment Scaling	91	(1)
Problems with Goal Attainment Scaling	92	(2)
Client Satisfaction Studies	94	(5)
The Hammond Model	99	(3)
Chapter Recap	102	(5)
Single System Research Designs	107	(24)
Selecting Outcome Measures	108	(2)
Conducting Needs Assessments	110	(4)
Formative Evaluation	114	(2)
Quality Assurance Studies	116	(1)
Evaluation Designs	117	(4)
Experimental Designs	121	(5)
Chapter Recap	126	(5)
Group Evaluation Designs	131	(30)
Starting an Outcome Evaluation	131	(3)
Outcome Evaluation Designs	134	(3)
Pre-Experimental Evaluation Designs	137	(4)
Quasi-Experimental and Experimental Evaluation Designs	141	(5)
Eliminating Alternative Explanations	146	(1)
Threats to Internal Validity	146	(3)
Protection Against Alternative Explanations	149	(1)
Experimental Designs	150	(5)
Chapter Recap	155	(6)
Cost Effectiveness and Cost Analysis Designs	161	(14)
Example of a Cost-Effectiveness Evaluation	163	(2)
How to Do a Cost-Effectiveness Study	165	(2)
Other Methods of Cost Analysis	167	(3)
Final Thoughts on Cost Analysis	170	(5)
Measurement Tools and Strategies for Program Evaluation	175	(32)
What to Measure	177	(4)
Reliability	181	(7)
Validity	188	(2)
Locating Appropriate Instruments	190	(3)
When Reference Books Don't Provide the Instrument You Want	193	(2)
Constructing ``Good'' Evaluation Instruments	195	(12)
Illustrations of Instruments	207	(24)
Child Abuse Potential Inventory	208	(3)
Clinical Anxiety Scale	211	(2)
CES-D Scale	213	(2)
UCLA Loneliness Scale (Version 3)	215	(3)
Rosenberg Self-Esteem Scale	218	(2)
Adult-Adolescent Parenting Scale	220	(2)
The Hope Scale	222	(2)
Child Sexual Behavior Inventory	224	(2)
Brief Symptom Inventory	226	(5)
Pragmatic and Political Considerations	231	(30)
Guidelines for Evaluation in Politically Charged Areas	235	(3)
Other Pragmatic Problems	238	(1)
Determining Sample Size	239	(6)
Ethical Considerations	245	(3)
Ethical Guidelines	248	(1)
Locating Control Groups	249	(3)
Ethical Dilemmas	252	(2)
Chapter Recap	254	(7)
Making Sense of Evaluation Data	261	(30)
Univariate Analysis	263	(6)
Bivariate Analysis	269	(5)
Multivariate Analysis of Data	274	(2)
Myths about Statistical Significance	276	(2)
Understanding Trends	278	(3)
Using Statistics in Reports	281	(2)
Final Thoughts	283	(8)
Writing the Evaluation Report	291	(28)
Major Content Areas	291	(16)
Mistakes to Avoid	307	(5)
Checklist for Writing and Assessing Evaluation Reports	312	(7)
Index	319