Interactive Evaluation Practice; Mastering the Interpersonal Dynamics of Program Evaluation

by Jean A. King

• ISBN13: 9780761926733
• ISBN10: 0761926739
• Format: Paperback
• Copyright: 2012-04-12
• Publisher: SAGE Publications, Inc

Summary

You've taken your introduction to evaluation course and are about to do your first evaluation project. Where do you begin? Interactive Evaluation Practice: Managing the Interpersonal Dynamics of Program Evaluation helps bridge the gap between the theory of evaluation and its practice, giving students the specific skills they need to use in different evaluation settings. Jean A. King and Laurie Stevahn present readers with three organizing frameworks (derived from social interdependence theory from social psychology, evaluation use research, and the evaluation capacity building literature) for thinking about evaluation practice. These frameworks help readers track the various skills or strategies to use for distinctive evaluation situations. In addition, the authors provide explicit advice about how to solve specific evaluation problems. Numerous examples throughout the text bring interactive practice to life in a variety of settings.

Table of Contents

About the Authors	p. xiv
Preface	p. xvi
Acknowledgments	p. xx
An Introduction to Interactive Evaluation Practice	p. 1
Introducing Interactive Evaluation Practice	p. 2
Chapter Preview	p. 2
Introduction	p. 2
Why It Pays to Pay Attention to Interpersonal Dynamics in Program Evaluation	p. 3
The Personal and Interpersonal Factors	p. 5
What Is Program Evaluation? What Is Interactive Evaluation Practice?	p. 11
Evaluation Metaphysics	p. 15
Three Roles of the Evaluator in Interactive Evaluations Practice	p. 17
Evaluator as Decision Maker	p. 18
Evaluator as Actor	p. 18
Evaluator as Reflective Practitioner	p. 19
Chapter Review	p. 20
Framing Interactive Evaluation Practice	p. 21
Chapter Preview	p. 21
Introduction	p. 21
A Primer on Seven Basic Inquiry Tasks	p. 22
The Interpersonal Participation Quotient	p. 26
Evaluator-Directed Studies	p. 28
Collaborative Studies	p. 29
Participant-Directed Studies	p. 32
The Evaluation Capacity Building Framework	p. 35
Applying the Frameworks to Evaluation Practice	p. 39
Accreditation for a Health Clinic	p. 39
Customer Satisfaction in the Hospitality Industry	p. 40
Organization Development in an Educational Institution	p. 41
Chapter Review	p. 42
Theoretical Foundations for Interactive Evaluation Practice	p. 44
Chapter Preview	p. 44
Introduction	p. 44
Where's the Theory?	p. 45
Factors Impeding Research on Evaluation Practice	p. 46
Theories to Use in Interactive Evaluation Practice	p. 49
Social Interdependence Theory	p. 50
Theoretical Conceptions of Evaluation Use	p. 53
Studying Evaluation Use	p. 54
What Research Says About Evaluation Use	p. 57
Theory-Based Principles for Interactive Evaluation Practice	p. 60
Chapter Review	p. 63
Skills and Strategies for Interactive Evaluation Practice	p. 65
The Nuts and Bolts of Evaluation Conversations	p. 66
Chapter Preview	p. 66
Introduction	p. 66
The Role of Conversations in Evaluation Practice	p. 67
How Program Evaluation Conversational Differ From Other Conversations	p. 70
Context	p. 71
The Client/Primary Intended User	p. 71
Conversation Content	p. 72
The Evaluator	p. 74
Overarching Goals and Sample Questions for Evaluation Conversations	p. 76
Conversations and the Interactive Evaluation Practice Frameworks	p. 90
Applying Interactive Evaluation Practice Principles to Evaluation Conversations	p. 93
Chapter Review	p. 95
An Evaluator's Dozen of Interactive Strategies	p. 96
Chapter Preview	p. 96
Introduction	p. 96
Grounding Interactive Evaluation Strategies	p. 98
Why Use Interactive Strategies in Evaluation?	p. 98
Where Will Interactive Evaluation Strategies Work Best?	p. 100
When Should Evaluators Use Interactive Evaluation Strategies?	p. 100
How Can Interactive Strategies Be Facilitated?	p. 101
Facilitating Interactive Evaluation Strategies	p. 101
Interactive Evaluation Strategies	p. 106
An Example of the Strategies in Action	p. 148
Practical Considerations for Using Interactive Strategies	p. 153
Applying Interactive Evaluation Practice Principles to Interactive Strategies	p. 162
Chapter Review	p. 164
Managing Conflict Constructively in Evaluation Settings	p. 166
Chapter Preview	p. 166
Introduction	p. 166
Recognizing Conflict in Evaluation Practice	p. 167
Theoretical Frameworks for Constructive Conflict Resolution	p. 169
Conflict Strategies Theory	p. 169
Constructive Conflict Resolution Theory	p. 171
Skills for Constructive Conflict Resolution	p. 173
Structure Cooperative Goals	p. 173
Negotiate for Mutual Gain	p. 177
Conflict Competencies for Evaluators	p. 180
Analyze the Social Context	p. 181
Goal Structures	p. 181
Cooperative Interaction	p. 181
Conflict Situations	p. 182
Recognize Conflict Behaviors	p. 185
Forcing	p. 185
Withdrawing	p. 186
Smoothing	p. 187
Compromising	p. 188
Facilitate Mutual Problem Solving	p. 189
Create Cooperative Norms	p. 190
Know Thyself	p. 190
Applying Interactive Evaluation Practice Principles to Managing Conflict Constructively	p. 190
Chapter Review	p. 193
Creating a Viable Interactive Evaluation Process	p. 195
Chapter Preview	p. 195
Introduction	p. 195
Planning a Viable Interactive Evaluation Process	p. 197
Context/Setting	p. 197
Culture	p. 202
Involvement	p. 207
Establish Committees	p. 208
Populate Committees	p. 209
Analyze Attitude and Aptitude	p. 212
Logistics	p. 216
Establish Consistent Expectations, Procedures, and Routines	p. 217
Focus on Meetings	p. 217
Create and Use Templates	p. 218
Organize Systems for Dealing With Documents	p. 218
Determine Who Will Manage Logistics	p. 221
Communication	p. 221
Communication Within Evaluation Committees	p. 222
Communication Among Evaluation Committees	p. 223
Communication Beyond Evaluation Committees	p. 223
Electronic Communication	p. 224
Information Management	p. 225
Confidentiality	p. 226
Building Evaluation Capacity Through Interactive Processes	p. 227
Organizational Context	p. 228
ECB-Friendly Internal Organizational Context	p. 229
Support From the External Environment	p. 229
Resources	p. 229
Access to Evaluation Resources	p. 229
Sources of Organizational Support for Evaluation	p. 230
ECB Structures	p. 230
Long-Term Plan for ECB	p. 230
Infrastructure to Support the Evaluation Process	p. 231
Purposeful Socialization Into the Evaluation Process	p. 231
Peer Learning Structures	p. 232
Assessing Evaluation Processes to Enhance Viability	p. 232
Applying Interactive Evaluation Practice Principles to Creating a Viable Interactive Evaluation Process	p. 236
Chapter Review	p. 238
Dealing With the Unexpected in Program Evaluation: When Bad Things Happen to Good Evaluators	p. 240
Chapter Preview	p. 240
Introduction	p. 240
The Limits of Evaluation Practice	p. 242
What Can Go Wrong During a Program Evaluation?	p. 245
Environmental Issues	p. 246
Environmental Scenario	p. 250
Client/User Issues	p. 251
Client/User Scenario	p. 259
Evaluation Process/Results Issues	p. 261
Evaluation Process/Results Scenario	p. 265
Evaluator Issues	p. 267
Evaluator Issues Scenario	p. 268
What Can Interactive Evaluators Do When Bad Things Happen?	p. 269
General Responses to Unexpected Issues	p. 270
Environmental Issues	p. 270
Client/User Issues	p. 270
Evaluation Process/Results Issues	p. 271
Evaluator Issues	p. 271
Putting It All Together	p. 271
The Role of Internal Versus External Evaluators in Addressing the Unexpected	p. 275
Internal Evaluators	p. 275
External Evaluators	p. 276
Thinking About Inevitable Trade-Offs in Evaluation Decision Making	p. 278
Applying Interactive Evaluation Practice Principles to Dealing With the Unexpected in Program Evaluation	p. 281
Chapter Review	p. 283
Teaching Cases For Bringing Interactive Evaluation Practice To Life	p. 285
The Evaluator Is in Charge: Evaluating a Controversial Shelter Project	p. 287
Chapter Preview	p. 287
Introduction	p. 287
The Evaluation Context	p. 289
The Cast of Characters as the Evaluation Began	p. 290
The Evaluation Process	p. 293
Initial Decisions/Actions	p. 293
Data Collection and Analysis Decisions/Actions	p. 296
Data Interpretation and Reporting Decisions/Actions	p. 303
Case Study TIPS: Think, Interact, Practice, Situate	p. 307
Chapter Review	p. 310
We're in This Together: Evaluating a Remedial Math Program	p. 313
Chapter Preview	p. 313
Introduction	p. 313
The Evaluation Context	p. 315
The Cast of Characters as the Evaluation Began	p. 317
The Evaluation Process	p. 320
Initial Decisions/Actions	p. 320
Data Collection and Analysis Decisions/Actions	p. 323
Data Interpretation and Reporting Decisions/Actions	p. 337
Case Study TIPS: Think, Interact, Practice, Situate	p. 342
Chapter Review	p. 346
Serving as an Evaluation Coach: Engaging Staff and Participants in Evaluating a Healthy Nutrition Program	p. 349
Chapter Preview	p. 349
Introduction	p. 349
The Evaluation Context	p. 352
The Cast of Characters as the Evaluation Began	p. 353
The Evaluation Process	p. 356
Initial Decisions/Actions	p. 356
Data Collection and Analysis Decisions/Actions	p. 359
Data Interpretation and Reporting Decisions/Actions	p. 369
Case Study TIPS: Think, Interact, Practice, Situate	p. 373
Chapter Review	p. 377
Epilogue: The End-and a Beginning	p. 379
Glossary	p. 382
The Program Evaluation Standards: A Guide for Evaluators and Evaluation Users (3rd Edition)	p. 388
American Evaluation Association Guiding Principles for Evaluators	p. 392
Essential Competencies for Program Evaluators	p. 397
Interactive Evaluation Practice Principles Chapter Crosswalk	p. 400
Generic Exercises for Reflecting on Interactive Evaluation Practice Case Studies	p. 407
References	p. 412
Author Index	p. 419
Subject Index	p. 422
Table of Contents provided by Ingram. All Rights Reserved.