Practice Evaluation for the 21st Century

by Nugent, William R.; Sieppert, Jackie D.; Hudson, Walter

• ISBN13: 9780534348670
• ISBN10: 053434867X
• Format: Paperback
• Copyright: 2001-01-09
• Publisher: Cengage Learning

Summary

Offering an excellent, client-oriented, results-driven means for studying practice evaluation, this book brings together practice, research, structural change in service delivery, and specific skills in an integrated, problem-solving way. With managed care becoming such a hot topic, professionals need to track client assessments and demonstrate the efficiency and effectiveness of their treatment. PRACTICE EVALUATION IN THE 21st CENTURY helps readers develop the skills to monitor efficacy by integrating practice and research in the book, as well as providing access to powerful evaluation software via the Web. The book effectively conveys to readers the importance of empirically evaluating social work practice and the responsibility of all practitioners to engage in evaluation as an integrated part of professional practice. Readers have access to the CASS software on the accompanying Web site and will find that the contextual support in the text along with easy-to-follow documentation make the software easy to use.

Table of Contents

Preface	xvi
Introduction	1	(26)
Overcoming Bad Vibes	2	(1)
Accountability and Effectiveness	2	(2)
Two Definitions of Effectiveness	3	(1)
Three Definitions of Accountability	4	(1)
The Fundamental Equation of the Empirical Practice Model	4	(3)
Cost Benefit Analysis	7	(1)
Empirical Practice Model	7	(4)
A Simple Monitoring Design	8	(3)
Scientist and Practitioner	11	(3)
Practitioner Role	12	(1)
Scientist Role	12	(1)
Role Dependency in Science and Practice	13	(1)
The Role of Feedback	14	(6)
Feedback: An Illustration	14	(6)
The Promise of the EPM	20	(2)
The EPM for Everyone	21	(1)
A Human Problem Theory	22	(2)
The Role of Measurement	24	(1)
Computers and the Empirical Practice Model	25	(2)
PART I USING SINGLE-CASE TIME-SERIES DESIGNS	27	(184)
Designing for Effectiveness-Oriented Practice	29	(21)
A Basic Evaluation Typology	30	(6)
The Role of Goals, Objectives, and Activities	36	(6)
Program Goals	37	(1)
Program Objectives	37	(1)
Practice Objectives	38	(1)
Practice Activities	39	(1)
Relationship Between Goals, Objectives, and Activities	40	(2)
The Role of Information in Human Services	42	(4)
Final Thoughts About Collecting Practice Evaluation Information	46	(2)
Summary	48	(2)
N = 1 Designs in Science and Practice	50	(19)
Social Work as Science and Practice	50	(4)
N = 1 Designs as Tools to Do and Enhance Practice	54	(1)
The Nature of Science Versus the Nature of Practice	55	(4)
Using N = 1 Designs to Conduct and Enhance Social Work Practice	59	(9)
Intake and Engagement	60	(2)
Data Collection and Assessment	62	(1)
Planning and Contracting	63	(1)
Intervention and Monitoring	64	(2)
Termination and Evaluation	66	(2)
Summary	68	(1)
Monitoring and Evaluating Clinical Practice	69	(21)
The Nature of Monitoring Clinical Practice	69	(3)
The Single-System Framework	72	(5)
Deciding Upon Measurable Client Objectives	73	(1)
Selecting Appropriate Measures	74	(1)
Collecting Data Over Time	75	(1)
Graphing a Single-System Design	76	(1)
Phases and Baselining	77	(7)
The Concept of Phases	77	(1)
The Concept of Baselining	78	(6)
Basic Monitoring Designs	84	(4)
The B Design	84	(1)
The BC and BCD Designs	85	(2)
The AB Design	87	(1)
Summary	88	(2)
Designs to Evaluate Practice	90	(20)
The Nature of Evaluating Practice	90	(8)
Establishing Causality Using Single-System Designs	92	(2)
Threats to Internal Validity	94	(3)
Threats to External Validity	97	(1)
Basic Evaluation Designs	98	(11)
The ABA Design	98	(2)
The ABAB Design	100	(1)
The BAB Design	101	(2)
The BCBC Design	103	(2)
The Multiple Baseline Design	105	(4)
Summary	109	(1)
The Analysis of Single-Case Design Data	110	(41)
Visual Analysis and Statistical Analysis Procedures	110	(1)
Characteristics of Single-Case Design Data: Definitions and Representations	111	(13)
Level	111	(1)
Mean	112	(1)
Trend	112	(8)
Variability	120	(2)
Background Variability	122	(1)
Overlap	122	(2)
Between Phase Change	124	(5)
Change in Level and Mean	124	(1)
Change in Trend	125	(1)
Change in Variability	126	(1)
Assessing Between Phase Change	126	(3)
Latency of Change	129	(1)
Permanent Versus Temporary Change	129	(1)
Illustrative Visual Analyses	129	(20)
Illustrative Analysis Number One	131	(1)
Illustrative Analysis Number Two	132	(1)
Illustrative Analysis Number Three	133	(1)
Illustrative Analysis Number Four	134	(1)
Illustrative Analysis Number Five	135	(3)
Illustrative Analysis Number Six	138	(2)
Illustrative Analysis Number Seven	140	(2)
Illustrative Analysis Number Eight	142	(2)
Illustrative Analysis Number Nine	144	(2)
Illustrative Analysis Number Ten	146	(3)
Examples from the Literature	149	(2)
Integrating Single-Case and Group-Comparison Designs for Evaluating Practice	151	(17)
Advantages of Integrated Designs	152	(3)
A Conceptual Link Between Single-Case and Group Designs	155	(4)
Direct Replication	156	(1)
Systematic Replication	156	(1)
Clinical Replication	157	(1)
Linking Single-Case and Group Designs	158	(1)
General Procedures for Integrating Single-Case and Group Methods	159	(1)
Hypothetical Examples of Integrated Designs	160	(4)
Hypothetical Example Number One	160	(1)
Hypothetical Example Number Two	161	(3)
Examples from the Literature	164	(4)
Illustrative Example Number One	164	(1)
Illustrative Example Number Two	165	(1)
Illustrative Example Number Three	166	(2)
Analyzing Aggregated Single-Case Data	168	(25)
Graphical Methods	169	(14)
The Graphic Representation of Aggregated Data	169	(4)
Making Distinctions Between Client Groups	173	(3)
Comparing Different Context Variables	176	(7)
Statistical Methods	183	(6)
Additional Statistical Aids	189	(1)
More Advanced Statistics	189	(1)
A Simple Example	189	(3)
Summary	192	(1)
Quality Management: Process and Outcome	193	(18)
The Emergence of Managed Care	194	(3)
The Spread of Managed Care to Mental Health Services	197	(2)
The Role of Quality Management in Managed Care	199	(5)
Utilization Management	200	(1)
The Role of EPM in Quality and Utilization Management	201	(3)
Example of Empirical Practice Model in Quality Management Process	204	(7)
PART II MEASUREMENT TOOLS	211	(126)
The Role of Measurement in Practice	213	(20)
The Nature of Measurement	213	(1)
Measurement Defined	214	(3)
Levels of Measurement	216	(1)
The Functions of Measurement	217	(8)
The Axioms of Treatment	218	(1)
Redefining Description	219	(2)
Enhancing Precision	221	(1)
Facilitating Practice Decisions	222	(1)
Improving Information Feedback	222	(1)
Ensuring Legal Accountability	223	(1)
Attitudes About Measurement	224	(1)
Characteristics of Good Measures	225	(7)
Reliability	226	(4)
Validity	230	(2)
Summary	232	(1)
A Sampler of Short-Form Measures for Use in Practice	233	(16)
The CASS Scales	234	(1)
Personal Adjustment Issues	235	(6)
Clinical Anxiety Scale	236	(2)
Generalized Contentment Scale	238	(1)
Index of Alcohol Involvement	238	(1)
Index of Clinical Stress	238	(1)
Index of Drug Involvement	239	(1)
Index of Homophobia	239	(1)
Index of Peer Relations	240	(1)
Index of Self-Esteem	240	(1)
Sexual Attitude Scale	240	(1)
Dyadic Relationship Issues	241	(2)
Index of Marital Satisfaction	241	(1)
Index of Sexual Satisfaction	242	(1)
Non-physical Abuse of Partner Scale	242	(1)
Partner Abuse Scale: Non-physical	242	(1)
Physical Abuse of Partner Scale	243	(1)
Partner Abuse Scale: Physical	243	(1)
Family Adjustment Issues	243	(3)
Child's Attitude Toward Father	244	(1)
Child's Attitude Toward Mother	244	(1)
Index of Parental Attitudes	244	(1)
Index of Brother Relations	245	(1)
Index of Sister Relations	245	(1)
Index of Family Relations	245	(1)
Organizational Assessment Issues	246	(1)
Client Satisfaction Inventory	246	(1)
Index of Job Satisfaction	246	(1)
Index of Managerial Effectiveness	246	(1)
Index of Sexual Harassment	247	(1)
Summary	247	(2)
Administering, Scoring, and Interpreting the Short-Form Scales	249	(12)
Structure and Scoring	249	(4)
Interpreting the Short-Form Scale Scores	253	(5)
Administering the Scales	258	(3)
Present the Scales with Confidence	258	(1)
Be Familiar with Scale Performance	259	(1)
Explain the Purpose of the Scales	259	(1)
Avoid Excessive Administration	259	(1)
Check Out Inconsistent Responses	260	(1)
Consider Social Desirability, Demand Characteristics, and Misleading Responses	260	(1)
Multidimensional Assessment Tools	261	(24)
The Multi-Problem Screening Inventory (MPSI)	262	(19)
The MPSI Items	262	(1)
The MPSI Subscale Scores	263	(2)
The MPSI Subscales	265	(7)
Psychometric Characteristics of Subscale Scores	272	(9)
The Family Assessment Screening Inventory (FASI)	281	(4)
The FASI Items and Subscale Scores	281	(3)
Psychometric Characteristics of FASI Subscale Scores	284	(1)
Administering, Scoring, and Interpreting the MPSI and FASI	285	(8)
Administering the MPSI and FASI	285	(3)
General Guidelines	285	(2)
The Nonapplicability of Some Subscales	287	(1)
Two Administration Models	287	(1)
Scoring the MPSI and the FASI	288	(2)
Interpreting the MPSI Subscale and FASI Subscale Scores	290	(2)
Interpreting the MPSI and FASI Score Profiles	292	(1)
Questions About Using Assessment Scales	293	(21)
How to Select and Use the Scales	294	(2)
Screening and Diagnostic Applications	296	(2)
Using Scales with Children and Special Populations	298	(2)
Interpreting and Using Scale Scores	300	(2)
Interpreting Changes in Client Scores	302	(3)
Client Reactions and Responses	305	(1)
Dependability of Client Responses	306	(4)
Using Scales for Training and Supervision	310	(1)
Administrative and Logistical Questions	311	(1)
Research and Technical Questions	312	(1)
Summary	313	(1)
Developing One's Own Measurement Scales	314	(23)
Conceptual Fundamentals	315	(8)
Ways of Measuring Clients' Problems	315	(2)
Classifying Measurement Tools	317	(1)
Standardized Scales	318	(1)
Items	318	(5)
The Development of Standardized Summated Scales	323	(9)
The Scale Blueprint	323	(4)
Item Development	327	(3)
Initial Review of Items	330	(1)
Content Validity	330	(1)
Pilot Test and Item Analysis	331	(1)
Reliability and Validity Studies	331	(1)
Client-Specific Measures: Self-Anchored Scales	332	(2)
Summary	334	(3)
PART III THE CASS SOFTWARE	337	(54)
Acquiring and Installing the CASS Software on a PC or LAN	339	(9)
The Role of CASS in Practice	339	(3)
Acquiring a Copy of CASS	342	(1)
Hardware and Software Requirements for CASS	342	(1)
Installing CASS on a Personal Computer	343	(1)
Installing CASS from Diskettes	343	(1)
Installing CASS from the Web	344	(1)
Where Things Are Stored	344	(1)
Changing the Default Installation Parameters	345	(1)
Loading the Share.exe Program	345	(1)
Installing CASS on a Network	346	(1)
Calling Up and Using the Software	346	(1)
Free CASS Updates	347	(1)
Next Steps	347	(1)
Using CASS in Practice	348	(19)
Setting Up the CASS Software	349	(1)
Change the UserID and Password	349	(1)
Install the Service Codes	350	(1)
Client Records and Service Periods	350	(1)
A First Tour of CASS	351	(5)
Conducting a First Case Review	351	(4)
Reviewing a Caseload	355	(1)
Learning About the Tool Bar	356	(1)
Ending the First Quick Tour of CASS	356	(1)
Working with Case Notes	356	(3)
Creating a Case Note Template	357	(1)
Naming Each Case Note	357	(1)
Dating Case Notes	357	(1)
Keeping Case Note Brief	358	(1)
Writing ``To Do'' Notes	358	(1)
Case Note Accountability	358	(1)
Editing Case Notes	358	(1)
Case Note Limitations	359	(1)
Task Management	359	(3)
Quality Assurance Monitoring and Managed Care	359	(1)
Goal Attainment and Task Completion Scaling	360	(1)
Making the Most of Task Management	360	(1)
Defining Treatment/Service Delivery	360	(1)
Developing New Conceptual Tools	361	(1)
Understanding and Reducing Risks	361	(1)
Client Assessment and Progress Monitoring	362	(3)
Initial Assessment	363	(1)
Final Assessment	363	(1)
Interim Assessment	364	(1)
Problem Monitoring with Short-Form Scales	364	(1)
Seeing Real Change	365	(1)
Measurement as a Central Practice Task	365	(1)
Summary	365	(2)
Making CAAP Available to Clients	367	(6)
Calling Up CAAP	368	(1)
Learning the CAAP Ropes	369	(1)
Training Clients	369	(1)
Training Receptionists	369	(1)
Using CAAP on a Personal Computer	370	(1)
Installing a Network	370	(1)
Using Two Independent Computers	371	(1)
Summary	372	(1)
The Manager's Use of CASS	373	(8)
Standardizing Practice	373	(1)
Managing Service Codes	374	(1)
Helping with Program Evaluation	374	(3)
The CASS Utility Kit	375	(1)
The CASS Program Evaluator	375	(2)
Managing the CASS Software	377	(4)
Managing Passwords	377	(4)
Concluding Remarks	381	(10)
Practice Evaluation Themes and Future Directions	382	(8)
The Integration of Practice and Evaluation	382	(2)
Managed Care and Quality Management	384	(1)
The Role of Technology	385	(2)
The Impact of Consumerism	387	(1)
New Models of Professional Practice	388	(2)
Summary	390	(1)
Appendix A Some Technical Details	391	(12)
Appendix B Sample Copies of the CASS Scales	403	(46)
Appendix C Training and Practice Exercises	449	(6)
References and Suggested Readings	455	(14)
Index	469