Demonstrating and Communicating Research Impact Preparing NIOSH Programs for External Review

by Williams, Valerie L.; Eiseman, Elisa; Landree, Eric; Adamson, David M.

• ISBN13: 9780833046505
• ISBN10: 0833046500
• Format: Paperback
• Copyright: 2009-03-16
• Publisher: RAND Corporation

Summary

From 2005 to 2008, the National Academies conducted an external review of National Institute for Occupational Safety and Health (NIOSH) research programs. The National Academies' review assessed the programs' impact on and relevance to preventing work-related injuries, illnesses, and fatalities. This book describes the methodology that RAND researches developed to help NIOSH research programs demonstrate and communicate the impact of their activities. The methodology is based on the use of logic models, outcome worksheets, and outcome narratives as key tools in preparing evidence packages that describe the contribution that NIOSH research activities have made in reducing occupational illnesses, injuries, and fatalities. Collectively, these tools offer research programs an approach to conceptualizing their research pathway to outcomes, tracing specific cases of outcomes back to research activities, and creating a model package that concisely communicates the evidence of impact. Clearly, more tools and methods are needed to map the causal connections between publicly funded research and its social benefits. However, putting the tools described here to rigorous use is an important step in determining whether federally funded research programs are achieving long-range societal goals. Book jacket.

Table of Contents

Preface	p. iii
Figures	p. vii
Tables	p. ix
Summary	p. xi
Acknowledgments	p. xix
Abbreviations	p. xxi
Introduction	p. 1
Evaluating the Impact of Research Programs	p. 1
Expert Review	p. 4
Demonstrating and Communicating the Impact of Research Programs	p. 5
Purpose of This Book	p. 6
Organization of This Book	p. 7
Using Expert Evaluation to Measure the Impact of Federal Programs: The National Academies' Review of NIOSH	p. 9
Overview of the National Institute of Occupational Safety and Health	p. 9
Expert Review by the National Academies	p. 12
The National Academies' Evaluation Framework	p. 13
Criteria for Assessing Impact and Relevance	p. 16
RAND's Role in Helping NIOSH Programs Prepare for External Review	p. 17
Phase I: Research and Design	p. 18
Phase II: Implementation	p. 19
Logic Models	p. 21
Elements of a Logic Model	p. 22
Importance of Logic Models in Demonstrating and Assessing Impacts	p. 25
Linking Program Operations to Program Strategy	p. 26
Generating the Information for the Logic Model	p. 27
Approaches for Addressing Research Complexity in the Logic Models	p. 29
Representing the Role of Partners in Logic Models: The Mining and Construction Research Programs	p. 30
Describing Multifaceted Research Programs: The Health Hazard Evaluation and Personal Protective Technology Programs	p. 33
Concluding Thoughts	p. 38
The Outcome Worksheet	p. 41
The Evolution of Historical Tracing	p. 42
Developing Outcome Worksheets: Building from Logic Models	p. 44
Gathering Data for the Outcome Worksheet	p. 47
Analyzing Information in the Outcome Worksheet	p. 48
Concluding Thoughts	p. 51
The Evidence Package	p. 53
Communicating Impact	p. 53
Communicating to a Different Audience	p. 53
Communicating for a Different Purpose	p. 55
The Structure of the Evidence Package	p. 56
Using Outcome Worksheets to Prepare Outcome Narratives	p. 57
Writing the Outcome Narrative	p. 57
Future Considerations for the Improvement and Application of Tools	p. 65
Limitations of the Tools	p. 65
Other Uses for the Tools	p. 68
Appendix NIOSH Program Logic Model	p. 71
References	p. 73
Table of Contents provided by Ingram. All Rights Reserved.