Toolkit of Evaluation Methods & Measures
Welcome to an evaluation toolkit designed specifically for use by the staff of injury prevention (IP) organizations and IP practitioners from other organizations (e.g. Ontario’s Public Health Units or Boards). The purpose of providing you with the contents of these pages is to provide you with easy access to useful knowledge and resources that will help you to start planning and doing evaluations of your organization’s IP programs, projects and other IP activities.
Evaluation is a word that often promotes feelings of fear and dread, or at least boredom on the part of injury prevention practitioners. It can conjure up images of horrible math tests from high school and uncomfortable job interviews or work performance reviews. For those who have worked in the public sector for a while, the word evaluation can also conjure up images of impersonal evaluation consultants breezing into the office for a few weeks, disrupting everyone's work patterns, and then producing a dry, technical report that no-one will ever read, unless of course, they are looking for an excuse to attack the program that was evaluated or to appropriate the program’s budget.
It does not have to be that way. Indeed, when conducted responsibly and with a focus on the information needs of IP program stakeholders and the usefulness of results, evaluation can be a positive force for organizational and program development (e.g. breathing new life into old, established injury prevention programs & helping to focus new ones).
In addition, developing your staff members’ expertise, knowledge and skills in evaluation can be very useful in meeting the accountability demands of the organizations that fund your IP programs and projects.
There is a lot of material, and many organizations and individuals that are available to help a beginner get started on their first evaluation, or a seasoned pro develop their skills. It is not the aim of this toolkit to duplicate any of these excellent resources. Rather, we hope to provide descriptions of a number of methods that are particularly useful for evaluations in the IP sector and provide some specific tools that you can use in evaluations of your organization’s injury prevention programs and projects. In addition, we provide links to additional resources you will find helpful.
The contents of this toolkit are as follows:
• The Stages of Evaluation
Stages of Evaluation
• Evaluation Concepts
• Our Recommended Model of Evaluation Practices for IP Organizations
i. The Value of Using the Utilization-Focused Evaluation Model
ii. Model for the Comprehensive Evaluation of Training Programs in Injury Prevention
• How to Use Logic Models for Planning, Developing & Evaluating Your IP Programs & Projects
i. Logic Model -Planning Injury Prevention Programs
ii. Logic Model - Developing Injury Prevention Programs
iii. Logic Model - Evaluating Injury Prevention Programs
• How to Evaluate the Processes & Outputs of Your IP Programs & Projects
• How to Evaluate the Effectiveness of Your IP Programs and Projects
• How to Effectively Report Evaluation Results to Your Funders
• How to Develop the Internal Evaluation Capacity of Your Organization
i. How To Create an Internal Evaluation Capacity Development Plan
ii. Example of a Completed Internal Evaluation Capacity Development Plan
iii. Internal Evaluation Capacity Building Tool #1
iv. Internal Evaluation Capacity Building Tool #2
v. The Importance of Developing Internal Evaluation Capacity
• How to Find, Select & Work with External Evaluation Consultants
External Evaluation - PDF file
• Where to Get Valuable Training in Evaluation Concepts, Methods & Skills
• The Names of Important Evaluation Organizations & How They Can Help You
Evaluation Organizations - PDF File
• Lists of Evaluation Resources that may be Useful in Evaluating Your IP Activities (e.g. newsletters, committees, awareness raising events), Resources (e.g. Falls Prevention Toolkit, Fact Sheet), Programs & Projects
Resources - Part 1
Resources - Part 2
This toolkit is under constant development. Kindly send your feedback about what else you would like to see here to the OIPRC Evaluation Coordinator.