Online Learning Module: Planning evaluation

Webinar overviewWebinar overview This webinar will be recorded so that it can be

available on the Centre’s website as an educational resource

The slides and any supplementary materials will be sent to participants at the end of the session

The session will take approximately 45 minutes including time for questions

You may ask questions or make comments by:• Typing your question or comment

What is the Centre?What is the Centre?

Knowledge

Bringing people and knowledge together to promote the best mental health and

well-being for every child and youth

Capacity Partnerships

Full continuum of effective and accessible mental health services for children and youth.

IntroductionIntroduction Facilitator:

• Lindsey Thomson, Research Associate Today’s webinar:

• Brief overview of Module 1: Planning Evaluation ◦ Will also provide information on the associated

‘Toolkit’ for planning evaluation

Strengths of Online Learning ModulesStrengths of Online Learning Modules

Active Learning:• Case studies• Scenarios• Quizzes

Build a common language around evaluation Good idea to view modules with colleagues

and work through exercises together

Module 1: Learning ObjectivesModule 1: Learning Objectives Define evaluation Distinguish between types of evaluations Identify possible benefits and challenges Outline and describe key elements of an

evaluation framework

Types of EvaluationTypes of Evaluation

Types of Evaluation Process Evaluation: Focuses on the development,

implementation, and/or delivery of a program • E.g. What is the average wait time for a program?

Outcome Evaluation: Extent to which a program has been successful in achieving the goals/results/objectives• E.g. To what extent did the program reduce family

conflicts?

Benefits and ChallengesBenefits and ChallengesBenefits to evaluation: Identify aspects of

program that are working well and those to be improved

Opportunities to share best practices and lessons learned with others

Challenges to evaluation: Investment of time and

resources Varying levels of staff

experience with evaluation

Clients may be reluctant to participate

Preparing your Agency for EvaluationPreparing your Agency for Evaluation

http://www.partnershipsforolderadults.org/resources/leveltwo.aspx?sectionGUID=e601e0c7-f9d5-4ae0-8ffc-3d69e632c605

Clarify program purpose and objectives

Identify and engage key stakeholders

Setup evaluation team and identify key roles

Conduct a literature review

Consider investment of time and strategies to reduce time invested

Preparing Your Agency for Evaluation Con’t…Preparing Your Agency for Evaluation Con’t…

a. Logic Modelb. Measurement strategyc. Indicatorsd. Existing data collection sourcese. Data collection tools/methodsf. Responsibility for data collectiong. Timeframe for data collectionh. Analysis plani. Plan for sharing findingsj. Plan for using findings

Develop an Evaluation Framework/Plan:

Planning, Doing, and Using Evaluation Planning, Doing, and Using Evaluation ToolkitToolkit

Module 1:• Provides conceptual understanding of planning

evaluation Planning, Doing, and Using Evaluation Toolkit:

• Offers guiding materials such as checklists, templates, and explanations for various tasks involved

◦ E.g. stakeholder engagement, developing a logic model, identifying evaluation questions, budgeting, choosing methods, etc.

* The Centre is currently working on making worksheets more user friendly! (PDF format will be changed to Excel or Word)

Questions?Questions?

Lindsey ThomsonResearch Associate613.737.7600 x3483

lthomson@cheo.on.cawww.onthepoint.ca