introduction to program evaluation by lizzette rojas, phd and flordeliz serpa, phd non-profit...

16
INTRODUCTION TO INTRODUCTION TO PROGRAM EVALUATION PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, I

Upload: theresa-fields

Post on 23-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

INTRODUCTION TO INTRODUCTION TO PROGRAM EVALUATIONPROGRAM EVALUATION

By Lizzette Rojas, PhDand Flordeliz Serpa, PhDNon-Profit Evaluation & Resource Center, Inc. (NPERCI)

Page 2: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Lizzette Rojas, PhDLizzette Rojas, PhDDr. Rojas has over seventeen years of experience in the area of evaluation research of health, education, and social services programs. She is the Chief Operating Officer of Non-Profit Evaluation & Resource Center, Inc.

Page 3: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Flordeliz Serpa, Flordeliz Serpa, PhDPhD

Dr. Serpa is an accomplished researcher and program evaluator. She has applied her skills to organizations in both the public and private sectors. Dr. Serpa is the Chief Executive Officer of Non-Profit Evaluation & Resource Center, Inc.

Page 4: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Learning Learning ObjectivesObjectives

Learn about evaluation and evaluation research

Learn about the evaluation process

Be able to develop an evaluation plan

Be able to determine appropriate evaluation designs

Page 5: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

DefinitionsDefinitions

EvaluationEvaluation research

AssessmentNeeds assessment

Page 6: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

The Evaluation The Evaluation Process: Process:

CharacteristicsCharacteristicsSystematic

EmpiricalLogicalInductive

Explanatory

SpecificReplicable and Valid

Page 7: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Stages In TheStages In TheEvaluation ProcessEvaluation Process

Goals and objectivesActivity standardizationStatistical model design

Page 8: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Stages In TheStages In TheEvaluation Evaluation

ProcessProcessData collectionData analysisExplanation of success level

Recommendations

Page 9: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Categories Of Categories Of EvaluationEvaluation

RelevanceProgressEfficiencyEffectivenessImpact

Page 10: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Principles In The Principles In The Selection And Selection And Elaboration Of Elaboration Of

VariablesVariables

ObjectivityVerifiableUniformity

SpecificityPertinenceAcceptability

Page 11: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

The Evaluation The Evaluation PlanPlan

IntroductionConceptual framework

ObjectivesProgram description

Page 12: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

The Evaluation The Evaluation PlanPlan

Measurable indicatorsMethodologyResultsDiscussionConclusions and recommendations

Page 13: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Evaluation Evaluation DesignsDesigns

True-Experimental DesignsQuasi-Experimental DesignsNon-Experimental DesignsCost-Benefit AnalysisCost-Effectiveness Analysis

Page 14: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Critical Issues To Be Critical Issues To Be Considered In The Considered In The Evaluation DesignEvaluation Design

Description of the organization

MissionShort and long term goals and objectives

Target populationDescription of the services

Page 15: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Critical Issues To Be Critical Issues To Be Considered In The Considered In The Evaluation DesignEvaluation Design

Priorities of the organizationChanges in the organizationCurrent situation of the organization

Available resourcesFlow chart of the organization

Page 16: INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and Flordeliz Serpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

Suggested Suggested ReadingsReadings

Thinking About Program Evaluation by Berk and Rossi, Sage Publications, 1998

Program Evaluation by John Owen, Sage Publications, 1999