MassCUE Evaluators – Maximizing Your Technology Investment

Documenting the Impact of Instructional Technology Initiatives

Who We Are

Sun Associates Jeff Sun Jeanne Clark www.sun-associates.com/masscue MassCUE and Boston College

Why Evaluate?

Determine if your investment in instructional technology is “paying off”

Measure progress toward meeting your project goals

Support action planning with data

An Evaluation Plan…

Is organized around the goals of your project Defines success through the creation of

indicators keyed to your project goalsProduces data specifically targeted at

measuring success relative to your project goals

Provides feedback and recommendations for improvement

An Example Project

iPad implementation in an elementary school (grades 3 – 5)

Goals… Increase the ability to support project-based,

small group learning Decrease cost of materials such as texts,

reference materials, etc.

Schematic View of the Evaluation Process

IndicatorsPedagogy

Students involved in the iPad project are engaged in student-centered, project-based, activities that make use of 1:1 access to info, resources and collaborative online environments.  Teachers have been provided with the training necessary to support the pedagogy involved in the project.

Materials/Infrastructure

Materials/Infrastructure Implementation of iPads (1:1) in grades 3 – 5

results in an initial first year savings of 10% compared to the cost of texts, paper resource materials, photocopying, and teacher time involved in moving students to and from the computer lab. 10% additional savings are anticipated for each of the next 3 years.

Data Collection

Students involved in the iPad project are engaged in student-centered, project-based, activities that make use of 1:1 access to information, resources and collaborative online environments.  Teachers have been provided with the training necessary to support the pedagogy involved in the project.

Student-centered, project-based, learningClassroom observationsTeacher focus groups/interviewsReview of lessons plansRubrics 1:1 accessClassroom observations Information resources, collaborative environments, toolsClassroom observationsReview of lessons and student work product (against rubrics) Teacher professional developmentTeacher learning plansProfessional development observationTeacher focus groups/interviewsProfessional development participant surveys

Analysis and Findings

Data analysis – comparing data to indicators -- will show the degree to which actions (PD, pedagogy, student work, infrastructure implementation) come together to produce the intended result.

Findings are the results of this analysis.

For Example…

If you discover that teachers are not actually using the iPads for project-based learning – what are reasons for this?

One reason might be related to the PDDid the PD support the development of new

pedagogies?How could the PD – content, structure,

follow-up, participation – be modified to better support the initiative?

Recommendations

Findings (analysis) lead to recommendations and reporting.

Recommendations lead to action items. What are you going to do to implement the

recommendations?

What Does This Mean to You?

The MassCUE Evaluators’ project will Work with a team from your district to develop an

evaluation plan with indicators and data collection tools

Offer training and support in data collection and reporting

Position your district to logically reflect upon its progress toward meeting programmatic goals and substantiating your investment in instructional technology

Participation

Each district should register a 4 to 6 person team Superintendent or Assistant Superintendent Technology specialist or coordinator Curriculum and Instruction specialist Professional development specialist Classroom teacher or instructional specialist who works

with students MassCUE members fee = $2400 for a 4-person team

($3400 for a 6-person team) 4 full-day sessions starting in January, 2012 (2 in

January, 1 in February, and 1 in March) Fee covers lunch and follow-up support by Sun

Associates and Boston College

Ingrid Eppelsheimer at ieppelsheimer@fc.masscue.org