harnessing the power of research to inform data …...1 5 1 5 1 5 please contact us don fraynd, phd...

27
The Educator’s Professional Inventory Harnessing the Power of Research to Inform Data-Driven Hiring and Increase Student Achievement

Upload: others

Post on 11-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

The Educator’s Professional Inventory

Harnessing the Power of Research to Inform Data-Driven Hiring and Increase

Student Achievement

Page 2: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

A (R)evolution Created to Transform the Way You Hire

Page 3: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Recent research has made it possible to create a tool that predicts the impact that a teacher candidate will have on student achievement.

Page 4: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Teachers Are the Most Important Factor

• Yet very little effort has been placed into making sure they are hired with scientific precision.

• Can you predict teacher candidate performance? Yes!

• EPI is the first and only comprehensive tool that predicts the impact that teachers will have on student achievement. And, because of advanced machine learning capabilities, it gets better and better the longer it is in use.

Page 5: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

It’s Time for a Change

Page 6: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Linking the Human Capital Chain

Page 7: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Meta-Analysis of Hundreds of Studies An in-depth review of the literature yields four areas that matter most.

Page 8: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Our Research Consortium

Page 9: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

CA

UT

NE

KS

MN

ILIN

KY

OH

PA

ME

FL

SCAR

LA

AZ

WI

DI STRI CT TYPE

Red = Urban

Blue = Suburban

Green = Rural

TYPE OF SCHOOL

Char ter School

Publ ic School

Size of shape indicates research sample size.

TeacherMatch Nationwide Research Sample deliberately varied by location, school type, size, and demographics.

Page 10: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Automating Sophisticated Analytics

Hierarchical Linear Modeling: Indicates which items on the EPI are most predictive of student growth.

Technology Platform: Uses HLM and VAM results to deliver the EPI to assess candidates and report on their results.

Value-Add Modeling: Used as a Dependent Variable in our HLM model; our operational definition of “teacher effectiveness.”

EPI is truly an inter-disciplinary undertaking. We bring together specialists from multiple fields who normally do not dialogue.

Page 11: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

The System Learns Over Time

The addition of SEM along with R on the technology side will enable a Computer Adaptive Test (CAT) that will allow for a real-time EPI that is context specific right down to the school and classroom level.

Hierarchical Linear Modeling

Technology Platform

Value-Add Modeling

Adaptive EPI

Structural Equation Modeling

Page 12: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

National Teacher

E ectiveness Research

Highly Predictive

I tems

EPI

EPI- Résumé

- Candidate Portfolio of Credentials

- Base I nventory

- Candidate Grid

- Professional Development Report

Over Time,

Observed Teacher

E ectiveness,

As Compared to

EPI Results

Over Time,

Disti llation of the

Most Predictive Domains

and Subdomains for

Teacher Success by

School/ Distr ict

Organized,

Highly-Predictive

Teacher Candidate

Data

EPI

Candidate

Selection

Factors

SampleLesson

PhoneScreen ReferencesI nterview

4 Domains of I nquiry:

Teaching Ski l l, Quali cations,

Cognit ive Abi l i ty, Att i tudinal Factors

Candidate

EPI Results

PredictiveAnalytics

EPI Is Artificially Intelligent Research in Action

Page 13: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Candidate Grid = Actionable & Fast Now you can interview only the candidates most likely to be an effective teacher.

Page 14: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Translating Score to Likelihood of Student Growth Value-Add Modeling (VAM) removes factors that are not under the teacher’s control.

Page 15: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

VAM Distribution Think of this as a distribution of teachers’ ability to deliver student growth.

Page 16: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Professional Development Profile (PDP) Uses evidence-based EPI results to customize a PD report.

Page 17: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Normal Student Growth

Page 18: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Impact of Scientifically Based Hiring Over Time

Page 19: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Impact of Scientifically Based Hiring Over Time

Page 20: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

The Science + Art of Hiring Excellent Teachers

Healthy Pool

of Applicants

Predictive Screening

(EPI)

Strong Pool of

Qualified Candidates

Rigorous Job Order

Management Superior Hired

Pool

Analytics

1 2 3

4

5

TeacherMatch delivers one

glance analytics and actionable

insights on all vital steps of

hiring excellence so decision

makers can focus on key issues

6

Benchmarking &

Feedback for

Continuous

Learning

Page 21: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

TeacherMatch Mosaic Delivers One Glance Actionable Insights At Your

Fingertips

High EPI Candidates which need to be addressed quickly

Job Orders that are not getting any quality candidates

Page 22: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

..And Key Drill Down Insights Out of the Box

All Job Orders

By Cert i f ication

By # of Openings

By Schools

Search

By Cert i f ication

By # of Openings

By Distr ict

By Schools

Search

By EPI

By Cert i f ication

By Education

By Geography

Search

Al l Appl icants

Al l Hi res

By EOEC

Search

By

Geography

By EPI

By Education

By

Cert i f ication

By Col lege

My Default Feed

Candidates Only in

Feed

Jobs Only in Feed

Select Al l

Candidates

Select Al l Jobs

Search Feed

Page 23: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Single click status management

for workflow management and reporting

Hiring Velocity

A List

Round 2

Check References

Message Notes Save Share

Kelly Buffet EPI Norm: 85

Applied On: June 12, ‘13

Contacted: Yes (Name)

Certifications:

BS (College Name) ’91/4.0

Physics

MS (College Name) ’96/4.0

Physics

Improved Candidate Grid Deliver Norm Rankings Along With Full Suite of Decision

Making Tools For Single Point Command and Control for a Job

View total # of Jobs applied at your District + other jobs (but not details of those jobs)

Candidate bio and other portfolio data

Page 24: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

24

Capture and Track Messages/Notes/Phone Calls

2013

August 12

August 6

2012

Rita,

please look at his cover letter. He has lots of progressive ideas. Have spoken

with him and would like him to come in for a mock class.

Melinda

Hi Tim,

We are reaching out to schedule a phone conversation with you. Are you

available on August 12 at 10 am Central?

Heather

August 12

August 6

Spoke to Adam for 30 minutes. Quite an impressive candidate. Details notes

are attached here. We need to get him in.

Melinda

Page 25: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

✓ Applied

Hiring Vetting Interview Screening

✓ ✓ ✓

Interview 1

Interview 2

Interview 3

EPI/PD/Resu

me Review

Phone

Interview Group

Interview

H Hired

D

Removed

References

Checked

Mock Class

Sessions

In-Person

Interview(s)

R

Rejected

PD

Review/Fee

dback Formal

Offer

Made

Declined

X W

Withdrawn By Applicant

Design Your Own Process and We Will Deliver Cutting Edge Analytics for Process

Excellence

Page 26: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

✓ Applied

Hiring Vetting Interview Screening

✓ ✓ ✓

Interview 1

Interview 2

Interview 3

EPI/PD/Resu

me Review

Phone

Interview Group

Interview

H Hired

D

Removed

References

Checked

Mock Class

Sessions

In-Person

Interview(s)

R

Rejected

PD

Review/Fee

dback Formal

Offer

Made

Declined

X W

Withdrawn By Applicant

Checklist At Each Vital Step to Capture the Rationale for Moving The Candidate

To Next Stage..Configurable for Flexibility And Speed

Candidate Competency Checklist

Breadth of Skills

Experience

Subject Matter Knowledge

Leadership

Communication skills

References

1 5

1 5

1 5

1 5

1 5

1 5

Page 27: Harnessing the Power of Research to Inform Data …...1 5 1 5 1 5 Please Contact Us Don Fraynd, PhD CEO dfraynd@teachermatch.org 773-655-8806 We would welcome the opportunity to continue

Please Contact Us

Don Fraynd, PhD CEO [email protected]

773-655-8806

We would welcome the opportunity to continue the discussion!