april 3, 2017 - dese.mo.gov · april 3, 2017 missouri department of elementary and secondary...

MISSOURI ADVISORY COUNCIL FOR THE CERTIFICATION

OF EDUCATORS (MACCE)

OFFICE OF EDUCATOR

QUALITY

APRIL 3, 2017

Missouri Department of Elementary and Secondary Education

Today’s Topics

Two New Educator Preparation Programs Missouri Educator Gateway Assessments Missouri Content Assessments Missouri Performance Assessments

Annual Performance Report Alternative Measure of Content Expertise

2

STATE BOARD OF EDUCATION MEETING

APPROVAL OF COTTEY COLLEGE

& KANSAS CITY PATHWAYS TO

LEADERSHIP IN URBAN SCHOOLS (KC PLUS)

Missouri Department of Elementary

and Secondary Education March 14, 2017

SBE Meeting – March 14

Cottey College 6 Secondary

Certification Areas Biology Business Education Chemistry English Social Science Speech & Theatre

Begin Fall 2017

KC PLUS Kauffman Center Part of TNTP Partnership School

Districts 2 Leadership Areas Principal K-8 Principal 7-12

Begin Fall 2017

4

Missouri EPPs

Overall 13 – Community Colleges 13 – Public Colleges & Universities 31 – Independent Colleges, Universities, & Residencies 57 – Total Number of Approved EPPs

CAEP Accredited EPPs in Missouri 12 – Public Colleges & Universities 13 – Independent Colleges & Universities 25 – Total CAEP EPPs

5

MISSOURI EDUCATOR GATEWAY ASSESSMENTS

MISSOURI CONTENT

ASSESSMENTS

MISSOURI PERFORMANCE ASSESSMENTS

Missouri Department of Elementary and Secondary Education

• MEGA’S Three Objectives Recruit the Right People Assess Content Knowledge oMissouri Content Assessments o50+ Certification Assessments

Assess Performance Missouri Performance Assessments Teachers (V-NV), Counselors,

Librarians

7

Missouri Content Assessments

The Missouri Content Assessments are: Based on unique needs and requirements of

Missouri Consistent with state and national educator

standards and practices Reflective of subject knowledge required

for effective teaching Accurate and valid Free from bias

Next Steps

Gather input from MABEP & MACCE Consider input to establish recommendations Present to SBE the Missouri Qualifying Score

for each assessment – June 13, 2017 Communicate Missouri Qualifying Scores

effective for 2017-2018 Review test results throughout 2017-2018 Revisit Results with State Board – Summer

2018

Today’s Discussion

Review Results from 2016-2017 Consider performance of candidates who

have tested so far (for tests with a sufficient number of examinees).

Present each assessment and pertinent data Discuss results Recommendations

Getting to Work

Assessments Grouped By Certification Review Each Assessment @ Panel Based Score Information Presented Includes:

Number Tested Raw Score/Number of scorable Items Focus on Initial Certification Testing Year – August 2016 to February 2017 1st, Best, & All Attempts for 3 Years Missouri Content Assessments – 2014-17

Additional Pertinent Information

A Different Approach

Review Missouri Content Assessments in Groups by Pass Rates 90 to 100 Percent 80 to 89.9% 70 to 79.9% 60 to 69.9 % Below 59.9%

Review Individual Tests as Necessary

MISSOURI EDUCATOR GATEWAY ASSESSMENTS

MISSOURI PERFORMANCE ASSESSMENTS

Missouri Department of Elementary and Secondary Education

Next Steps

MABEP Meeting on May 5 If necessary …….. Report and/or Action Item

DESE Develops Final Recommendation DESE-OEQ Pre-Board Meeting Webinar SBE Meeting – June 13 State Board of Education Meeting Room 1st Floor – Jefferson Building – Jefferson

City DESE-OEQ Post-Board Meeting Webinar

REPORT ON 2016 ANNUAL PERFORMANCE REPORT FOR

EDUCATOR PREPARATION PROGRAMS (APR-EPP)

Missouri Department of Elementary and Secondary Education March 14, 2017

Annual Performance Reports 16

Accredit the certification programs

Provide annual data to guide continuous improvement of certification programs

Inform the public about program quality

Four-Tier Point System

APR Quality Indicators* Possible Points Content Assessment Pass Rate 20 Content Coursework GPA 20 1st Year Teacher Survey 10 Principal – 1st Year Teacher 10

Total Points Possible 60

17

*Two of the four quality indicators are necessary to generate an APR. Each quality indicator must also have 15 or more candidates.

Certification Program Ratings

Five possible ratings Tier 1

(90 to 100%) Performance of the candidates in the program exceeds expectations

Tier 2 (70 to 89.9%)

Performance of the candidates in the program meets expectations

Tier 3 (50 to 69.9%)

Performance of the candidates in the program is approaching expectations

Tier 4 (0 to 49.9%)

Performance of the candidates in the program do not meet expectations

N/A Not Applicable

15 candidates or fewer completed the program in the past 5 years – AND / OR – Data were available for fewer than 2 of the APR indicators

18

Tier 1 Example – Early Childhood Education B-3

20

Quality Indicators & Points Possible Status Points

Content Test (20) 100% 66/66 20

Content GPA (20) NA NA Survey Teacher (10) Participation Rate 68.8%

100% 22/22 10

Survey Principal (10) Participation Rate 53.1%

100% 17/17 *

Total Points Possible (30) 100% Tier 1 30/30

* Insufficient Cell Size or low participation rate

Tier 2 Example – Music: Instrumental K-12

21

Quality Indicators & Possible Points Status Points

Content Test (20) 80% 32/40 14

Content GPA (20) 3.5 GPA 18

Survey Teacher (10) Participation Rate 56.5%

100% 13/13 *

Survey Principal (10) Participation Rate 47.8%

81.8% 9/11 *

Total Points Possible (40) 80% Tier 2 32/40

* Insufficient Cell Size or low participation rate

Tier 3 Example – General Science 9-12

22

Quality Indicators & Possible Points Status Points

Content Test (20) 66.7% 10/15 8

Content GPA (20) 3.4 GPA 16

Survey Teacher (10) Participation Rate 62.5% * *

Survey Principal (10) Participation Rate 50.0% * *

Total Points Possible (40) 60% Tier 3 24/40

* Insufficient Cell Size or low participation rate

2016 APR 1.5 – Results

Total number of “reportable candidates eligible for certification” over the last five years for Missouri is 14,973.

Number of certification candidates in reportable certification areas produced by preparation programs Top 1/3 of Producers – 10,708 candidates

(71.5%) Middle 1/3 of Producers – 3,387 candidates

(22.6%) Low 1/3 of Producers – 878 candidates (5.9%)

25

Performance of Certification Programs Represents 10,708 (71.5%) candidates in 169 certification programs

26

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

MO STATE UNIV- SPRINGFIELD

(2,224)

LINDENWOODUNIVERSITY

(1,461)

MISSOURIBAPTIST

UNIVERISTY(1,409)

UNIVERSITY OFCENTRALMISSOURI

(1,287)

SOUTHEASTMO STATE

UNIVERSITY(1,171)

NORTHWESTMO STATE

UNIVERSITY(944)

UNIVERSITY OFMO -

COLUMBIA(823)

UNIVERSITY OFMO - ST LOUIS

(669)

UNIVERSITY OFMO - KANSAS

CITY(515)

CENTRALMETHODISTUNIVERSITY

(190)

Tier 1

Tier 2

Tier 3

Tier 4

Num

ber o

f Cer

tific

atio

n Ar

eas

27

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

SOUTHWESTBAPTIST

UNIVERSITY(574)

WILLIAMWOODS

UNIVERSITY(458)

DRURYUNIVERSITY

(456)

MO SOUTHERNSTATE

UNIVERSITY(407)

FONTBONNEUNIVERSITY

(381)

TRUMAN STATEUNIVERSITY

(286)

EVANGELUNIVERSITY

(233)

WEBSTERUNIVERSITY

(224)

ROCKHURSTUNIVERSITY

(189)

COLLEGE OFTHE OZARKS

(179)

Tier 1

Tier 2

Tier 3

Tier 4

Performance of Certification Programs Represents 3,387 (22.6%) candidates in 52 certification programs

Num

ber o

f Cer

tific

atio

n Ar

eas

28

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

MO WESTERNSTATE

UNIVERSITY(162)

LINCOLNUNIVERSITY

(141)

COLUMBIACOLLEGE

(137)

MARYVILLEUNIVERSITY

(130)

STEPHENSCOLLEGE

(106)

ST LOUISUNIVERSITY

(77)

PARK UNIVERSITY(65)

AVILAUNIVERSITY

(40)

HANNIBALLAGRANGECOLLEGE

(20)

Tier 1

Tier 2

Tier 3

Tier 4

Performance of Certification Programs Represents 878 (5.9%) candidates in 24 certification programs

Num

ber o

f Cer

tific

atio

n Ar

eas

Continuous Improvement Activities

Review by Certification program & points earned Quality indicator

Annual activities for continuous improvement Analysis of data Curriculum alignment Faculty assignments & evaluations Differences between main campus & satellite

classes Resources – data management & collection

29

Communication

Webinars on February 28 10:00 AM – Educator preparation programs 1:00 PM – Media outlets

Comprehensive Guides Educator preparation programs Current & future students/parents, alumni &

other stakeholders Presentation to CBHE – April 6 @ Lincoln

University

30

Moving Forward

2017 APR-EPP Version 1.5 report

2018 APR-EPP Version 1.5 report and accountability Initiate supports

Version 2.0 draft report 2019 APR-EPP Version 2.0 report and accountability Supports Initiate improvement plans

31

APR 1.5 & 2.0 Workgroup

32

Beth Kania-Gosche (LU) Daryl Fridley (SEMO) James Sottile (MSU) Sankalp Shivaprakash (Missouri) Mike McBride (NWMSU)) Matt Beaver (MSSU) Tammy Mann (CC) Alicia Murillo (AU) Joseph Nichols (SLU) Mark Hogrebe (WU) Nicky Nickens (UCM) Hollie Sheller (DESE-OEQ)

STATE BOARD OF EDUCATION MEETING

OFFICE OF EDUCATOR

QUALITY

CONTENT GRADE POINT AVERAGE

APRIL 18, 2017

Missouri Department of Elementary and Secondary Education

Content GPA Requirement

Standard 4 – Missouri Standards for the Preparation of Educators (MoSPE) Two Measures of Content Expertise Grade Point Average 2.75 Cumulative 3.00 Content 3.00 Professional Education

Praxis II Series or Missouri Content Assessments

34

Content GPA Requirement

35

Change Made Following Comment Period 3.00 Content – Candidates who do not meet

these requirements may demonstrate competency via other measures approved by the board.

Factors in Determining Other Measures Consistency of Measures – ALL Content Areas Purpose of Assessments Setting a Higher Standard Efficient for Candidates, Programs, DESE

Content GPA Requirement

Consistency in Calculating Content GPA Example: Mathematics Grades 9-12 C. Mathematics Content Knowledge Area Total of 36 Semester Hours Calculus & Analytical Geometry (9) Algebraic Structures (3) Geometry (3) Computer Science (3) Electives from Above (6)

36

Content GPA Requirement

C. Mathematics Content Knowledge Area Additional Mathematics Coursework with a

Minimum of 12 Semester Hours/3 Below Completion of Calculus Sequence (3) History of Mathematics (3) Structure of the Real Number System (3) Computer Science (3) Number Theory (3) Probability & Statistics Linear Algebra (3)

37

Content GPA Requirement

Proposed Demonstration of Competency Who? – Candidates who have a GPA Between

2.75 to 2.99 in the Content Area When? – Candidates completing their

preparation program in Fall 2017 and Beyond.

How? Consistency in Calculating Content GPA Using +1 Standard Error of Measure Above

the Missouri Qualifying Score

38

Questions & Comments

What about candidates who did not do well in their “introductory” courses? Is it okay for candidates to take a different course instead of repeating the “introductory “ course? Replacement – MUST be Same Course at the

Same College/University Take Additional Coursework, Cannot

Remove Previous Coursework Importance of EPP Guidelines/Policies

39

Questions & Comments

What about the Missouri Content Assessments with Subtests? Multi-Content Assessments would require a

+1 SEM on all of the subtests for Certification.

What other questions do you have?

40

Next Steps – Content GPA

Advisory Groups MoTEP – March 31

DESE Update & Pre-Board Webinar April 11 @ 9:00 AM

State Board Meeting – April 18 in Jeff City DESE Update & Post-Board Webinar

April 25 @ 9:00 AM Candidates Completing in Fall 2017

41

42

Gale “Hap” Hairston – Gale.Hairston@dese.mo.gov Hollie Sheller – Hollie.Sheller@dese.mo.gov Sandy Jensen – Sandra.Jensen@dese.mo.gov

Marcia Patridge – Marcia.Patridge@dese.mo.gov

Contact Us – 573-751-1668 43