Educator Licensure and Preparation Subcommittee
APRIL 30, 2020
Agenda edTPA Research and Trends in Tennessee 2019 Educator Preparation Report Card TN Department of Education Annual Reports TN Department of Education Updates May Meeting Items Relevant to Licensure and Preparation Final Discussion and Adjourn
edTPA Qualifying Score AnalysisERIKA LE ICHT
What is edTPA? edTPA is a performance-based assessment of teaching developed by the
Stanford Center for Assessment, Learning and Equity (SCALE).
During their student teaching or internship placement, teacher candidates create a portfolio that includes lesson plans, samples of student work and assessments, and videos of the candidate delivering instruction.
Trained scorers who are either P-12 teachers or teacher preparation faculty score each edTPA portfolio.
edTPA is offered in 28 different subject areas. About 80% of the assessment is the same across all subject areas, while the other 20% is subject-specific.
Background
Oct. 2016The Board passed an update to the Professional Assessments Policy (5.105) requiring educator candidates to pass the edTPAperformance assessment as a requirement for licensure beginning January 1, 2019.
Oct. 2018The Board updated the Professional Assessments Policy (5.105) to allow a gradual ramp-up of the edTPA qualifying score from 37 to 42.
Until Jan. 1, 2019Teacher candidates could submit a qualifying score on either the relevant Praxis PLT assessment or edTPA.EPPs could set their own edTPA qualifying score at or above the state minimum of 37.
Jan. 1, 2019edTPA became a requirement for licensure in most endorsement areas. (A few endorsement areas do not have an applicable edTPAassessment. These candidates still take the Praxis PLT.)edTPA qualifying score increased to 38.
edTPA Qualifying ScoresNumber of
RubricsRange of Possible Scores
Qualifying ScoreUntil Dec. 31,
2018Jan. 1, 2019 –Dec. 31, 2019
Jan. 1, 2020 –Dec. 31, 2020
Jan. 1, 2021 and thereafter
13 13-65 32 33 35 3615 15-75 37 38 40 4218 18-90 44 46 48 50
Candidates receive a score of 1-5 for each rubric.Most subject areas have 15 rubrics.World Languages and Classical Languages have 13 rubrics.Elementary Education – Literacy & Mathematics has 18 rubrics.
Data Notes This analysis includes three cohorts: individuals who completed their teacher
preparation program in 2015-16, 2016-17, and 2017-18
Official edTPA scores reported by Pearson
Only tests taken prior to August 1, 2018 are included
Only first attempts are included (less than 2% of test-takers had more than one attempt)
Pass Rates
CohortCombined Praxis
PLT pass rate
Percent of candidates who passed edTPAbased on cut
score of 37
Percent of candidates who
would have passed edTPA at a
cut score of 40
Percent of candidates who
would have passed edTPA at a
cut score of 42
2015-16 94.0% 93.7% 91.1% 87.3%
2016-17 94.7% 95.3% 91.2% 86.8%
2017-18 95.0% 95.6% 91.1% 83.1%
Number of Teachers
Cohort Scored below 37 Scored 37-39 Scored 40-41 Scored 42+
2015-16 75 30 46 1,033
2016-17 61 52 56 1,115
2017-18 66 66 120 1,236
Group Analysis
edTPA Score
Average First-Year Observation Score
Average First-Year TVAAS Score
Average First-Year LOE Score
<37 3.31 2.30 3.28
37-41 3.40 2.54 3.53*
≥42 3.51*ŧ 2.78* 3.64*
* Indicates a statistically significant difference from the <37 groupŧ Indicates a statistically significant difference from the 37-41 group
Diversity Implications
Cohort
All Teachers Average
edTPA Score
White Teachers Average
edTPA Score
Teachers of Color
Average edTPA Score
2015-16Mean: 47.0Median: 46(N=1,149)
Mean: 47.1Median: 47
(N=991)
Mean: 45.4Median: 45
(N=115)
2016-17Mean: 46.9Median: 46(N=1,184)
Mean: 47Median: 47(N=1,055)
Mean: 45Median: 45
(N=98)
2017-18Mean: 46.6Median: 46(N=1,347)
Mean: 46.7Median: 46(N=1,214)
Mean: 46.4Median: 46
(N=125)
On the Praxis PLT, the gap in average scores between white teachers and teachers of color was approximately 5 points (about ½ of a standard deviation) for each of the three cohorts.
Diversity Implications
CohortTeachers Scoring
37+White Teachers
Scoring 37+Teachers of Color
Scoring 37+
2015-16 93.7% 94.4% 87.3%
2016-17 95.3% 95.9% 87.5%
2017-18 95.6% 95.4% 97.1%
Diversity Implications
CohortTeachers Scoring
42+White Teachers
Scoring 42+Teachers of Color
Scoring 42+
2015-16 87.3% 88.5% 76.3%
2016-17 86.8% 88.1% 72.3%
2017-18 83.1% 83.0% 83.2%
National ComparisonCohort National
Average edTPA ScoreTennessee
Average edTPA Score
2015-16 45.0(N=34,786)
47.0(N=1,149)
2016-17 44.7(N=39,566)
46.9(N=1,184)
2017-18 44.3(N=45,365)
46.6(N=1,347)
EPPs Using edTPACohort EPPs with at least 1 edTPA
submissionEPPs with no edTPA
submissions2015-16 11 282016-17 17 222017-18 32 7
As noted earlier, edTPA became a statewide requirement on January 1, 2019. More EPPs began implementing edTPA as this deadline approached.
Comparing Early Implementers to Others
Group
Number of Candidateswith edTPA
scores in 2017-18 Mean Score
Pass Rate based on a
cut score of 37
Pass Rate based on a
cut score of 40
Pass Rate based on a
cut score of 42
Early Implementers 1,000 47.4 98% 93.8% 87.3%
Later Implementers 488 44.8 90.6% 85.7% 74.4%
edTPA in Border StatesState edTPA required? edTPA cut score
Alabama Candidates must pass a performance assessment to qualify for licensure. edTPA is one option.
37
Arkansas Required for the Arkansas Professional Pathway to Educator Licensure (a state-administered alternative certification program).
37
Georgia Yes 38Kentucky No N/AMississippi No N/AMissouri No N/ANorth Carolina Candidates must pass a performance assessment
to qualify for licensure. edTPA is one option. 38
Virginia No N/A
Conclusions When Tennessee’s edTPA cut score increases to 42 on January 1, 2021,
Tennessee will have the highest cut score in the country. Tennessee’s average edTPA score has consistently been higher than the
national average. As the number of people taking edTPA has increased, the average score has
declined slightly. The score gap between white teachers and teachers of color appears to be
closing. EPPs that were early implementers of edTPA have higher average scores and
pass rates. It is likely that other EPPs will improve their average scores and pass rates as they gain more experience supporting candidates through the edTPAprocess.
Next Steps Key question: Should Tennessee continue with its current plan to raise the edTPA
cut score to 42 on January 1, 2021? 42 is the professional performance standard recommended by the makers of
edTPA. However, to account for measurement error, 37-42 is the recommended cut score range.
No state currently has a cut score of 42.
Tennessee’s current cut score of 40 is the second-highest in the nation. Only California has a higher cut score.
2019 Educator Preparation Report CardAMY OWENERIKA LEICHT
Agenda Reasons for 2019 updates
Virtual walk-through of enhanced website
Discuss next steps for 2020 Report Card production
Annual Educator Preparation Reporting A shared data set that is cleaned and coded by a joint SBE/TDOE team and verified by EPPs underlies both reports
State Board of Education Report Cards
High‐level report designed for external
stakeholders
Highlights EPP performance on key state
priority areas
Public accountability mechanism
TDOE Annual Reports
Detailed report designed for program approval process and EPP
continuous improvement efforts
Sets a minimum bar for programs to continue
operation
Failure to meet expectations for two
consecutive years triggers TDOE interim review
Vision for Design Refresh Increase accessibility & usefulness for new stakeholder groups
Education Preparation
Providers
Prospective Teacher
Candidates
Legislators & State-Level
Leaders
School-Level Leaders
Other Community
Groups
District-Level Leaders
New Teacher HiringEducator Preparation Program Selection
Partnerships with area EPPs
Overview of Scoring Framework
Metric Previous Point Value New Point Value
Domain: Candidate Profile 20 20Percent with qualifying ACT, SAT, or all 3 Praxis: CORE scores
3 0
Percent of Racially & Ethnically Diverse Completers 7 10Percent of High‐Demand Endorsements 10 10Domain: TN Employment 15 15First‐Year Employment 6 0Second‐Year Retention 9 9Third‐Year Retention 0 6Domain: Provider Impact 40 40Classroom Observation Score of 3+ 6 9Classroom Observation Score 4‐5 9 6Student Growth (TVAAS) Score 3+ 10 15Student Growth (TVAAS) Score of 4‐5 15 10
Previous Report Card Layout
Online Tour of Report Card Landing Page
Teacher prep Sort, filter, and compare functions State report Report card example: UT-Knoxville New metrics Candidate assessment Candidate satisfaction
Leader prep Example: Lipscomb
Next Steps Gather feedback on updates from partners including EPP faculty, district
personnel, and other stakeholders
Identify trends in the Report Card data to share via follow-up reports or memos
Support EPPs in using Report Card (and Annual Report) data in program improvement
Data collection for 2020 Report Card: April 2020: pull 2018-19 cohort data from TNCompass May – July 2020: EPPs review cohort data and supply additional information July – August 2020: TDOE and SBE staff review and clean data submitted by EPPs Fall 2020: merge cohort data with data on employment/retention, licensure
assessments, and candidate satisfaction
Questions?
TN Department of Education Annual ReportsMICHAEL DEURLEIN
Update and next steps 2019 Annual Reports will be released to EPPs no later than next week
Currently being reviewed for accuracy and IT working to provide secure access via TNAtlas
Metrics have not changed, now have three years of Performance Reports
Comprehensive Reviews have included substantive integration of Annual Reports data
2020 Annual Reports Data collection EPWG feedback on metrics Director of Data and Research vacancy
TN Department of Education UpdatesMICHAEL DEURLEIN AND DAVID DONALDSON
Math Proposal Considering alternative endorsement structures to address challenges in secondary
mathematics
Table provided includes two options for added flexibility with minimal impact on existing preparation programs
Proposal includes the development of a 6-10 Mathematics endorsement that would: Include two pathways (initially) Improve the alignment of assessments and endorsement grade spans Allow educators to teach 6-8 math, Algebra I, Geometry, Integrated Mathematics I and II
This would be the first step in addressing the challenges faced in secondary math
We will be seeking feedback from key stakeholder groups (Educator Preparation Working Group, TOSS, TASPA, etc…) and hope to bring a recommendation in July
Looking Ahead: EPP Recommendations
July will be a heavy month for EPP recommendations 4 state-managed comprehensive reviews Maryville College Bryan College Tusculum University South College
3 CAEP-State Joint comprehensive reviews UT Chattanooga Freed-Hardeman University Carson-Newman University
2 state-managed focused reviews Johnson University Bethel University
First round of recommendations under new state-managed process What documentation would be most useful for the board in July?
May Meeting Items Relevant to Licensure and PreparationAMY OWENMICHAEL DEURLEIN
May Board Meeting ItemsFIRST READING
EPP Rule 0520-02-04-.03 – Permanent
FINAL READING
EPP Rule 0520-02-04-.03 – Emergency
Employment Standards
Licensure Policy
Discussion SBE points of contact: [email protected] [email protected]
TDOE points of contact: [email protected] [email protected]