the teaching performance assessment consortium (tpac) · tpa development timeline 2009-10...
TRANSCRIPT
![Page 1: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/1.jpg)
The Teaching Performance Assessment Consortium
(TPAC)
Raymond Pecheone Professor Of Practice, Stanford University
Stanford Center for Assessment, Learning and Equity (SCALE)
Stanford Center for Assessment, Learning and Equity 2012
1
![Page 2: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/2.jpg)
The Teacher Performance Assessment (TPA) is a student centered multiple measure assessment of teaching.
It is designed to be educative and predictive of effective teaching and student learning
The Cocktail Party Definition
What is the TPA?
Stanford Center for Assessment, Learning and Equity 2012
2
![Page 3: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/3.jpg)
Lineage
National Board for Professional Teaching Standards (NBPTS) portfolio assessments – accomplished teachers
InTasc/ Connecticut BEST assessment system – teachers at end of induction
Performance Assessment for California Teachers (PACT) – pre-service teachers
Stanford Center for Assessment, Learning and Equity 2012
3
![Page 4: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/4.jpg)
Confidential Information – Copyright © 2011
Preservice
Career
Master Teacher
Induction
Collaborative Planning
Instruction Professional
Development
Student Assessment Peer Observation
Lesson Planning
Instruction
Student Assessment Clinical
Observation
Professional Development
Postgraduate Education
Curriculum Development
Model Lessons & Tasks
Coaching & Mentoring
Lesson Planning
Clinical Observation
Instruction Assessment
Level 1 – Area Schools
Level 2 – Lab/PD Schools
Level 3 – Methods Course
Level 4 – Student Teaching
Assessment/ Reflection
Knowledge Building and
Field Experience
Clear Credential
Initial License
Professional Growth
Teacher Life Cycle
![Page 5: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/5.jpg)
Building Blocks for a Teaching Profession
• Ethical and Moral commitment to ALL students
• Agreed Upon Knowledge Base—common set of knowledge/skills
• Standards of Practice are • Defined, Communicated and Enforced
• Professional Certification of Effective Practice –signals the birth of a profession ( state licensure, national and state accreditation).
Stanford Center for Assessment, Learning and Equity 2012
5
![Page 6: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/6.jpg)
Learning Centered Design Principles: Educative Focus Discipline Specific: embedded in curriculum
within and across grade levels
Student Centered: examines teaching practice in relationship to student learning
Analytic: provides feedback and support along targeted dimensions.
Integrative: supports a multiple measures assessment of teaching
Stanford Center for Assessment, Learning and Equity 2012
6
![Page 7: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/7.jpg)
Building a Profession From the Grass Roots: TPA by the Numbers States = 25 Campuses = 180+
Teacher Candidates = 8,000 Scorers (IHE and K-12) = 900 Subject Specific design/review team members (including
national subject matter project representatives) = 120+ Content Validation reviewers = 200+ Benchmarkers and Scoring Trainers = 120 Bias Review Members = 10
Stanford Center for Assessment, Learning and Equity 2012
7
![Page 8: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/8.jpg)
Stanford Center for Assessment, Learning and Equity 2012
TPAC as Part of a Multiple Measures Assessment System
Embedded Signature Assessments
Observation/Supervisory Evaluation & Feedback
Child Case
Studies
Analyses of
Student Learning
Analyses of Curriculum/Teac
hing
TPAC Capstone Assessment
Integration of: Planning Instruction Assessment Analysis of
Teaching with attention to Academic Language
8
![Page 9: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/9.jpg)
TPA Architecture
Stanford Center for Assessment, Learning and Equity 2011
![Page 10: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/10.jpg)
TPA
Records of Practice*
Planning Lesson Plans Handouts, overheads, student work Lesson Commentary
Instruction Video clip(s) Teaching Commentary
Analysis of Teaching Daily Reflection Notes Reflective Commentary
Assessment Analysis of Whole Class Assessment Analysis of learning of 2 students
Instructional and Social Context
3 to 5 Days
Evidence of Academic Language
![Page 11: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/11.jpg)
Alignment with standards Common Core
InTASC
New York State Teaching Standards
Stanford Center for Assessment, Learning and Equity 2012
Endorsement by accrediting bodies NCATE/CAEP
SPAs
11
![Page 12: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/12.jpg)
Rubric blueprint Task name: Rubric Title
Guiding Question
Level 1 Level 2 Level 3 Level 4 Level 5
Struggling candidate, not ready to teach
Some skill but needs more practice to be teacher-of-record
Acceptable level to begin teaching
Solid foundation of knowledge and skills
Stellar candidate
Stanford Center for Assessment, Learning and Equity 2012
12
![Page 13: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/13.jpg)
Rubric Sample Eliciting and Monitoring Students’ Mathematical Understandings
Level 1 Level 2 Level 3 Level 4 Level 5 Candidate talks throughout the clip(s) and students provide few responses. The candidate stays focused on facts or procedures with no attention to mathematical concepts and representations of content.
Candidate primarily asks surface-level questions and evaluates student responses as correct or incorrect. Candidate makes vague or superficial use of representations to help students understand mathematical concepts.
The candidate elicits student responses related to reasoning/problem solving. Candidate uses representations in ways that help students understand mathematical concepts.
Candidate elicits and builds on students’ reasoning/ problem solving to explicitly portray, extend, or clarify a mathematical concept. Candidate uses strategically chosen representations in ways that deepen student understanding of mathematical concepts.
All components of Level 4 plus, Candidate facilitates interactions among students to evaluate their own ideas.
Stanford Center for Assessment, Learning and Equity 2012
13
![Page 14: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/14.jpg)
Targeted Competencies
Stanford Center for Assessment, Learning and Equity 2012
PLANNING • Planning for content
understandings • Using knowledge of students
to inform teaching • Planning assessments to
monitor and support student learning
INSTRUCTION • Engaging students in learning • Deepening student learning
during instruction
ASSESSMENT • Analyzing student work • Using feedback to guide learning • Using assessment to inform
instruction
REFLECTION • Analyzing Teaching Effectiveness
ACADEMIC LANGUAGE • Identifying Language Demands • Supporting students’ academic
language development • Evidence of language use
14
![Page 15: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/15.jpg)
Special Education (inclusive settings and other)
Early Childhood Development Middle Grades (Science, ELA,
Math, and History Social Science)
Art Performing Arts (Music, Dance,
Theater) Physical Education World Language
Stanford Center for Assessment, Learning and Equity 2012
Subject Specific Handbooks Elementary Literacy
Elementary Mathematics
English/Language Arts
History/Social Science
Science
Secondary Mathematics
A generic handbook is also available for use in low incidence areas during the field test (no scoring training provided).
15
![Page 16: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/16.jpg)
“Cultures of Evidence”
Critical and collegial conversations about TPA adoption Inquiry and program improvement (not compliance) as
motivational orientation Strategic inclusion of faculty in examining cases of
candidate performance at regularly scheduled events Affirmation of program values and identity Deepens candidate understanding and practice
– From Peck and McDonald’s Study of PACT
Implementation (2011)
Stanford Center for Assessment, Learning and Equity 2012
16
![Page 17: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/17.jpg)
Program Impact
Course re-alignment and revision o Evidence based performance data o Impact on clinical supervision o Faculty Seminars
Sharper focus o Content and pedagogy o Assessment and student learning in relation to
teacher (InTasc) and student standards(CCS). o attention to content specific academic
language demands.
Collaboration across institutions Stanford Center for Assessment, Learning and Equity 2012
17
![Page 18: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/18.jpg)
National Leadership AACTE overall project management, communication with
programs
Stanford University assessment development and technical support
Council of Chief State School Officers policy development and support, communication
with state education agencies (prior to March 2011)
Stanford Center for Assessment, Learning and Equity 2012
18
![Page 19: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/19.jpg)
Partnering States
Stanford Center for Assessment, Learning and Equity 2012
19
![Page 20: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/20.jpg)
Inquiry?
Stanford Center for Assessment, Learning and Equity 2012
20
![Page 21: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/21.jpg)
Compliance?
Stanford Center for Assessment, Learning and Equity 2012
21
![Page 22: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/22.jpg)
SCALE has exclusive authorship of theTPA Design, Development and Research activities
Serves as Stanford’s operational partner Pearson supports Stanford and AACTE with
quality control, maintaining candidate and student confidentiality and legal defensibility
Pearson enables scale up and sustainability Stanford Center for Assessment, Learning and Equity 2012
SCALE and PEARSON
22
![Page 23: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/23.jpg)
Pearson’s Role in Scale-Up and Sustainability
Web-based services for candidate registration, assembly of artifacts, faculty/supervisor feedback, final submission for official TPA scoring and a score report.
Scoring services – recruitment, and on-line certification of all scorers, scoring for all submitted TPA responses
Reporting services – generation of all official score reports to candidates and institutions of record.
Stanford Center for Assessment, Learning and Equity 2012
23
![Page 24: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/24.jpg)
ESSS 6696 (2009): Beginning in 2011-12, all approved programs must administer to all candidates a TPA specified by PESB. PESB will specify date in 2012-13 when candidates must pass the TPA. WACTE recommended and PEBS accepted TPAC.
SB 1799 (2011): Beginning 9/1/15, candidates must pass an approved TPA for program completion; IHEs must begin phase in 2013-14. Proposed Rule: TPA specified; IHEs cannot require passage prior to 9/1/15 unless required for all candidates
Washington Illinois
State Policy Development
Stanford Center for Assessment, Learning and Equity 2012
24
![Page 25: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/25.jpg)
All teacher candidates at BOR campuses must complete the TPA as a program requirement (as of 2013-14). SBOE 5.105 (2011): Allows programs to substitute TPA for currently-approved pedagogy assessment (Praxis PLT) in 2011-12 and 2012-13.
Program Effectiveness Reports for Continuing Approval (PERCA): Includes input, performance, and program analysis measures; TPA one of three performance measures. Required participation for all candidates in 2012-13. Consequential date TBD by BOT.
Tennessee Minnesota
State Policy Development
Stanford Center for Assessment, Learning and Equity 2012
25
![Page 26: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/26.jpg)
TPA NEXT STEPS
TPA IHE LEAD
MULTI-MEDIA RESOURCES – AACTE ONLINE, IMPLEMENTATION FRAMEWORKS, WEB-BASED ENGAGEMENT
CUNY SCHOLAR IN RESIDENCE: BEV FALK & LEAD FACULTY TO SUPPORT IMPLEMENTATION (face/face)
SUPPORT AND COMMUNICATION PLAN
Stanford Center for Assessment, Learning and Equity 2012
26
![Page 27: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/27.jpg)
APPLE Criteria Redux
Administratively Feasible
Publicly Credible
Professionally Acceptable
Legally & Technically Defensible (Reliability and Validity)
Economically Affordable
27
Stanford Center for Assessment, Learning and Equity 2012
![Page 28: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/28.jpg)
Questions?
Stanford Center for Assessment, Learning and Equity 2011
![Page 29: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/29.jpg)
Field Test Research Agenda Reliability (incld, G-study) **
Content Validity
Construct Validity
Consequential Validity
Bias and Sensitivity Review
Predictive Validity Relationship of TPA to GPA, Content
Knowledge Exams and Value Added metrics (State student assessments) &other measures.
** Reliability of InTasc/Ct portfolio .88 Stanford Center for Assessment, Learning and Equity 2012
29
![Page 30: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/30.jpg)
TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback
from users.
2010-11 Development of six pilot prototypes based on feedback. Piloted in 20 states. User feedback gathered to guide revisions.
2011-12 National field test of 17 prototypes, producing a technical report with reliability and validity studies, and a bias and sensitivity review. National standard setting.
2012-15 On-going field trials and state validation
Stanford Center for Assessment, Learning and Equity 2012
30
![Page 31: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/31.jpg)
SCALE &Pearson’s Role in the Field Test Development Support for Field Testing
SCALE: responsible for authorship of all handbooks, rubrics , training materials, benchmarking and research design
Pearson: Handbook and template publication
Pearson: Recruitment of scorers and scorer compensation
Pearson: Reporting results to states and IHEs
Pearson: Providing an electronic platform to manage TPA submissions.
Pearson: Interface with other E portfolio vendors Stanford Center for Assessment, Learning and Equity 2012
31
![Page 32: The Teaching Performance Assessment Consortium (TPAC) · TPA Development Timeline 2009-10 Small-scale tryout tasks & feedback from users. 2010-11 Development of six pilot prototypes](https://reader033.vdocuments.us/reader033/viewer/2022060802/60869aff12c6e924c0323138/html5/thumbnails/32.jpg)
More Information You can find more information about the NYS
new certification exams, including the TPA on the New York Teacher Certification Exam (NYSTCE) website:
http://www.nystce.nesinc.com/NY_annProgramUpdate.asp#TestSched