A few tips!

Teacher Evaluation System for Floridas Charter Schools

An Overview: The Danielson FrameworkName of School

The Leadership and Learning CenterThis presentation is based on The Danielson Framework and is designed for use by Charter school leaders to help them inform their teachers about the evaluation system the school will use in the coming year. A leader may choose to use the power point as is, or may pick and choose particular slides to use in his or her presentation. It is suggested that the leader make copies of the school teacher evaluation system and have them accompany the slides here. State Department documents including Common Language, FEAPs, High Effect Size Practices, Senate Bill 736, and others related to teacher evaluation are available on the HMH support website to be used with these slides should a leader desire to share them with the staff.1What do we need to know about educator evaluation in charter schools?

Presenter:Share with your team that both leader and teacher evaluation systems are changing in Floridas charter schools. All evaluations had to meet certain criteria in order to be approved for use. Today you will share that criteria, the law and rules set forth by the state of FL related to educator evaluation.Purpose of Evaluation

For the purpose of increasing student learning growth by improving the quality of instructional, administrative, and supervisory services in the public schools of the state, the district school superintendent shall establish procedures for evaluating the performance of duties and responsibilities of all instructional, administrative, and supervisory personnel employed by the school district. Florida Statutes Section 1012.34 (1) (a).This slide makes the point that the purpose for evaluation for leaders and teachers is the same.3This New Approach to EvaluationSupports three processes:

Self-Reflection by the teacher on current proficiencies and growth needs. (What am I good at? What can I do better?)Feedback from the evaluator and others on what needs improvement.An annual summative evaluation that assigns one of the performance levels required by law (i.e., Highly Effective, Effective, Needs Improvement / Developing, or Unsatisfactory).Details on the purpose of evaluation4

Leader & Teacher PerformanceStudent LearningThe underlying purpose of all evaluation systems is to positively impact student learning. When adults get better at their work, students benefit.

Objectives for TodayExamine foundational statutes and rules related to teacher evaluation systemsFEAPs Florida Educator Accomplished PracticesCommon LanguageHigh Effect SizeReview the requirements in the evaluation system Discuss the timelines and logistics for implementation of the system

Presenter-share the objectives for your session. You may edit these to meet your specific needsFEAPs, Common Language and High Effect Size documents may be found on the HMH support website6

Objectives for TodayExamine and discuss the additional metric: deliberate practice Discuss and understand performance metricsValue-added measureInstructional practice

7Todays Agenda Part I: Foundational Information Part II: Requirements Part III: Contemporary Research Part IV: The Danielson Framework Part V: Logistics & SupportFoundational InformationThis section of the presentation will provide participants with foundational information important to understanding whey evaluations are changing and the philosophy upon which they are based.9Rewards states leading the way in comprehensive, coherent, statewide education reform across four key areas:Adopting standards and assessments that prepare students to succeed in college and the workplace.Building data systems that measure student growth and success, and inform teachers and principals how to improve instruction. Recruiting, developing, rewarding, and retaining effective teachers and principals, especially where they are needed most.Turning around their lowest-performing schools.

The state of FL received $700 million in RtTT money the most of any state in the nation. As part of their application, revised evaluation systems for both leaders and teachers is required. The FL legislature deemed that charter schools would be included in the revised evaluation procedures.

Florida worked diligently to bring together broad statewide support from superintendents, school board members, teachers, and teacher associations for the Race to the Top application.

Senate Bill 736: Student Success Act Presenter - you the full text of the bill is available on the HMH support website. Participants may not know the full extent of what is actually required by law in re to evaluation systems.The following slides provide the details from 736 most pertinent to teacher evaluation.

SB 736 Requires

DOE approve school district evaluation systems & monitor for compliance.DOE provide requirements and criteria for evaluation systems.Charter schools comply with provisions related to performance evaluations.Source: p. 1-4 SB 736

SB 736 RequiresDistrict evaluation systems.Support effective instruction & student learning growth.Provide appropriate instruments, procedures, and criteria for continuous improvement.Use data from multiple sources including input from parents.Source: P. 4-5 SB 736

SB 736 RequiresFour levels of performance (highly effective, effective, *needs improvement, unsatisfactory)At least **50% of the evaluation is based on student learning growthBased on contemporary researchIndicators based on each of the FEAPS Source: P. 6-9 SB 736* Can use a developing rating for teachers with less than 3 years experience - this rating is NOT to be used for new leaders**40% is less than 3 years of data is available

SB 736 RequiresDOE annual reports to the public on performance ratings including the percent of teachers and leaders receiving each rating.School reports to parents when their childs teacher or principal has received unsatisfactory ratings for two consecutive years. Source: P. 31 SB 736

SB 736 RequiresThe state Board of Education shall adopt rules to establish uniform procedures for the submission and approval of evaluations of teachers and leaders.Source: P. 9- SB 736

SBE Rule 6A-5.065 The Educator Accomplished PracticesFlorida's core standards for effective educators. The Educator Accomplished Practices are based upon three (3) foundational principles; high expectations, knowledge of subject matter and the standards of the profession

Each effective educator applies the foundational principles through six (6) Educator Accomplished Practices. Each of the practices is clearly defined to promote a common language and statewide understanding of the expectations for the quality of instruction and professional responsibility.

Presenter- the full text of FEAPS is on the HMH support website.

The Florida Educator Accomplished Practices (FEAPs) are Florida's core standards for effective educators and provide valuable guidance to Florida's public school educators and educator preparation programs throughout the state on what educators are expected know and be able to do. The Educator Accomplished Practices are based upon three (3) foundational principles. Those principles focus on high expectations, knowledge of subject matter, and the standards of the profession. Each effective educator applies the foundational principles through six (6) Educator Accomplished Practices. Each of the practices is clearly defined to promote a common language and statewide understanding of the expectations for the quality of instruction and professional responsibility.

Teacher Evaluation Requirements

Part II provides teachers with the requirements upon which your evaluation system was built.19

Florida Educator Accomplished Practices (FEAPS)In this slide, the apple represents education in general, and the orange represents education in FL. There are specific understandings about effective educator practice that the state of FL requires all educators to know and follow. Understanding these practice as described in FEAPs in critical to the success of all teachers and leaders. Presenter- you may want to have the full document available for teachers and create a learning activity around for deep understanding. The Common Language Project is a process to refine conversations in ways that increase the clarity of exchanges and deepen common understanding of the work in progress. ADMR TM (p.40)

Common Language of InstructionClearly stated in FEAPs is the desire to have a common language of instruction throughout the state of Florida. The next few slides address the common language content and goal. The full Common Language document is available on the HMH support website. You may want to have copies available and engage teachers in an activity which requires that they dig into the document.

21Common Languagea tool of master practitioners in any profession that is used to facilitate effective communications about the essential concepts and practices of the profession.

From the Common Language doc

Common language" is a tool of master practitioners in any profession that is used to facilitate effective communications about the essential concepts and practices of the profession. Consensus within a group of practitioners on the specific meaning of terms and expressions is used to provide feedback for improvement of proficiency on important job functions and in deepening understanding of the priority practices, standards, and goals of the profession. There are over 200 terms defined and clarified in the Common Language document.Causal Instructional Strategies

Key strategies revealed by research to have the highest probability of impacting student learning when used appropriately and in appropriate instructional contexts. These are the controllable actions in a school that impact student learning. DOE Form No. EQEVAL-2012-4

ADMR TM (p.40)

Examples of Common Language Causal instructional strategies is a term pulled from the common language document. It is a term that is used often in both leader and teacher evaluation systems.

23Learning Goal(s)

A learning goal is a statement of what learners will know and/or be able to do. In teaching situations, effective teachers state learning goals in a rubric (or scale) format where ascending levels of proficiency of the goal are specified. The rubric form guides learners in self-assessment of progress toward mastery of the goal and guides teachers in tracking student progress and providing feedback on progress toward accomplishing the goal.

DOE Form No. EQEVAL-2012-4

ADMR TM (p.40)Examples of Common Language

Another term from the Common Language document appears on this slide. Learning goals with scales are a large part of teacher evaluation and it also has a significant presence in the leader evaluation. It is important for all teachers and leaders to become familiar with the terms in the Common Language document so that everyone understands what is expected of them.

Presenter- you may choose additional or different words to focus on based on your context and work as a school.

24High-Effect Size PracticesContemporary research reveals a core of instructional and leadership strategies that have a higher probability than most of positively impacting student learning in significant ways.

Florida also has an focus on instructional staff using high effect size practices. This document applies equally to leaders and teachers. Using contemporary research, the state defines high effect size practices and provides suggestions for what these practices include.This High Effect Size document is also available on the HMH support website for your use in training. It is suggested that some time be spent on high effect size practices in multiple trainings throughout the year. In addition to the state document, Robert Marzanos Art and Science of Teaching, and John Hatties Visible Learning are two great sources of information on the topic. High-Effect Size Strategies

Are components within the core standards and expectations described in the FEAPs (Rule 6A-5.065, F.A.C.) and FPLS (Rule 6A-5.080, F.A.C.) and constitute priority issues for faculty development and deliberate practice. A listing of these high-effect size strategies will be posted for district use on www.fldoe.org/profdev/pa.asp.

According to the DOE High effect size is defined as seen on the screen. Source: PPT presented in Orlando Jan. 2012 by John Moore on completing the state checklist.High-Effect Size Practices

Classroom teachers need a repertoire of strategies with a positive effect size so that what they are able to do instructionally, after adapting to classroom conditions, has a reasonable chance of getting positive results. The quote here is pulled directly from the state document on high effect size practices. The visual is from Hatties Visible Learning. The barometer on the screen illustrates the various effect sizes and impact they have on student learning. Negative ES means that students actually loose ground in their learning when these practices are used. For example- summer vacation has a negative impact on student learning. They actually loose ground when they go home for the summer. It is highly recommended that every school have a copy of the groundbreaking book.

What works BEST?

Hattie, J. (2009) Visible Learning. Rutledge. New YorkThe zone of desired effects, in the blue, illustrates the impact of high effect size practices when used consistently and with fidelity. A 0.40 ES will give you better than average results. A 0.60 ES and higher will give you 2-3 years of learning in one years time. The research on high effect size practices helps us maximize the effects of our teaching. We are not seeking what works, rather, we are seeking what works BEST. More info on this can be found in Hatties book

Contemporary Research on Teacher Evaluation

Part III explores what research forms the foundation for teacher evaluation in Florida. The next 6 slides have excerpts from the state document to illustrate the research base for the evaluation structure and requirements. Contemporary research is defined as research from 2000 to the present. Much has been learned from numerous studies on development, growth and learning of teachers through evaluation systems. The primary sources of information come from research from Marzanos Lab and Charlotte Danielsons Framework for Teaching. The state of FL took parts of both to create a comprehensive system. The State document on Research Frameworks is on the HMH support website. The following slides provide more detail on this.

29

Research frameworks pre-approved by the Department are:Based on contemporary researchAligned with the Student Success Act, the FEAPs or FPLS, as appropriate

Presenter: The key word here is pre-approved. If schools opted to create their own models, they would need to provide the research framework like the one provided by the state to support the system and show the alignment to SB 736, FEAPs and FPLS. Research Frameworks for Instructional Evaluation

Behavioral Framework

Based on research and meta-analyses by Dr. Robert Marzano, Dr. John Hattie, and other research findings that identify instructional strategies or behaviors that, done correctly and in appropriate circumstances, have a positive probability of improving student learning.

This information was pulled from the Departments document on Research Frameworks which is available for your use. This slide provides just an overview of the approach FL is taking with their eval systems. More on the framework can be found on Marzanos website.Constructivist Framework

Based on research and meta-analyses by Dr. Charlotte Danielson, Dr. Albert Miller, and other research findings that focus on principles and methods of instruction designed to generate knowledge and meaning from an interaction between their experiences and their ideas.

Another approach is known as the Constructivist approach. More info is available on Danielsons website.Based on a merger of both Behavioral and Constructivist insights into quality instruction. Relies on Behavioral Framework strategies to establish a core repertoire of teaching competencies and Constructivist methods for planning instructional units, collegial work on adapting core strategies to local conditions, and deliberate practice work for deepening expertise.

Comprehensive Framework

This model represents a effective blend of the two models and defines the approach FL decided to in re to teacher evaluation. The evidence and current literature supports this decision.

The Florida criteria for evaluation relies on:

Behavioral Framework strategies to establish a core repertoire of teaching competenciesConstructivist methods for planning instructional units, collegial work on adapting core strategies to local conditions, and deliberate practice work for deepening expertise

Presenter you may want to go deeper into this topic in which case you could ask for your teachers to engage in reflection and group discussion____ Charter School Evaluation ModelThe Danielson FrameworkPart IV- Your Model- The Danielson Framework. Put your school name on the slide. This begins the discussion about the evaluation model you are using.35

A recently published study of a two-year pilot program in Chicago Public Schools has documented the benefits of this approach. Researchers at the Consortium on Chicago School Research at the University of Chicago, aim to accurately measure a teacher'sclassroom performance.

As members of the Danielson Group have observed after working with in hundreds of school districts to enhance professional practices, It's all about the conversation.Danielsons Framework for TeachingPresenter: Below is information on recent research supporting the Danielson Framework as a viable and effective means to evaluate teachers from a growth perspective.

A recently published study of a two-year pilot program in Chicago Public Schools has documented the benefits of this approach. Conducted by researchers at the Consortium on Chicago School Research at the University of Chicago, the Excellence in Teaching Project aims to accurately measure a teacher'sclassroom performance. The project is the proposed replacement for a teacher evaluation checklist that administrators have used in Chicago Public Schools for the past 30 years. Principals in the pilot used the Framework for Teaching to guide their classroom observations as well as the required pre-observation and post-observation conferences. The pilot provides an insight into the perceptions of participating teachers and administrators, who signaled the following areas as being crucial to effective teacher evaluation:A consistent definition of good teaching. For a teacher evaluation system to be transparent and credible, everyoneboth teachers and administrators must understand what constitutes good practice. Unless principals participate in focused training, they probably will not have this understanding. But they appreciate acquiring that knowledge. As one principal noted, "The thing I like about the framework is that it actually makes you cognizant of the behaviors that constitute excellence in teaching."Opportunities to engage in meaningful conversations about practice. As members of the Danielson Group have observed after working with teachers and administrators in hundreds of school districts to enhance professional practices, "It's all about the conversation." Noted one teacher, "You get to close the door, turn off the noise, and actually sit and talk [with your supervisor], which is really, really nice."A focus on what matters. Both teachers and administrators appreciate an opportunity to concentrate their collective attention on the important issues of teaching and learning. These typically occur in the post-observation (reflection) conference. As one principal pointed out, "The conversation is entirely different. My conversation before was 'You were tardy,' 'You didn't turn in your lesson plans,' all those kinds of things. Now this conversation is about good instruction."Evaluations That Help Teachers Learn Two in OneThe challenge is merging the two purposes of teacher evaluation. A system to ensure quality must be valid, reliable, and defensiblethese are hard sounding qualitieswhereas a system designed to promote professional learning is likely to be collegial and collaborativethese are much softer sounding qualities.The profession is better served when the requirements for these two purposes are embedded in the design of the systems themselves. Charlotte Danielson

Educational LeadershipDecember 2010/January 2011 | Volume 68 | Number 4Quote from: Educational LeadershipDecember 2010/January 2011 | Volume 68 | Number 4The Effective Educator Pages 35-39Evaluations That Help Teachers LearnCharlotte DanielsonThe challenge is merging these two purposes of teacher evaluation. Educators need to create procedures that yield valid and reliable resultsthat is, that satisfy the legitimate demands for quality assurance while promoting professional learning. In truth, the demands are somewhat different. A system to ensure quality must be valid, reliable, and defensiblethese are "hardsounding" qualitieswhereas a system designedto promote professional learning is likely to be collegial and collaborativethese are much "softersounding qualities.Until recently, educators' attempts at merging quality assurance with professional learning have taken the form of enhancing evaluators' skills using techniques like clinical supervision and cognitive coaching. These are valuable skills and worth learning, but they are insufficient. The profession is better served when the requirements for these two purposes are embedded in the design of the systems themselves.

The Florida Evaluation System for Teachers shouldReflect teacher performance across all elements (4 domains)Account for teachers experience levelsAssign weight to the domain with greatest impact on student achievement Acknowledge deliberate practice by measuring teacher improvement over time on specific elements within the frameworkThese are the non-negotiables for teacher evaluation they are required by the state.Florida Approved ModelDanielson Framework for TeachingDomain 1: Planning and Preparation1a Demonstrating Knowledge of Content and Pedagogy1b Demonstrating Knowledge of Students1c Setting Instructional Outcomes1d Demonstrating Knowledge of Resources1e Designing Coherent Instruction1f Designing Student Assessments

6 elementsDomain 2: Classroom Environment2a Creating an Environment of Respect and Rapport2b Establishing a Culture for Learning2c Managing Classroom Procedures2d Managing Student Behavior2e Organizing Physical Space

5 elementsDomain 3: Instruction3a Communicating With Students3b Using Questioning and Discussion Techniques3c Engaging Students in Learning3d Using Assessment in Instruction3e Demonstrating Flexibility and Responsiveness5 elementsDomain 4: Professional Responsibilities4a Reflecting on Teaching4b Maintaining Accurate Records4c Communicating with Families4d Participating in a Professional Community4e Growing and Developing Professionally4f Showing Professionalism

6 elementsTotal 22 Elementshttp://www.highlands.k12.fl.us/sbhc/The Danielson Group: www.danielsongroup.orgThe Danielson model with 4 domains and 22 elements are illustrated on this slide.

Teacher Evaluation MetricsInstructional Practice 50%The teachers performance on the 4 domains and 22 elements result in what the state calls a Status Score. The Status Scores counts 30% of the overall summative evaluation. The Status Score gets added to the Deliberate Practice score and combined becomes the Instructional Practice score which accounts for 50%, or half of the summative score at the end. The remaining 50% comes from student growth.

In the next few slides we will learn about deliberate practice and how it will work in our school.Deliberate Practice for TeachersTeachers take the leadCollaborate with the principal to identify personal growth goalsLeaders provide structure, resources, and feedback for ongoing practice

The end result is year-to-year development of instructional expertise giving rise to improved student achievement year-to-year.

Deliberate practice is a term from contemporary research which indicates practice on a very specific skill which will make the overall performance much more effective. Many writers such as Fullan, Marzano, Dan Pink, Geoff Colvin, Doug Reeves and others define deliberate practice as thin slices of work that help a person become a master at their craft. They say it takes 10,000 hours to become a master! In the state of FL, deliberate practice goals serve as an additional metric in the evaluation system. It fulfills that constructivist piece of the comprehensive evaluation system. As we work to learn more about deliberate practice, it is important to keep a few things at the forefront of our thinking. These things are on the slide. DP is similar to the professional growth plans we have done in the past, but DP goes deeper and is monitored more closely for success on stated targets.Deliberate Practice ProtocolThe process of deliberate practice, as intended, is an ongoing process, with multiple interactions between teachers and evaluators. Show teachers the form(s) you will be using at your school. Explain your process of DP, how it will be scored and the timeline associated with the implementation.Presenter: you might ask teachers this question: What, if anything, distinguishes this approach from the typical professional development plan?State Model Evaluation MetricsInstructional Practice 50%Source: SB 763, 2011So on the slide, you see again that DP accounts for 20% of the Instructional Practice score which counts 50% in the overall summative score at the end of the year.

Student Growth Measure?The Student Success Act requires the inclusion of student learning growth measures in teacher evaluations, and it tasks the education commissioner with identifying and implementing student growth models.

Student growth measure accounts for the remaining 50% of the evaluation and is required in the law. The law tasked the DOE with coming up with a model which would fairly evaluate the impact of teacher on student learning.

The Department put together a work group which including researchers from American Institute of Research (AIR), researchers and psychomatricians from Pearson, as well as DOE staff, teacher unions and other stakeholders.

They decided on a Value-added Model. (VAM) This model uses a co-variant process to separate or isolate the impact of the teacher from the other influences on student achievement.

See next slide

The Value-Added Model (VAM)Value-added is a statistical model that uses student-level growth scores to differentiate teacher performance in the area of student learning growth.

The model takes into account other factors that may impact the learning process. These covariates include: prior achievement scores, disability status, mobility, ELL status, attendance, class size, number of subject relevant courses taken, and others. Prior years achievement is the strongest predictor among them. The prior achievement data is combined with other measured student characteristics- the covariates- to form the predicted performance of the student.

The Value-Added Model (VAM)A students predicted performance serves as the target. A student who meets or exceeds his target has a positive impact on the teachers evaluation, and a student not making his target has a negative impact.

The listed covariates are run through the statistical model to establish a predicted, or expected performance level for each student. The model is substantially different than other models that may evaluate teachers based on a single year of student performance or evaluate teachers based on simple comparisons of student growth from one year to the next. Some of the covariates lower the students expected performance level while others raise it.

The Value-Added Model (VAM)The percent of students whose performance is equal to or higher than predicted forms the foundation for the student growth score in the evaluation system.

How a teacher or leader scores is determined is based on the % of students meeting or exceeding their predicted score. A student who meets their expected performance level has a VAM score of 0. When the student exceeds their predicted performance, their score is a positive over 0. When a student scores below their predicted performance, their VAM is a negative below 0. See next slide for a visual.VAM Scores

Students who meet their expected performance levelStudents who fall below their expected performance levelStudents who exceed their expected performance levelHow a teacher or leader scores is determined is based on the % of students meeting or exceeding their predicted score. A student who meets their expected performance level has a VAM score of 0. When the student exceeds their predicted performance, their score is a positive over 0. When a student scores below their predicted performance, their VAM is a negative below 0.The higher % of the VAM scores at 0 or higher, the higher score for the teacher on the student growth portion of the evaluation system.The final VAM number provided to the teacher is a combination of all of the VAM scores for the students he or she is measured by.

The Value-Added Model (VAM)This overall percent is transferred to a scale which provides a rating for the teacher at highly effective, effective, needs improvement/ developing, or unsatisfactory.

Each district creates their own scale ranges based on scores in the positive and scores in the negative and relates those ranges to a rating of highly effective, effective, Needs improvement or unsatisfactory. That may be changing, as the state is considering creating VAM score ranges and their ratings equivalency that will be the same for all schools. Escambia County has a good scale on their E3 website as an example. They are also using the Danielson Framework.Recorded Webinar for Charter Schools with Kathy Hebda, Deputy Chancellor for Education Quality, and Adam Miller, Charter Schools Director, on the Florida Value-Added Model (VAM) is available at http://www.floridaschoolchoice.org/Information/Charter_Schools/ (bottom of page). This presentation provides an overview of Floridas Value-Added Model and how it should be used for teacher evaluations.

FloridasValue Added Model

Presenter- you may want to have your staff watch the DOE webinar which was created specifically for charter schools. This might clear up some of the questions and confusion around how they are scored. It is suggested that all leaders watch the webinar before they present VAM to their teams.50State Model Evaluation MetricsInstructional Practice 50%Source: SB 763, 2011This graph depicts the student growth metric at 50% of the overall summative rating. It is added to the Instructional Practice score for a total of 100%. This formula is to be used for all instructional staff in the school including the leaders, library/media specialists, counselors, coaches, etc. Presenter: you might ask the group how this scoring process is similar or different from practices in the past. Lead a discussion using their comments. LogisticsHow will our system work?Part V- this section of the presentation is intended for leaders to share the nuts and bolts on how their system will work. Who will do what by when? What will teachers do at various points in the year? What should they expect from the leader in the way of support? How will they receive feedback? What forms will be used? And so on. Presenters should share all of the information in their approved model, and should share the details at this point in the presentation with the staff. 52Implementation Components & TimelinesDuring the summer or early fallThroughout the YearEnd of first semesterEnd of YearThis graphic is a basic depiction of the evaluation process on a annual basis. It is suggested that specific dates be added to the graphic and details unique to your system be shared.53Our Plan to Support Teacher Learning and Development

This slide is intended to prompt presenters to lay out the professional development plan for the year which will build capacity of the staff to perform well on the evaluation domains and elements. Each schools plan will be different, based on their current status, needs, challenges and focus. Presenters should add slides here to highlight major components of the plan.54

Once all of the prior information has been shared, teachers will be curious about what comes next. What is the first thing they should do and what will be the first thing their leader will do to implement the cycle. One of the first steps after this orientation session, should be the completion of the self-assessment. Teachers should be given instructions on how to complete the self-assessment, by when, and submitted to whom? They should also have some indication when conferences will be held to go over the results with their supervisor.55Questions & Reflection