benedict ssest reg institute presentation final · district or school’s work in indistar. this...
TRANSCRIPT
11/6/13
1
Monitoring and Evalua3ng Turnaround Efforts
Stephanie Benedict Academic Development Ins3tute Center on School Turnaround
Monitoring SIG …
Lagging
Indicators
Interven0ons
Leading Indicators
11/6/13
2
Leading Indicators
1. Number of minutes within the school year
2. Student par3cipa3on rate on state assessments in reading/language arts and in mathema3cs, by student subgroup.
3. Dropout rate
4. Student aMendance rate
5. Number and percentage of students comple3ng advanced coursework (e.g., AP/IB), early-‐college high schools, or dual enrollment classes.
6. Discipline incidents
7. Truants
8. Distribu3on of teachers by performance level on LEA’s teacher evalua3on system
9. Teacher aMendance rate
Lagging Indicators
1. Number of minutes within the school year
2. Student par3cipa3on rate on state assessments in reading/language arts and in mathema3cs, by student subgroup.
3. Dropout rate
4. Student aMendance rate
5. Number and percentage of students comple3ng advanced coursework (e.g., AP/IB), early-‐college high schools, or dual enrollment classes.
6. Discipline incidents
7. Truants
8. Distribu3on of teachers by performance level on LEA’s teacher evalua3on system
9. Teacher aMendance rate
11/6/13
3
Interven3ons
Implementa3on & Monitoring
Indicators
Assess
Create Plans -‐Tasks -‐Timelines -‐Responsibili3es
Monitor/ Implement -‐Evidence
-‐Sustainability
District Liaisons and/or School Consultants can monitor implementa3on and quality of each school’s work u3lizing: • Coaching Comments • Coaching Reviews • Coaching Cri3ques
State Administrators can monitor implementa3on and quality of each school’s work u3lizing: • State Feedback
11/6/13
4
Coaching and Feedback
Coaching Comments should be specific comments and/or sugges5ons in rela5on to an indicator or area of leadership team planning (e.g., team mee5ngs, forms, updates).
Coaching Review enables the coach to scan a variety of
reports in order to create an overall review of the leadership
team’s progress.
Coaching Cri0que enables the coach to address a specific set of ques5ons, set by the state, rela5ve to the leadership
team’s progress.
State Feedback enables state administrators to address a
specific set of ques5ons, set by the state, rela5ve to each leadership team’s progress.
Con3nuous Improvement
Leadership Teams meet regularly (twice per month)
Indicators: Assess, Plan, Monitor,
Implement, and Adjust
Track Leading Metric Data
Track Lagging Metric Data
Receive ongoing coaching support
and state feedback
Create annual goals to meet
interven3ons; 3e into Indicator
work
11/6/13
5
Tools for Monitoring Implementa3on and
providing State Feedback
State Administra3on level
• View mul3ple school years • View district submissions • View school submissions by ‘groups’ of schools (SIG, Priority, Focus, etc.) • Run and export State level reports • Review individual school or district forms • Data mine evidence, plans, login ac3vity, and coaching ac3vity • Drill down to individual school or district dashboards • Provide state feedback to schools and districts
• View mul3ple school years • View district submissions • View school submissions by ‘groups’ of schools (SIG, Priority, Focus, etc.) • Run and export State level reports • Review individual school or district forms • Data mine evidence, plans, login ac3vity, and coaching ac3vity • Drill down to individual school or district dashboards • Provide state feedback to schools and districts
11/6/13
6
District submission summary
School submission summary
11/6/13
7
PDF links to all submiMed reports
Drilling down to a district dashboard
11/6/13
8
Drilling down to a school dashboard
Providing State Feedback
11/6/13
9
State Level Reports
Reports and descrip3ons
11/6/13
10
Implementa3on Report
School Drilldown Report
11/6/13
11
Coaching Ac3vity Report
Coaching Comment Log
11/6/13
12
School Aggregate Report
Data Mining
11/6/13
13
Data mining for specific indicator and plan details
Tools for Coaching And Providing Feedback
11/6/13
14
View reports, comments, quick score, meeting minutes, etc.
Choose Coaching Review
Coach’s critique or state feedback using state questions
Coach’s comments
Coach’s review
Coaching Comments and Reviews
• The “Coaching Review” link enables the coach to scan a variety of reports while entering a “coaching review” or “coaching comment.” When a coach enters a coaching comment or coaching review, the principal and process manager receive an email alert, and a dialogue can be created with the coach within Indistar maintaining documentation of the conversation.
11/6/13
15
Coaching Review Reports
• Summary Report... summary report of all work, information and activity that a school or district team has completed.
• Comprehensive Report...detailed report of all assessments, plans, and monitoring information.
• Comments & Reviews...Coaching comments, reviews and responses; history and ability to send or respond anew.
• Task Report...detailed list of all tasks created. • Where Are We Now...overview of a school or district’s plan, in graph form. • Team Meetings... agendas and meeting minutes as entered by the school or district. • Quick Score Report...a quantitative rating summary of the school or district’s
progress, based on key factors within the tool. • Coaching Critique/Feedback…an electronic form used by coaches and/or state
administrators to add a standardized assessment of the quality of work of the school or district team. Critiques are a series of questions or items, determined by the state.
Coaches move through each tab, checking... 1. Recent activity....login activity, meetings and agendas, chart progress in the Where Are We Now report. 2. Quantity of work...has the school or district completed what is expected of them? Summary Report has a list of recent dashboard submissions as well as an indicator count for the assessing and planning pieces. 3. Quality of work...in the Comprehensive Report, the coach will be able to see levels of implementation as well as evidence provided for each indicator or objective 4. Responses to Coaching Comments or Reviews 5. Critique or Feedback information sent to the school or district by the state or other coach(es). Coaches provide feedback using the Coaching Review and Coaching Comments.
11/6/13
16
Coach’s critique and state feedback
• The state may choose to add one or both of two optional coaching features to Indistar. Coach’s Critique enables the state to determine a set of questions or items for the coach to address relative to the district or school’s work in Indistar. This report is then viewable by states, districts, and/or schools.
• State Feedback works the same as a Coach’s Critique but is completed by SEA staff rather than the coach. The Coach’s Critique and State Feedback are ways to add a standardized assessment of the quality of work.
• Once a feedback or critique form has been submitted to a school or district, a copy is also visible to the state, coaches, district, and school.
The state completes the Feedback form by drilling down to a school or district’s Coaching page, from the state administration page. The state will then complete the Feedback form and submit a copy to the school or district. All levels (coaches, districts) will have view-only access of the form as submitted by the state.
For the Coaching Critique, coaches will be able to access the form as set up by the state, via the Coaching Review page. The coach will then complete the Feedback form and submit a copy to the school or district. All levels (state, coaches, districts) will have view-only access of the form as submitted by the coach.