wsu sod findings apr 25 09

60
C E N TE R F O R E D U C A T IO N A L EF F E C T IV E N E S S , IN C. Schools of Distinction What Makes Them Distinct? C E N TE R F O R E D U C A T IO N A L EF F E C T IV E N E S S , IN C. Greg Lobdell Co-founder & Director of Research Center for Educational Effectiveness [email protected]

Upload: wsu-cougars

Post on 11-Nov-2014

633 views

Category:

Education


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Schools of DistinctionWhat Makes Them Distinct?

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Greg LobdellCo-founder & Director of Research

Center for Educational [email protected]

Page 2: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

• Field-based research, service, and data-centric tools to support School & District Improvement

• Partnerships with 700 Schools in 135 districts– What we do & how we do it varies based on serving districts from 80

students K-12, to districts over 30,000 K-12

• Assist all schools & districts in OSPI School, District, & Summit District Improvement programs

• Assist all districts in Idaho’s “Building Capacity” K-12 District Improvement Program

Center for Educational Effectiveness

Page 3: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

On-going Investment• The Repository: >280,000 Educational

Stakeholders– EES-Staff: 55,857 staff– EES-Student: 164,029 students– EES-Parent: 60,592 parents– 26% of parents and 30% of students indicate English is not their

primary language at home

• Representing– 642 Unique Schools– 122 Unique Districts

• Open to doctoral candidates for research purposes

Page 4: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Today’s Outcomes• Introduction: Who are the Schools of Distinction -

How are the award winners selected?– Why does this matter to me? Reflection…

• Findings– Highlights: Repeat winners vis-à-vis State sample– Application- What’s happening in my school?

• Implications & application: Reflection on change processes

Note: SOD == Schools of Distinction

Page 5: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Schools of Distinction: Selection

• Combined Reading and Math Learning Index

• View of improvement over 5 years (2003 to 2008)– Grades 4, 7, and 10 only

• Winners: Top 5% of each grade band

Page 6: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C . 6

Performance: Learning Index

• Based on the 4 Levels of WASL Performance• Can be applied to any of the WASL Sub-tests

1 x % at Level-12 x % at Level-23 x % at Level-3

+ 4 x % at Level-4------------------------------

= Level Index

Page 7: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C . 7

Level Index of 2.5

LI= (1 x .25) + (2 x .25) + (3 x .25) + (4 x .25)

For ExampleWASL Math- % of Students by Level

Page 8: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C . 8

Level Index of 3.0

LI= (1 x .10) + (2 x .10) + (3 x .50) + (4 x .30)

Another ExampleWASL Math- % of Students by Level

Page 9: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Elementary Schools RMLI 2002-03

WA State Grade 4: RMLI '02-'03 Baseline

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Percent Poverty

Re

ad

ing

/ M

ath

Le

arn

ing

Ind

ex

WA 4th Grade

2008 Schools of Distinction

Page 10: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Elementary Schools RMLI 2008

WA State Grade 4: RMLI 2008

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Poverty

Re

ad

ing

/ M

ath

Le

arn

ing

Ind

ex

WA 4th Grade

2008 Schools of Distinction

Page 11: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Middle Schools RMLI 2002-03

WA State Grade 7: RMLI '02-'03 Baseline

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Percent Poverty

Re

ad

ing

/ M

ath

Le

arn

ing

Ind

ex

WA 7th Grade

2008 Schools of Distinction

Page 12: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Middle Schools RMLI 2008

WA State Grade 7: RMLI 2008

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Percent Poverty

Re

ad

ing

/ M

ath

Le

arn

ing

Ind

ex

WA 7th Grade

2008 Schools of Distinction

Page 13: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

High Schools RMLI 2002-03

WA State Grade 10: RMLI '02-'03 Baseline

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Percent Poverty

Re

ad

ing

/ M

ath

Le

arn

ing

Ind

ex

WA 10th Grade

2008 Schools of Distinction

Page 14: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

High Schools RMLI 2008

WA State Grade 10: RMLI 2008

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Percent Poverty

Re

ad

ing

/ M

ath

Le

arn

ing

Ind

ex

WA 10th Grade

2008 Schools of Distinction

Page 15: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Award Winners: Who Are They?

2008 Schools of Distinction 53 elementary, 21 middle, 20 high schools and 7 alternative schools ESDs: at least 3 winners in all 9 ESDs. 65 from Western WA, 31 from Eastern WA Poverty Ranges: 1% to 82% ELL Percentage: 0% to 31% % Non-white enrollment: 0% to 70%

Title I School wide: 40 buildings Did Not Meet AYP: 40 buildings

2008 Repeat Winners 14 elementary, 3 middle, 4 high schools (no alternative repeat winners) Repeat winners in 7 different ESDs. 14 from Western WA, 8 from Eastern WA Poverty Ranges: 5% to 69% ELL Percentage: 0% to 26% % Non-white enrollment: 1% to 57% Title I School wide: 8 buildings Did Not Meet AYP: 10 buildings

Page 16: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

In the field this looks like…

East Port Orchard Elem

South Kitsap SDPoverty: 48.4%

Students of color: 28%

ELL: 2%

Page 17: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

WASL 4 Reading: Percent of Students by Level

31%44% 52% 45% 49% 48%

36%

-38%-23% -17% -11% -19% -11% -20%

-11%

-6%-5%

-9%-4%

-7%-3%

19%

25%25% 36% 28% 33%

41%

2002 2003 2004 2005 2006 2007 2008 2009 2010

20%

40%

60%

80%

MeetingStandard

100%

49% NOT meeting standard to77% MEETING standard

All Schools of Distinction accelerated Reading and . . .

Page 18: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

WASL 4 Math: Percent of Students by Level

-30%-39%

-23%-33% -26%

-11% -16%

-35% -13%

-16%-15% -22%

-19%-22%

27% 25% 31% 22% 30% 30% 30%

8%22%

31%30% 23%

39% 33%

2002 2003 2004 2005 2006 2007 2008 2009 2010

20%

40%

60%

80%

MeetingStandard

100%

. . .accelerated Math as well.

65% NOT meeting standard to63% MEETING standard

Page 19: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

The Center for Educational Effectiveness, Inc.www.effectiveness.org

Organization

StudentLearning

The Center for Educational Effectiveness, Inc.www.effectiveness.org

Organization

StudentLearning

Page 20: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Reflection

• Given the Nine Characteristics of High Performing Schools

• Stack Rank Exercise

Page 21: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Stack Rank Your SchoolStack Rank the following-- from 1 (Best) to 10

Step 1 Step 2 Step 3

CharacteristicMy Building-

Positive Reflection by our Staff

Repeat Schools of Distinction- Positive

Staff Reflection

Where's the Largest GAP between My Building and Schools of Distinction Notes

Clear and Shared Focus        

Collaboration for Student Learning        

Community & Parent Involvement        

Effective Leadership        

Focused Professional Development        

High Quality Curriculum, Instruction, and Assessemnt

       

High Standards and Expectations        

Monitor Teaching and Learning        

Readiness to Benefit        

Supportive Learning Environment        

Page 22: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Stack Rank Your SchoolStack Rank the following-- from 1 (Best) to 10

Step 1 Step 2 Step 3

CharacteristicMy Building-

Positive Reflection by our Staff

Repeat Schools of Distinction- Positive

Staff Reflection

Where's the Largest GAP between My Building and Schools of Distinction Notes

Clear and Shared Focus        

Collaboration for Student Learning 1       

Community & Parent Involvement        

Effective Leadership        

Focused Professional Development  2       

High Quality Curriculum, Instruction, and Assessemnt

       

High Standards and Expectations        

Monitor Teaching and Learning        

Readiness to Benefit        

Supportive Learning Environment        

Page 23: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Schools of Distinction?Stack Rank the following-- from 1 (Best) to 10

Step 1 Step 2 Step 3

CharacteristicMy Building-

Positive Reflection by our Staff

Repeat Schools of Distinction- Positive

Staff Reflection

Where's the Largest GAP between My Building and Schools of Distinction Notes

Clear and Shared Focus        

Collaboration for Student Learning        

Community & Parent Involvement   1     

Effective Leadership        

Focused Professional Development        

High Quality Curriculum, Instruction, and Assessemnt

       

High Standards and Expectations        

Monitor Teaching and Learning        

Readiness to Benefit        

Supportive Learning Environment        

Page 24: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Where are the gaps?Stack Rank the following-- from 1 (Best) to 10

Step 1 Step 2 Step 3

CharacteristicMy Building-

Positive Reflection by our Staff

Repeat Schools of Distinction- Positive

Staff Reflection

Where's the Largest GAP between My Building and Schools of Distinction Notes

Clear and Shared Focus        

Collaboration for Student Learning        

Community & Parent Involvement      

Effective Leadership        

Focused Professional Development        

High Quality Curriculum, Instruction, and Assessemnt

       

High Standards and Expectations        

Monitor Teaching and Learning        

Readiness to Benefit        

Supportive Learning Environment        

Page 25: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Research Approach

• Guiding Prompt: How are attitudes and practices different in the Schools of Distinction?

Page 26: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Today’s Focus Data Will Be:

Phase I Practices of Improving or

Turnaround Schools Oct 2007 – Jan

2008

Phase II EES-Staff Survey Characteristics of High Performing

Schools Dec 2007 – May

2008

Phase III EES-Staff with

Repeat WinnersOct 2008 – Jan

2009

For Details:

• OSPI January Conference-2008, WERA-Spring-2008, AWSP/WASA Summer Conference 2008 Session, OSPI January Conference-2009

• www.effectiveness.org

• Sharratt, G. C., Mills, S., & Lobdell, G. (2008). Schools of distinction: What makes them distinct? Washington State Kappan, 2(1), 20-22.

Page 27: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

"Nine Characteristics of High Performing

Schools" OSPI

Characteristics of Improved School Districts" OSPI,

Shannon & Bylsma, 2004

"Beat the Odds, 2006"

Morrison Institute for Public Policy,

"Knowing the Right Things

to Do", Elmore, 2004.

"School Turnarounds" Public Impact,

2007

What Works In Schools,

Marzano, 2003

Instructional Leadership

student learning focus distributed leadership observes instruction

frequently

√ √ √ √ √ √

High Quality Teaching and Learning

High expectations use of student data

personalized interventions aligned C & I

√ √ √ √ √ √

Systems Support for Improvement

effective use of data parent involvement professional learning

community I(2nd ed.) √ √ √ √ I

Collaboration

communication addressing conflict

organizational trust peer observation

√ √ √ √ √ √

Readiness for Improvement

belief in student learning openness to new ideas problem solving, conflict

management

√ I √ I I I

CEE Research Focus- Schools of Distinction

Page 28: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

"Nine Characteristics of High Performing

Schools" OSPI

Characteristics of Improved School Districts" OSPI,

Shannon & Bylsma, 2004

"Beat the Odds, 2006"

Morrison Institute for Public Policy,

"Knowing the Right Things

to Do", Elmore, 2004.

"School Turnarounds" Public Impact,

2007

What Works In Schools,

Marzano, 2003

Instructional Leadership

student learning focus distributed leadership observes instruction

frequently

√ √ √ √ √ √

High Quality Teaching and Learning

High expectations use of student data

personalized interventions aligned C & I

√ √ √ √ √ √

Systems Support for Improvement

effective use of data parent involvement professional learning

community I(2nd ed.) √ √ √ √ I

Collaboration

communication addressing conflict

organizational trust peer observation

√ √ √ √ √ √

Readiness for Improvement

belief in student learning openness to new ideas problem solving, conflict

management

√ I √ I I I

CEE Research Focus- Schools of Distinction

Page 29: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Highlights of Phases I and II

Very High Readiness for Improvement75% belief that ALL students can meet state

standards75% willingness to change, and openness to new

ideasCulture of Collaboration

High trust across staff and with leadership75% willingness to address conflict

LeadershipStable – average of 4 yrs in building and 8 years as

principalFocus on instruction and student learning - 50%

observe classrooms dailySystem Support for Improvement

80% have release time monthly for professional development

60% monitor school improvement plans at least monthly

High Quality Instruction and Supportive Instructional Practice

92% use assessment data to identify student needs and instructional intervention

84% use data to guide professional development80% use collaborative lesson design and analysis of

student workHigh Level of Trust

71% believe there is a high level of trust in their school

Reading and Math Beliefs are more important – both in top 10!

Collaborative planning for integration of literacy and numeracy across the curric.

Leadership facilitate processes for improvement

Staff have frequent feedback about how they are doing

Teachers engage in PD to learn and apply skills and strategies

Struggling students receive interventionCelebrating student successTeachers integrate literacy and numeracy

Strength in positive side of TrustLower “Trust Erosion” factors

Page 30: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Phase III• Approach: differential comparison

– By each of the Nine Characteristics– By each item within the characteristic scales

• Focus on repeat winners– 2008 repeat winners– 2008 first year winners– Comparison with schools across the state

• Instrumentation: Educational Effectiveness Survey v9.0– Voluntary participation: Staff self-reflection– Nine Characteristics of High Performing Schools– Readiness to Benefit– Includes views of: Organizational Trust, District Support for

Improvement, and Cultural Responsiveness

Page 31: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Sample Definitions

• SOD EES Overall Sample (non-repeat winners)N= 1,710 staff in 55 Buildings

• Repeat Winners

N= 520 in 18 Buildings (out of 21)

Page 32: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Demographics for State Sample

• EES-Staff surveys from October 2007 to January 2009• N= 16,934 staff• 321 unique schools• Geographically, demographically, and achievement fairly representative

of the state (slightly higher poverty, ELL, and Hispanic representation than state overall)– WASL Reading slightly higher than state average, WASL Math slightly lower

than state

School Level

Other, 87, 1%

K-12, 347, 2%

Elementary, 8461, 50%

Middle / Jr. High, 3843,

23%

High School, 3992, 24%

ESD by Respondents

ESD105, 2199, 14%ESD112,

2406, 15%

ESD113, 125, 1%

ESD114, 1458, 9%

ESD121, 5070, 32%

ESD123, 1860, 12% ESD171,

1129, 7%

ESD189, 803, 5%

ESD101, 724, 5%

Position Administrator2%

Para-Professional /

Instr. Aide12%

Classif ied Support Staff

14%

Certif icated Support Staff

6%

Certif icated Teacher

66%

Page 33: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C . 33

Before we get into the findings…

“Bummer of a

birthmark”

Reflection and sharing without the

bullseye

Page 34: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

For Interpretation

• EES scale is 5-pt Likert– Almost Always True (5), Often True,

Sometimes True, Seldom True, Almost Never True(1)

– Positive Responses: Almost Always True + Often True

Page 35: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Distinction: Repeat Schools of Distinction demonstrate significant strength in ALL of the Nine Characteristics

2.000

2.500

3.000

3.500

4.000

4.500

High Quality Curriculum, Instruction, andAssessemnt

Monitor Teaching and Learning

Collaboration for Student Learning

District Support for Improvement

High Standards and Expectations

Clear and Shared FocusFocused Professional Development

Supportive Learning Environment

Community & Parent Involvement

Effective Leadership

Readiness to Benefit

SOD-Repeats

State Sample

(further out from center is better)

Page 36: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Distinction: The Instructional Core Matters

SOD-Repeats State Sample

Mean: 5=ALMOST ALWAYS TRUE, 1=Almost Never True

Mean Mean

Difference: Repeats vs

StateRank of

diffs

Monitor Teaching and Learning 3.646 3.341 0.306 1

High Quality Curriculum, Instruction, and Assessemnt

3.967 3.687 0.280 2

Collaboration for Student Learning 3.825 3.581 0.244 3

High Standards and Expectations 3.664 3.468 0.196 4

Focused Professional Development 3.731 3.537 0.195 5

Supportive Learning Environment 4.128 3.936 0.191 6

Community & Parent Involvement 3.729 3.538 0.190 7

Clear and Shared Focus 4.230 4.068 0.162 8

Effective Leadership 4.189 4.032 0.157 9

Page 37: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

DISTINCTION: Monitoring Teaching and Learning

Reduce isolation and open practice up to direct observation, analysis, and feedback.– Make direct observation of practice, analysis, and feedback a

routine feature of work.Elmore (2000, 2002, and 2004)

Page 38: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Means vs. Positive Responses

• Both Schools show 35% Positive

• School A Mean =2.60

• School B Mean =3.43

15%

28%

20%

7%

10%

50%

20%

10%

35%

5%

0% 20% 40% 60% 80% 100%

School A

School B

Almost Always True Often True Sometimes True Seldom True Almost Never True Missing

We monitor the effectiveness of instructional interventions

Copyright © The Center for Educational Effectiveness, Inc., 2004

Page 39: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Distinction: Monitor Teaching and Learning

Mean: 5=ALMOST ALWAYS TRUE, 1=Almost Never True

MeanCombined Positive Mean

Combined Positive

Repeats vs State Means

Repeats vs State %Pos

We monitor the effectiveness of instructional interventions

3.843 69.6% 3.322 56.0% 0.520 13.6%

We are frequently informed about how well we are doing

3.867 69.0% 3.483 52.6% 0.384 16.4%

We reflect upon instructional practice to inform our conversations about improvement

3.698 65.7% 3.338 57.2% 0.360 8.5%

Struggling students receive early intervention and remediation to acquire skills

4.018 73.1% 3.678 58.4% 0.340 14.6%

Teachers collaboratively plan lessons 3.492 58.6% 3.205 50.3% 0.287 8.3%Data from peer observations leads to meaningful change in instructional practice

3.000 47.8% 2.794 41.0% 0.206 6.8%

Assessment data is used to identify student needs and appropriate instructional intervention

4.175 78.5% 3.985 71.0% 0.189 7.5%

We are encouraged to participate in classroom observation

3.080 43.6% 2.920 42.8% 0.159 0.8%

Monitor Teaching and Learning 3.646 3.341 0.306

State SampleSOD-Repeats

Page 40: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

DISTINCTION: The “VITAL Cycle” of Curriculum, Instruction, and Assessment

Beat-the-odds-schools are figuring out ways to customize instruction and intervention so it exactly suits each student’s needs.The beat-the-odds schools are putting in place a whole set of interlocking

practices and policies geared toward winning a marathon (instead of a sprint). It involves a vital cycle of instruction, assessment, and intervention, followed by more instruction, assessment and intervention.

Beat The Odds (2006)

Page 41: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Distinction: High Quality Curriculum, Instruction, and Assessment

Mean: 5=ALMOST ALWAYS TRUE, 1=Almost Never True

MeanCombined Positive Mean

Combined Positive

Repeats vs State Means

Repeats vs State %Pos

Common assessments are used to inform instruction

4.01 76.2% 3.43 59.5% 0.579 16.7%

Instruction is personalized to meet the needs of each student

3.79 68.0% 3.48 55.5% 0.313 12.5%

Regular assessment is used to monitor student progress

4.26 85.6% 3.95 76.5% 0.312 9.1%

The reading program we teach is aligned with state learning standards

4.22 81.2% 3.92 69.3% 0.301 11.8%

Our staff demonstrates a thorough understanding of state learning standards for reading

4.06 78.8% 3.78 64.4% 0.276 14.5%

This school provides curriculum that is relevant and meaningful

4.25 85.2% 4.00 74.8% 0.241 10.4%

Our staff demonstrates a thorough understanding of state learning standards for math

3.68 64.6% 3.48 52.0% 0.208 12.6%

The math program we teach is aligned with the state learning standards

3.87 69.4% 3.68 60.2% 0.196 9.2%

This district uses assessments aligned to standards and instruction

3.96 74.0% 3.77 63.2% 0.189 10.8%

All teachers integrate literacy and numeracy concepts into their teaching

3.57 61.0% 3.38 48.4% 0.186 12.6%

High Quality Curriculum, Instruction, and Assessemnt

3.967 3.687 0.280

State SampleSOD-Repeats

Page 42: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

DISTINCTION: Action-Based Collaboration

Improved districts build a culture of commitment, collegiality, mutual respect, and stability.– Professional culture of high standards– Trust, mutual respect, and competence– Opportunities for peer support, collaboration, and develop

professional learning communitiesShannon & Bylsma (2004)

Page 43: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Distinction: Collaboration & Communication

Mean: 5=ALMOST ALWAYS TRUE, 1=Almost Never True

MeanCombined Positive Mean

Combined Positive

Repeats vs State Means

Repeats vs State %Pos

Students understand the expectations and standards of this school

4.109 80.4% 3.732 62.3% 0.377 18.1%

When there is a problem in my school, we talk about how to solve it

4.058 75.0% 3.687 60.1% 0.372 14.9%

Staff in our building do not manipulate others to achieve their goals

3.998 74.2% 3.648 58.4% 0.350 15.8%

Parents & community understand the expectations & standards of this school

3.716 65.0% 3.382 47.0% 0.334 18.0%

Staff in our school are consistently truthful 4.072 80.6% 3.801 65.8% 0.272 14.8%There is a willingness to address conflict in this school

3.959 71.5% 3.695 59.5% 0.264 12.0%

Staff at this school collaborate to improve student learning

4.302 83.5% 4.075 75.7% 0.227 7.7%

We collaboratively plan the integration of literacy & numeracy concepts across the curriculum

3.539 55.6% 3.320 46.5% 0.220 9.1%

There is effective, 2-way communication between the district and our school

3.322 48.8% 3.103 38.2% 0.219 10.7%

Our staff shares learnings from conferences and seminars they attend

3.626 59.4% 3.461 51.0% 0.165 8.4%

Collaboration between district and schools is based upon trust and respect

3.394 49.8% 3.263 42.7% 0.131 7.1%

Our school meets regularly to monitor implementation of our school improvement plan

3.804 62.7% 3.801 64.5% 0.003 -1.8%

Collaboration for Student Learning 3.825 3.581 0.244

State SampleSOD-Repeats

Page 44: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Application of FindingsA Quick View by School Level

Why do we see significantly different improvement results in Reading and Math?

Page 45: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Elementary Staff- Top 10 Differences

Cha

ract

eris

tic

Stack Rank of

Gap% Positive

SOD

% Positive State

Sample Gap

Instruction is personalized to meet the needs of each student

CIA 1 74.2% 60.5% 13.8%

We hold one another accountable for student learning HSE 2 70.0% 57.4% 12.6%

We are frequently informed about how well we are doing

MTL 3 68.6% 57.6% 11.0%

We monitor the effectiveness of instructional interventions

MTL 4 75.7% 64.8% 10.9%

We reflect upon instructional practice to inform our conversations about improvement

MTL 5 73.0% 62.5% 10.5%

Parents & community understand the expectations & standards of this school

Collab 6 63.6% 53.2% 10.4%

We are provided training to support a culturally responsive learning environment

FPD 7 47.8% 37.4% 10.4%

Common assessments are used to inform instruction CIA 8 78.2% 67.8% 10.4%

Students understand the expectations and standards of this school

Collab 9 78.6% 69.1% 9.5%

Staff members enforce consistent behavior expectations and consequences in their classrooms

SLE 10 77.8% 68.3% 9.4%

Elementary Schools

Page 46: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Secondary Staff- Top 10 Differences

Cha

ract

eris

tic

Stack Rank of

Gap% Positive

SOD

% Positive State

Sample Gap

Students in this school are engaged in learning SLE 1 77.9% 60.4% 17.5%

Students understand the expectations and standards of this school

Collab 2 73.0% 55.6% 17.5%

When there is a problem in my school, we talk about how to solve it

Collab 3 72.2% 55.9% 16.3%

Struggling students receive early intervention and remediation to acquire skills

MTL 4 64.9% 49.0% 15.9%

Parents & community understand the expectations & standards of this school

Collab 5 55.4% 40.7% 14.7%

Staff in our school are consistently truthful Collab 6 76.7% 62.1% 14.6%

My colleagues welcome new and innovative ideas RTB 7 67.7% 54.6% 13.2%

Our teachers engage in professional development activities to learn and apply math skills and strategies

FPD 8 66.5% 53.8% 12.7%

We are frequently informed about how well we are doing

MTL 9 60.2% 47.6% 12.7%

Our staff believes that all students can meet state reading standards

HSE 10 57.8% 45.4% 12.5%

Secondary Schools

Page 47: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Improvement is Contagious

• East Port Orchard Elementary– South Kitsap SD

Page 48: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Application: Reflection on Change

Successful turnarounds are typically marked by vigorous analysis of data, identification of key problems, and selection of strategies to address the central challenges.

Two leader actions fall into this category:• Collecting and personally analyzing organization

performance data• Making an action plan to CHANGE based on data

School Turnarounds (2007)

Page 49: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Personal Side of Change• Planning

• Sense of Urgency

• Support Systems

• Personal Focus

• Effect of Results

• ACTION: Personal Side of Change Worksheet

Adapted and revised from Reeves, D. (2009). Leading Change in Your School: How to conquer myths, build commitment, and get results. Alexandria, VA: ASCD: 2009.

Page 50: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Personal Side of Change

CHANGEDescribe

PLANNING:I planned in advance the steps I would take and knew clearly how to make the change

Sense of URGENCYI know that the price of failing to change was much greater that the price of changing (and could identify each)

Personal SUPPORTFamily and friends knew I was making this change and supported me

Personal FOCUSI devoted time to initiating and maintaining the change despite my busy schedule

Effect on RESULTSI can measure the results of the change, and they are clear and significant

Directions: For each of your two changes, enter a score of 1 to 10 (in each column), with 1 representing no evidence of the characteristics described, and 10 representing an exceptional reflection of that characteristic.

Page 51: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Organizational Side of Change

Directions: For each of your two changes, enter a score of 1 to 10 (in each column), with 1 representing no evidence of the characteristics described, and 10 representing an exceptional reflection of that characteristic.

CHANGEDescribe

PLANNING:Plans were clear, data-driven, detailed, and effectively communicated

Sense of URGENCYWidespread sense of immediate need for the change was apparent

Stakeholder SUPPORTCritical stakeholders, staff, and leadership understood and supported the change

Leadership FOCUSSenior leadership made the change their clear and consistent focus long after initiation

Effect on RESULTSThe change had a measurable and significant effect on results

Page 52: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Creating Change- Where are You and Your School?

Readiness for Learning Ready for Change

Ready for Resistance Ready for Frustration

Organizational Change

High

High

Page 53: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

The Center for Educational Effectiveness, Inc.www.effectiveness.org

Organization

StudentLearning

The Center for Educational Effectiveness, Inc.www.effectiveness.org

Organization

StudentLearning

[email protected]?

Questions?

Page 54: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Performance, Improvement, and Poverty

• Poverty is inversely correlated with performance

• What about improvement- does the same hold true?

Page 55: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Poverty and ImprovementElems- Grade 4

R2 = 0.01667

-1.50

-1.00

-0.50

0.00

0.50

1.00

1.50

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Poverty

RM

LI C

han

ge

Award Winners Elems Linear-ALL

SOD Award Level

Page 56: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

HS-Grade 10

R2 = 0.0032

-1.50

-1.00

-0.50

0.00

0.50

1.00

1.50

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Poverty

RM

LI

Ch

an

ge

HS-Grade 10 Award Winners Linear-ALL

SOD Award Level

Poverty and Improvement

Page 57: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Poverty and ImprovementMS-Grade 7

R2 = 0.0072

-1.50

-1.00

-0.50

0.00

0.50

1.00

1.50

0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0

Poverty

RM

LI

Ch

an

ge

MS-Grade 7 Award Winners Linear-ALL

SOD Award Level

Page 58: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

The Center for Educational Effectiveness, Inc.www.effectiveness.org

Organization

StudentLearning

The Center for Educational Effectiveness, Inc.www.effectiveness.org

Organization

StudentLearning

[email protected] Material

Page 59: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

Rig

or

(Ro

bu

stn

ess)

- C

onte

nt c

over

age

- S

yste

mic

(K

-12)

ComplexityLow High

RMLI- Schools of DistinctionSelection

SBE AccountabilityIndex

• Reading, Math, Writing, & Science

• Compensatory

• Status AND Improvement (over 1 year), AND “Beat The Odds”

• Risk Adjusted for Low and non-Low Income

• Systemic- Gr. 3-10 and Extended Grad. Rate

• Criterion-based

•Reading & Math Level Index

• Conjunctive

• Improvement over 6 years

• Grade 4, 7, and 10 only

• 5% “winners”

Page 60: Wsu  Sod Findings Apr 25 09

C E N TE R F OR E D UC ATI ON A L EF F E CT I V E N E S S , I N C .

References You Can UsePrimary• Elmore, R. (2004). Knowing the Right Things to Do: School Improvement and Performance-Based

Accountability. Washington, D.C.: National Governors Association- Center for Best Practices.• Marzano, R. (2003). What Works in Schools: Translating Research Into Action. Alexandria, VA: ASCD.• Beat The Odds (2006). Morrison Institute for Public Policy (2006). Why Some Schools With Latino Children

Beat the Odds…and Others Don’t. Tempe, AZ.: Morrison Institute for Public Policy, Arizona State University, jointly with Center for the Future of Arizona. (aka: “Beat The Odds (2006) ).

• Fixen, D.L. et al. (2005). Implementation Research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Mental Health Institute, The National Implementation Research Network (FMHI Publication #231)

• School Turnarounds (2007). Public Impact (2007). School Turnarounds: A review of the cross-sector evidence on dramatic organizational improvement. Public Impact, Academic Development Institute- prepared for the Center on Innovation and Improvement. Retrieved from: http://www.centerii.org/ (aka: School Turnarounds (2007)).

• Shannon, G.S. & Bylsma, P. (2004). Characteristics of Improved School Districts: Themes from Research. Olympia, WA. Office of Superintendent of Public Instruction.

• Shannon, G.S. & Bylsma, P. (2003). Nine Characteristics of High Performing Schools. A research-based resource for school leadership teams to assist with the School Improvement Process. Office of Superintendent of Public Instruction. Olympia, WA.

• Sharratt, G. C., Mills, S., & Lobdell, G. (2008). Schools of distinction: What makes them distinct? Washington State Kappan, 2(1), 20-22.

Secondary• Center for Educational Effectiveness (CEE) (2005). Longitudinal Change in Staff Perceptions of the 9

Characteristics of High Performing Schools in OSPI SIA Cohort-II and III Schools. Redmond, WA: Center for Educational Effectiveness.

• Elmore, R. (2000). Building a New Structure For School Leadership. Washington, D.C.: The Albert Shanker Institute.

• Elmore, R. (2002). Bridging the Gap Between Standards and Achievement. Washington, D.C.: The Albert Shanker Institute.

• Tschannen-Moran, (2004). Trust Matters, Leadership for Successful Schools. San Francisco, CA. Jossey-Bass.