june 2014. articulate the impact slg goals have on improving student learning identify the...
TRANSCRIPT
![Page 1: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/1.jpg)
Supporting Administrators in the SLG Goal Setting
Process – Part IJune 2014
![Page 2: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/2.jpg)
Articulate the impact SLG goals have on improving student learning
Identify the characteristics of assessments that measure growth and inform instruction
Utilize the components of the SLG goal template
Create a common understanding of the depth of knowledge needed for college and career readiness
Set targets for all students
Professional Learning Outcomes for 2014-15: SLG Goal Setting Process
![Page 3: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/3.jpg)
Demonstrate familiarity with district rubric Describe proficient practice based on
district rubric descriptors Provide feedback to educators based on
evidence collected Calibrate of evaluators
Professional Learning Outcomes for 2014-15: Inter-rater Reliability
![Page 4: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/4.jpg)
Deeper examination of targeted components of the SLG goal setting process◦ Understand the connection/relationship between
content and assessment ◦ Understand the connection/relationship between
context and baseline data Revise personal goal based on today’s learning
Outcomes for Today
![Page 5: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/5.jpg)
How we got where we are today Celebrating Oregon’s successes Intention of SLG Goals
◦Collaborative conversations◦Recognition for what you are doing well◦Educators and students get the support
they need in real time
Purpose of SLG Goals
![Page 6: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/6.jpg)
The Oak Tree AnalogyThe Tree Analogy
![Page 7: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/7.jpg)
• For the past year, these gardeners have been tending to their trees trying to get them to grow as much as possible.
• Each gardener used a variety of strategies to help their own tree grow… Which of these two gardeners was more successful with their strategies?
Explaining the concept of educator contribution to student growth by evaluating the performance of two gardeners
Explaining the influence of educators on student learning and growth by examining the performance of two gardeners
![Page 8: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/8.jpg)
This method is analogous to using Achievement to measure student learning.
To measure the performance of the gardeners, we will measure the height of the trees today (one year after they began tending to the trees).
• Using this method, Gardener B is the superior gardener.
![Page 9: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/9.jpg)
Oak AAge 4
(Today)
Oak BAge 4
(Today)
Oak AAge 3
(1 year ago)
Oak BAge 3
(1 year ago)
… but this achievement result does not tell the whole story.
• These trees are four years old.
• We need to find the starting height for each tree in order to more fairly evaluate each gardener’s performance during the past year.
• The trees were much shorter last year.
![Page 10: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/10.jpg)
We can compare the height of the trees one year ago to the height today.
• By finding the difference between these heights, we can determine how many inches the trees grew during the year of gardener’s care.
• Tree B had more growth this year, so Gardener B is the superior gardener.
This is analogous to using Simple Growth, also called Gain, to measure performance .
![Page 11: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/11.jpg)
… but this simple growth result does not tell the whole story either. • We do not yet know how much of this growth was influenced by the strategies used by the
gardeners themselves.
• This is an “apples to oranges” comparison.
• For our tree example, three environmental factors we will examine are: Rainfall, Soil Richness, and Temperature.
![Page 12: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/12.jpg)
External condition Tree A Tree B
Rainfall amount
Soil richness
Temperature
High LowLow HighHigh Low
![Page 13: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/13.jpg)
How much the gardeners’ own strategies influenced the growth of the trees…
• We can take out each environmental factor’s contribution to growth.
• After these external factors are accounted for, we will be left with the effect of just the gardeners.
• To find the correct adjustments, we will analyze available data on trees tended by these gardeners.
![Page 14: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/14.jpg)
Based on data, we identify growth expectations for each of these environmental factors, and we convert them into a form usable for our
calculations.
Rainfall Low Medium HighGrowth relative to
the average Much less Less More
Soil Richness Low Medium High
Growth relative to the average Much less Less More
Temperature Low Medium HighGrowth relative to
the average Much more Less Much less
Now we can go back to Tree A and Tree B to adjust for their growing conditions.
![Page 15: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/15.jpg)
+20 Gain+14 Gain
• Next, we will use our adjustments to account for the effect of each tree’s environmental conditions.
To calculate our new adjusted growth, we start with gains.
• When we are done, we will have an “apples to apples” comparison of the gardeners’ influence on growth.
![Page 16: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/16.jpg)
+20 Gain+14 Gain
↓ for Rainfall ↑ for Rainfall
Similarly, for having low rainfall, Tree B’s growth is increased to compensate.
Based on data, we found that high rainfall resulted in extra growth on average.
For having high rainfall, the extra growth is subtracted from Tree A’s growth to compensate.
![Page 17: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/17.jpg)
+20Simple+14 Simple
↓ for Rainfall ↑ for Rainfall
↑ for Soil ↓ for Soil
For having rich soil, Tree B’s growth is adjusted down to compensate.
For having poor soil, Tree A’s growth is adjusted up to compensate.
![Page 18: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/18.jpg)
+14 Simple+14 Simple
↓ for Rainfall ↑ for Rainfall
↑ for Soil ↓ for Soil
↑ for Temp ↓ for Temp
For having low temperature, Tree B’s growth is adjusted down to compensate.
For having high temperature, Tree A’s growth is adjusted up to compensate.
![Page 19: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/19.jpg)
+20 Simple+14 Simple
↓ for Rainfall ↑ for Rainfall
↑ for Soil ↓ for Soil
↑ for Temp ↓ for Temp_________ + X inchesAdjusted Growth
_________+ Y inches
Adjusted Growth
We calculate that Gardener B’s effect on Tree B is a smaller number of inches
We calculate that Gardener A’s effect on Tree A is a given number of inches
Now that we have removed the effect of environmental conditions, our adjusted growth result puts the gardeners on a level playing field.
![Page 20: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/20.jpg)
+ Simple+ Simple
↓ for Rainfall ↑ for Rainfall
↑ for Soil ↓ for Soil
↑ for Temp ↓ for Temp_________+ X inchesAdjusted Growth
_________+ Y inches
Adjusted Growth
This is analogous to the student learning and growth goal process.
By accounting for last year’s height and environmental conditions of the trees during this year, we found the influence of each gardener on the growth of the tree.
Using this method, Gardener A is the superior gardener.
![Page 21: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/21.jpg)
Tree Analogy Student Learning and Growth Goals in Education
What are we evaluating?
• Gardeners • Districts• Schools/School Administrators• Grades• Classrooms/Teachers• Programs and Interventions
What are we using to measure success?
• Growth in Inches • Growth on Assessments from Categories I and II
Sample • Single Tree • Groups of Students
Adjustment Factors • Rainfall• Soil Richness• Temperature
• Students’ Prior Performance
Other variables collected for students e.g.,
•Gender• Race • Free/Reduced Lunch Status• English Learner Status• TAG• IEP•504
How does this analogy relate to student learning and growth goal calculations in the education context?
![Page 22: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/22.jpg)
Baseline student performance data in a classroom on a Category I or II assessment
22
![Page 23: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/23.jpg)
Using baseline student data and other information on factors that can influence student learning and growth to set targets
23
![Page 24: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/24.jpg)
At the end of the course, students showed growth
24
![Page 25: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/25.jpg)
Bringing all the information together
25
![Page 26: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/26.jpg)
Similarly we calculate Ms. Johnson’s influence on each Tier and average across Tiers
26
Ms. Johnson’s influence on Tier A learning and growth
![Page 27: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/27.jpg)
Two teachers with student populations that look similar may have good reasons to set different expectations
27
![Page 28: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/28.jpg)
THE SLGG process recognizes teachers of lower-achieving students who are as effective as a teacher of higher-achieving students (or
more)
28
![Page 29: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/29.jpg)
Find someone not at your table Share:
◦Successes
◦Roadblocks
Reflecting on 2013-14
![Page 30: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/30.jpg)
Where does goal setting originate? *What is the role of SLG goals in overall
evaluation? Who has to set SLG goals? Who are SLG goals set for? *What kinds of Assessments can be used? What is the scope of SLG goals? What is the difference between
Achievement and Growth?*Pending USED approval of Oregon’s waiver
Clarifications
![Page 31: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/31.jpg)
Rationale added to the template
*Category 3 removed
State checklist and scoring rubric
*Pending USED approval of Oregon’s waiver
Revisions to SLG Goal Guidance
![Page 32: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/32.jpg)
Targeted goals rather than school wide
All goals must be focused on academic growth
Revisions Specific to Administrators
![Page 33: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/33.jpg)
Content: Based on the relevant content and skills
students should know or be able to do at the end of the course /class, a clear statement of a specific area of focus is selected. These should be based on specific state or national standards. A statement such as “CCSS in Math” is not specific enough.
Digging Deeper into the Process
![Page 34: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/34.jpg)
Students will write arguments to support claims using valid reasoning and sufficient evidence, write informative/explanatory texts to examine and convey complex ideas, concepts, and information through the effective selection, organization, and analysis of content, and write narratives to develop real or imagined experiences or events using effective technique, well-chosen details, and well-structured event sequences. Related Oregon ELA standards:
◦ W. 9‐10.1 - W.9‐10.3, W.11‐12.1 - W.11‐12.3Knowledge = YELLOW
Skills = BLUEStandards = PINK
Content Example: HS Writing
![Page 35: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/35.jpg)
Content Example: HS Writing
Students will write arguments to support claims using valid reasoning and sufficient evidence, write informative/explanatory texts to examine and convey complex ideas, concepts, and information through the effective selection, organization, and analysis of content, and write narratives to develop real or imagined experiences or events using effective technique, well-chosen details, and well-structured event sequences.Related Oregon ELA standards:
– W. 9 10.1 - W.9 10.3, W.11 12.1 - W.11 12.3‐ ‐ ‐ ‐
![Page 36: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/36.jpg)
Think about the content you wrote in your goal◦ Do you still think it is appropriate?◦ Why or why not?◦ Do you need to narrow the focus?
Share your reflections with someone at your table
Reflecting on Content Component
![Page 37: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/37.jpg)
Assessment: Describes how student learning and growth
will be measured. In Oregon, two categories of assessments are used for SLG goals. Assessments must be aligned to state or national standards and meet state criteria.
Digging Deeper into the Process
![Page 38: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/38.jpg)
District‐developed writing prompts will be used. These prompts are from vetted assessments such as NAEP, AP exams, and released statewide assessment items. Students will complete one formal writing piece for each type of writing (arguments, explanatory, narrative) which will be scored using the Oregon Writing Scoring Guide. Students will receive an average score calculated across all three essays.
Assessment Example: HS Writing
![Page 39: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/39.jpg)
How is learning measured?Performance tasks
Which categories do the assessments fall under?Category 2
Are the assessments aligned with standards and do they meet state criteria?
YES – use state scoring guide
Assessment Example: Answers
![Page 40: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/40.jpg)
Think about the assessment you used◦ Do you still think it is appropriate?◦ Why or why not?◦ What would you change?
Share reflections with someone at your table◦ How can you use the assessment you chose to
measure the growth in the content you identified?
Reflecting on Assessment Component
![Page 41: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/41.jpg)
Digging Deeper into the ProcessContext:Description of the demographics and learning needs of all student in the class/course. Includes as relevant: number of students and their gender, race/ethnicity, socioeconomic status, attendance, and any students with diverse learning needs (EL, TAG, IEP, 504 plans). For those educators who do not meet with students on a regular basis, including contact time provides additional context for the goals developed.
![Page 42: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/42.jpg)
60% of students enrolled in ABC Middle School receive free or reduced lunch. As the result of our school’s block scheduling, all students participate in four 70 minute math periods per week. 82 students, or approximately 14%, are students with disabilities who have an IEP but are not eligible to take the extended assessment. 52 students are boys; 30 students are girls. 50% (41) of the students have IEP goals in math.
Context Example: MS Math
![Page 43: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/43.jpg)
Think about the context in the goal you brought◦ What context(s) did you include to address all the
learning needs of your students?◦ How did you use context to set targets and select
strategies?◦ What would you do differently?
Share your reflections with someone at your table
Reflecting on Context Component
![Page 44: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/44.jpg)
Baseline Data:Provides information about the students’ current performance at the start of course/class. It is generally the most recent data available and can include the prior year’s assessment scores or grades, results from a beginning of the year benchmark assessment, a pre-test, or other evidence of student learning. Determine students’ strengths and areas of weakness that inform the goal.
Digging Deeper into the Process
![Page 45: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/45.jpg)
Our original set of data included an analysis of OAKS results from the previous year which revealed a 48% gap in performance between students who received SPED services in Math and those that didn’t. Only 31% of students with IEPs in math scored at or above proficiency. We have analyzed their results and found three distinct tiers of performance. Group 1: 31% of students met or exceeded Group 2: 44% of students nearly met Group 3: 25% of students did not meet
Baseline Data Example: MS Math
![Page 46: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/46.jpg)
Share the baseline data in the goal you brought◦ What are the strengths/limitations of the baseline
data you collected?◦ To what extent would the baseline data you
collected allow you to tier your targets?◦ How will context inform your tiers? How won’t it?
Share your reflections with someone at your table
Reflecting on Baseline Data
![Page 47: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/47.jpg)
Reflect on today’s learning Review your goal using the Quality Review
Checklist. Justify your selection of YES or NO for each
of the five questions with evidence from your goal.
Applying the SLG Goal Tools
![Page 48: June 2014. Articulate the impact SLG goals have on improving student learning Identify the characteristics of assessments that measure growth and](https://reader038.vdocuments.us/reader038/viewer/2022110206/56649d085503460f949d9a99/html5/thumbnails/48.jpg)
Use an index card from your table to write down:◦ Two new learnings or “a-has” you had as a result
of today’s professional learning◦ One question you still have regarding the student
learning and growth goal setting process. Homework for October
◦ Bring a draft of an SLG Goal that you develop for the 2014-15 SY
Wrap-Up