data analysis protocols: an overview a “ground up approach” to effective data use 1
TRANSCRIPT
![Page 1: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/1.jpg)
Data Analysis Protocols: An Overview
A “Ground Up Approach” to Effective Data Use
1
![Page 2: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/2.jpg)
Why Use Assessment Data
Quality School Review (QSR) Rubric:Indicator 1.6: The principal ensures that classroom level instruction is adjusted based on formative and summative results from aligned assessments.
Indicator 3.3: Teachers use frequent checks for understanding throughout each lesson to gauge student learning, and to inform, monitor and adjust instruction.
Indicator 3.5: Teachers demonstrate the necessary skills to use multiple measures of data, including the use of diagnostic, formative and summative assessment data, to differentiate instruction to improve student achievement.
Indicator 4.2: Teachers and school leaders collect classroom level data to verify that the adopted and aligned CCSS curriculum is the “taught” curriculum.
2
![Page 3: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/3.jpg)
Why Use Assessment Data
Why are teachers learning this?Danielson Framework for Teaching:Domain 1e: Designing coherent instruction.Domain 1f: Designing student assessments.Domain 3d: Using assessment in instruction.Domain 4a: Reflecting on teaching. Domain 4b: Maintaining accurate records.
3
![Page 4: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/4.jpg)
Why Use Assessment DataHere’s some supporting research:
Abbott, D. V. (2008). A functionality framework for educational organizations: Achieving accountability at scale. In E. Mandinach & M. Honey (Eds.), Data driven school improvement: Linking data and learning (pp. 257–276). New York: Teachers College Press.
Brunner, C., Fasca, C., Heinze, J., Honey, M., Light, D., Mandinach, E., et al. (2005). Linking data and
learning: The Grow Network study. Journal of Education for Students Placed At Risk, 10(3), 241–267.
Halverson, R., & Thomas, C. N. (2007). The roles and practices of student services staff as data-driven
instructional leaders. In M. Mangin & S. Stoelinga (Eds.), Instructional teachers leadership roles: Using research to inform and reform (pp. 163–200). New York: Teachers College Press.
Kerr, K. A., Marsh, J. A., Ikemoto, G. S., Darilek, H., & Barney, H. (2006). Strategies to promote data
use for instructional improvement: Actions, outcomes, and lessons from three urban districts. American Journal of Education, 112(4), 496–520
Liddle, K. (2000). Data-driven success: How one elementary school mined assessment data to improve instruction. American School Board Journal. Retrieved April 19, 2009, from http://www.asbj.
Mandinach, E. B., Honey, M., Light, D., Heinze, C., & Rivas, L. (2005, June). Creating an evaluation
framework for data-driven decision-making. Paper presented at the National Educational Computing Conference, Philadelphia, PA.
4
![Page 5: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/5.jpg)
Part One: Daily Data Use
A “Ground Up Approach” to Daily Data Use
5
![Page 6: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/6.jpg)
Source: http://ies.ed.gov/ncee and http://ies.ed.gov/ncee/wwc/publications/practiceguides/
Why do we so often stop here?
An Effective Data-Use Model
6
![Page 7: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/7.jpg)
Increased Student Learning
1) Quarterly/ Benchmark Assessments should lead to…
SHORT, aligned assessments.
2) SHORT, assessments aligned to Benchmarks should lead to…
Creating aligned end-of-class DOLs.
3) Creating aligned end-of-class DOLs should lead to…
Responding to daily DOL data in
real time.4) Responding to daily DOL data in real time should lead to…
Quick, targeted remediation.
5) Quick, targeted remediation should lead to…
BETTER STUDENT OUTCOMES
Daily Data101
Backward
Planning
![Page 8: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/8.jpg)
Getting to a Daily Data-Use Mindset
![Page 9: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/9.jpg)
Demonstration of Learning (DOL) at the end of lesson
Dai
ly
What to do next based on your results Metric•Mastery of 80% - 99% Teacher works with a small group so they can catch up.
•Mastery of 60% - 79% Teacher uses as next-day’s Do Now (e.g. error analysis or a peer review) and does a mini-review.
•Mastery of 0% - 60% Teacher works with small groups AND puts independent Learning Activity related to the skill in the classroom for students’ in-class use.
Ignoring Data = Ignoring the Learner’s Needs
When to Intervene: A Suggestion
![Page 10: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/10.jpg)
Part Two: Data Analysis Protocols
Frameworks for Conversations about Results
![Page 11: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/11.jpg)
Teacher Tools
Pre-Assessment Resources
![Page 12: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/12.jpg)
●edConnect assessments are available to preview in advance of the testing window
●Use this as an opportunity to reflect and plan strategies for preparing students
○without “teaching to the test” or, worse, teaching the actual test.
Prior to Starting a New Unit
![Page 13: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/13.jpg)
Teacher Assessment Analysis ToolsConsider using one of the following tools to reflect on the End-of-Unit assessments to aide in unit planning. ●Option 1
○EUA Pre-Assessment Reflection Form●Option 2
○Assessment Analysis Tool
![Page 14: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/14.jpg)
Teacher Tools
Post-Assessment Resources
![Page 15: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/15.jpg)
Teacher Reflection Protocol
Post-EUA Administration Reflection Questions:
○What trends do you find in the data?
○To what would you attribute the results?
○What questions come to mind when you review the data?
○What recommendations would you make to improve student performance?
![Page 16: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/16.jpg)
Some Sample Teacher DAPs
Friendly Guide for Making Sense of Data●Link●This is a basic form teachers can use to reflect on
student performance.Data Analysis Planning Form
●Link●This is another form teachers can use to reflect
on student performance.edConnect Assessment Reflection form
●Link●This form was developed for use in a school using
edConnect during 2014-2015 SY.
![Page 17: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/17.jpg)
Student Tools
Assessment-Reflection Resources
![Page 18: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/18.jpg)
Teach Students to Examine Their Own Data
●Before test, have students set goals [See Hattie’s “Influences on Student Achievement”]
○See this sample student survey●After test, have students complete a self-reflection:○Student Self-Reflection Form
•Sample
18
![Page 19: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/19.jpg)
Teach Students to Examine Their Own Data
Teachers can easily collect students’ self-reflection data:●Student Feedback Form●Sample Form Results
19
![Page 20: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/20.jpg)
Part Three: Next Steps
Monitor and Adjust
![Page 21: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/21.jpg)
QSR Indicator 1.6
Principal as Instructional Leader
Indicator 1.6: The principal ensures that classroom level instruction is adjusted based on formative and summative results from aligned assessments.●A data management system provides teachers
with analytic tools to gain insight into how students are performing and how to design ongoing instruction.
●Students who are not mastering lesson objectives are quickly identified and provided additional instructional supports until they achieve mastery.
![Page 22: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/22.jpg)
Ingredients Needed
●Capacity to design and implement frequent, aligned assessments (ideally on a weekly basis).
●Capacity to quickly and easily access student performance data.
●Ability to meet weekly to discuss student performance citing REAL data from assessments.
●Capacity to monitor student learning during and immediately following instruction.
![Page 23: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/23.jpg)
Need help?
What do you do when you need assistance?Bruce HeneckerActing Director of Data, Assessment, and PlanningNew Jersey Department of [email protected]
![Page 24: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/24.jpg)
In closing...
![Page 25: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/25.jpg)
Effective Data UseData Trend Analysis...
●is a daily practice●informs interventions●informs lesson planning●INCREASES STUDENT LEARNING
You’ll know this is happening when…●Reflection forms are completed●“Problem of practice” is addressed●Gradebook reflects student achievement
![Page 26: Data Analysis Protocols: An Overview A “Ground Up Approach” to Effective Data Use 1](https://reader036.vdocuments.us/reader036/viewer/2022062322/5697bfbe1a28abf838ca2ae4/html5/thumbnails/26.jpg)