academic feedback - university of tennessee · feedback essentials goal-referenced tangible and...

82
Academic Feedback Kim Bell Christi Sampson Mid-Cumberland CORE

Upload: others

Post on 16-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Academic Feedback

Kim Bell Christi Sampson

Mid-Cumberland CORE

Page 2: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Objective

Participants will understand the characteristics of academic feedback

Participants will explore the role academic feedback plays in a Balanced Assessment System

Participants will understand how academic feedback and questioning are interrelated in instructional practices

Participants will gain knowledge of how academic feedback is related to academic success

Page 3: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Introductions

What is your favorite movie? Why is it your favorite movie?

Page 4: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Why Questions are Important….

Page 5: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Why are questions important?

Teachers ask as many as 300 to 400 questions a day.

Questions guide students’ thinking and

determine how students will process materials presented to them.

Questions are the single, most influential

teaching activity.

10/13/2015 5

Page 6: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

10/13/2015 6

Why ? • Direct Student thinking in a particular way.

• Control behavior of the class or individuals.

• Encourage students to be actively engaged in learning • Structure or guide the learning of a task.

• Challenge students.

• Gain feedback from students about teaching.

• Help students clarify their understandings

• Model questioning and thinking.

• Assess Students

• Evaluation purposes

• Challenge students

• Provide opportunities for student learning through discussion

• Identify gaps in student learning

• Encourage reflection on learning

Page 7: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Why do you ask questions?

10/13/2015 7

Page 8: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What Does the Research Say….

Page 9: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What Does the Research Say?

• Discussion – 32 classroom observations – 611 questions asked

• 80% of the questions closed-ended questions requiring little student thought or input (450/611)

• 11% asked students to analyze content/topic (64/611) • 6% required students to synthesize information and generate

new ideas (36/611) • 3% asked students to evaluate the topic or idea (21)

– Important Note—These teachers were using a “Standards-Based Curriculum” and they knew they were going to be observed. They were asked to teach an inquiry-based lesson.

10/13/2015 9

Page 10: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Blooms vs Webb

10/13/2015 10

Page 11: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Levels of Understanding

Creating

Evaluating

Analyzing

Applying

Understanding

Remembering 10/13/2015 11

Extended Thinking

Strategic Thinking

Skills and Concepts

Recall and Reproduction

Blooms Taxonomy Webb’s Depth of Knowledge

Page 12: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Movie Trivia Activity

Page 13: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What is a “take away” for you from the Movie trivia activity?

Good questions require thoughtful

planning.

10/13/2015 13

Page 14: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What does the research say……..

To identify major influences on achievement (using 700+ meta-analyses) Typical Effect Size

Decreased Enhanced Zero

0 .40

Page 15: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Effect Size Above Average

Equivalent to 2 grade leap

Page 16: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Hattie’s Results Effect on Student Learning Effect Size self-report grades 1.44 feedback 0.72 direct instruction 0.59 socio-economic status 0.57 questioning 0.49 motivation 0.48 teacher positive expectations 0.37 homework 0.31 class size 0.21 teacher subject matter knowledge 0.12 ability grouping 0.11 retention -0.16

Page 17: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What is Feedback?

“Feedback is an objective description of a student’s performance intended to guide future performance. Unlike evaluation, which judges performance, feedback is the process of helping our students assess their performance, identify areas where they are right on target and provide them tips on what they can do in the future to improve in areas that need correcting.”

~ W. Fred Miser

Page 18: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What is Feedback?

“Feedback is not about praise or blame, approval or disapproval. That’s what evaluation is – placing value. Feedback is value-neutral. It describes what you did and did not do.”

~ Grant Wiggins

Page 19: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

4 Guiding Questions to consider:

Where is the student going? Where is the student now?

How do we close the gap?

How do we know when they get there?

Page 20: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Feedback Essentials

Goal-referenced

Tangible and transparent

Actionable

User-friendly

Timely

Ongoing

Consistent

Page 21: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

"Effective feedback not only tells students how they performed, but how to improve the next time they engage the task. Effective feedback is provided in such a timely manner that the next opportunity to perform the task is measured in seconds, not weeks or months." Douglas Reeves

Page 22: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Feedback vs. Advice

• You need more examples in your report. • You might want to use a lighter baseball bat. • You should have included some Essential

Questions in your unit plan.

Page 23: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Feedback vs. Evaluation and Grades

• Good work! • This is a weak paper. • You got a C on your presentation. • I’m so pleased by your poster.

Page 24: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback
Page 25: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Motivation and Self-Esteem

Page 26: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

PUZZLE Activity

Article

Page 27: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

“Know Thy Impact” by John Hattie

How to Make Feedback More Effective

Three Levels of Fedback

Tips About What Works

What Doesn’t work

Page 28: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

How to Make Feedback More Effective

• Clarify the Goal • Ensure That

Students Understand the Feedback

• Seek Feedback from Students

Page 29: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

The 3 Levels of Feedback

• Task Feedback • Process Feedback • Self-Regulation

Feedback

Page 30: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Some Tips About What Works

• Disconfirmation – “learning from your mistakes”

• Formative Assessment • Instruction First

Page 31: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What Doesn’t Work

• Praise • Peer Feedback

“must be modeled and taught otherwise it is not successful”

Page 32: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Attaining Excellence

“Students must have routine access to the criteria and standards for the task they need to master; they must have feedback in their attempts to master those tasks; and they must have opportunities to use the feedback to revise work and resubmit it for evaluation against the standard. Excellence is attained by such cycles of model-practice-perform-feedback-perform.”

~ Grant Wiggins

Page 33: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What does this look like?

Page 34: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

“Miss Jones, you kept writing this same word on my English papers all year, and I still don’t know what it means.” “What’s the word?” she asked. “Vag-oo,” he said.

VAGUE many times teacher feedback is ‘vagoo’ – -Grant Wiggins 2012

Page 35: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Vague Feedback

Turn and Talk Share an experience when you were given vague feedback. Share an experience when you were given specific feedback. How did it help you improve? Which feedback had a greater impact on your learning?

10/13/2015 35

Page 36: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

How do we make this happen in the classroom?

Page 37: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Podcasting Personal Feedback

Podcast Feedback What benefits do you observe in giving effective feedback?

10/13/2015 37

Page 38: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Example from a District

Page 39: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Peer Feedback

Precision Teaching

Page 40: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Austin’s Butterfly

Page 41: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Kim Bell - [email protected] Christi Sampson – [email protected]

Page 42: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback
Page 43: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Participants will understand the characteristics of academic feedback

Participants will explore the role academic feedback plays in a Balanced Assessment System

Participants will understand how academic feedback and questioning are interrelated in instructional practices

Participants will gain knowledge of how academic feedback is related to academic success

Page 44: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What is your favorite

movie?

Why is it your favorite

movie?

Page 45: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Why Questions are Important….

Page 46: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Teachers ask as many as 300 to 400 questions a day.

Questions guide students’ thinking and

determine how students will process materials presented to them.

Questions are the single, most influential

teaching activity.

9/8/2015 5

Page 47: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

9/8/2015 6

Why ? • Direct Student thinking in a particular way.

• Control behavior of the class or individuals.

• Encourage students to be actively engaged in learning

• Structure or guide the learning of a task. • Challenge students.

• Gain feedback from students about teaching.

• Help students clarify their understandings

• Model questioning and thinking.

• Assess Students

• Evaluation purposes

• Challenge students

• Provide opportunities for student learning through discussion

• Identify gaps in student learning

• Encourage reflection on learning

Page 48: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

9/8/2015 7

Page 49: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

What Does the Research Say….

Page 50: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

• Discussion – 32 classroom observations

– 611 questions asked • 80% of the questions closed-ended questions requiring little

student thought or input (450/611)

• 11% asked students to analyze content/topic (64/611)

• 6% required students to synthesize information and generate new ideas (36/611)

• 3% asked students to evaluate the topic or idea (21)

– Important Note—These teachers were using a “Standards-Based Curriculum” and they knew they were going to be observed. They were asked to teach an inquiry-based lesson.

9/8/2015 9

Page 51: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

9/8/2015 10

Page 52: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Creating

Evaluating

Analyzing

Applying

Understanding

Remembering

9/8/2015 11

Extended Thinking

Strategic Thinking

Skills and Concepts

Recall and Reproduction

Blooms Taxonomy Webb’s Depth of Knowledge

Page 53: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback
Page 54: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Good questions require thoughtful

planning.

9/8/2015 13

Page 55: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Decreased Enhanced Zero

0 .40

Page 56: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Effect Size

Above

Average

Equivalent

to 2 grade

leap

Page 57: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Effect on Student Learning Effect Size

self-report grades 1.44

feedback 0.72

direct instruction 0.59

socio-economic status 0.57

questioning 0.49

motivation 0.48

teacher positive expectations 0.37

homework 0.31

class size 0.21

teacher subject matter knowledge 0.12

ability grouping 0.11

retention -0.16

Page 58: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

“Feedback is an objective description of a student’s performance intended to guide future performance. Unlike evaluation, which judges performance, feedback is the process of helping our students assess their performance, identify areas where they are right on target and provide them tips on what they can do in the future to improve in areas that need correcting.”

~ W. Fred Miser

Page 59: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

“Feedback is not about praise or blame, approval or disapproval. That’s what evaluation is – placing value. Feedback is value-neutral. It describes what you did and did not do.”

~ Grant Wiggins

Page 60: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Where is the student going?

Where is the student now?

How do we close the gap?

How do we know when they get there?

Page 61: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Feedback Essentials

Goal-referenced

Tangible and transparent

Actionable

User-friendly

Timely

Ongoing

Consistent

Page 62: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

"Effective feedback not only tells students how they performed, but how to improve the next time they engage the task. Effective feedback is provided in such a timely manner that the next opportunity to perform the task is measured in seconds, not weeks or months." Douglas Reeves

Page 63: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

• You need more examples in your report.

• You might want to use a lighter baseball bat.

• You should have included some Essential Questions in your unit plan.

Page 64: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

• Good work!

• This is a weak paper.

• You got a C on your presentation.

• I’m so pleased by your poster.

Page 65: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback
Page 66: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback
Page 67: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Article

Page 68: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

How to Make

Feedback More

Effective

Three

Levels of

Fedback

Tips

About

What

Works

What Doesn’t

work

Page 69: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

• Clarify the Goal

• Ensure That Students Understand the Feedback

• Seek Feedback from Students

Page 70: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

• Task Feedback

• Process Feedback

• Self-Regulation Feedback

Page 71: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

• Disconfirmation – “learning from your mistakes”

• Formative Assessment

• Instruction First

Page 72: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

• Praise

• Peer Feedback “must be modeled and taught otherwise it is not successful”

Page 73: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

“Students must have routine access to the criteria

and standards for the task they need to master;

they must have feedback in their attempts to

master those tasks; and they must have

opportunities to use the feedback to revise work

and resubmit it for evaluation against the

standard. Excellence is attained by such cycles of

model-practice-perform-feedback-perform.”

~ Grant Wiggins

Page 74: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback
Page 75: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

“Miss Jones, you kept writing this same word on my English papers

all year, and I still don’t know what it means.”

“What’s the word?” she asked.

“Vag-oo,” he said.

VAGUE

many times teacher feedback is ‘vagoo’ – -Grant Wiggins 2012

Page 76: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Turn and Talk

Share an experience when you were given vague feedback.

Share an experience when you were given specific feedback.

How did it help you improve?

Which feedback had a greater impact on your learning?

9/8/2015 35

Page 77: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback
Page 78: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Podcast Feedback

What benefits do you observe in giving effective feedback?

9/8/2015 37

Page 79: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Example from a District

Page 81: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback

Austin’s

Butterfly

Page 82: Academic Feedback - University of Tennessee · Feedback Essentials Goal-referenced Tangible and transparent Actionable User-friendly Timely Ongoing Consistent "Effective feedback