measuring & maximizing learner engagement

94
Measuring and Maximizing Learner Engagement Bernie Dodge, PhD San Diego State University : ttp://webquest.org/workshops/engagement8

Upload: bernie-dodge

Post on 22-May-2015

948 views

Category:

Education


1 download

DESCRIPTION

Presentation given at the Conference on Inquiry, Guangzhou, China on August 25, 2010.

TRANSCRIPT

Page 1: Measuring & Maximizing Learner Engagement

Measuring and Maximizing

Learner Engagement

Bernie Dodge, PhDSan Diego State University

:

http://webquest.org/workshops/engagement8

Page 2: Measuring & Maximizing Learner Engagement

As children, we are engaged by everything. As children get older, engagement isn’t automatic.

Page 3: Measuring & Maximizing Learner Engagement

Engagement is like a valve. It controls how much of the information we show students actually gets into their minds.

Page 4: Measuring & Maximizing Learner Engagement

Engagement is like a valve. It controls how much of the information we show students actually gets into their minds.

Page 5: Measuring & Maximizing Learner Engagement

If the valve is closed, not much information comes through for students to process further.

Page 6: Measuring & Maximizing Learner Engagement

The ISTE conference held last June is one of the largest conferences in the world about the use of technology in schools.

Page 7: Measuring & Maximizing Learner Engagement

Searching the program you could see that over 119 sessions mentioned “Engagement’.

Page 8: Measuring & Maximizing Learner Engagement

But what does “engagement” really mean?

Page 9: Measuring & Maximizing Learner Engagement

Whenever I have a question like that, I consult my friends online using Twitter.

Page 10: Measuring & Maximizing Learner Engagement

My Questions to the Twitterverse:

What is engagement? What does it look like?

What looks like engagement but really isn’t?

Page 11: Measuring & Maximizing Learner Engagement

What does engagement mean to YOU?

Page 12: Measuring & Maximizing Learner Engagement

What IS Engagement?

unklar @berniedodge I think "engagement" sometimes has to be taking notes, listening to the teacher, doing homework alone; oh, yeah, and STUDYING!

Page 13: Measuring & Maximizing Learner Engagement

What IS Engagement?

mmuir @berniedodge Eye contact w Head nodding w a smile while the teacher presents looks like engagement but often isn't...

mmuir @berniedodge Kids asking their own questions and finding answers and being excited and teaching others about it is engagement

Page 14: Measuring & Maximizing Learner Engagement

What IS Engagement?

thecleversheep @berniedodge Engagement: utterly tuned in, focused and undistractable; and they don't realize they're learning.

Page 15: Measuring & Maximizing Learner Engagement

Informal Study

N = 265

Describe a learning experience you had that was boring

And one that was fun

Page 16: Measuring & Maximizing Learner Engagement

The subject was the Civil War and we were discussing the tools, weapons, and clothing used during that era. We worked in small teams and moved from one artifact table to another.

We had to figure out what the artifact was, what it was used for, and why it was invented.

We then presented our findings to the class.

Page 17: Measuring & Maximizing Learner Engagement

In my junior American Literature class, we were expected to write a narrative based upon a selected piece of famous art.

We were to study every aspect of the painting and then create a story around it. We were allowed to pick the painting we wanted from a selection and we were allowed to work with a partner.

Page 18: Measuring & Maximizing Learner Engagement

This is gross, but we were learning what causes finger/toenails to become discolored or misshaped.

We looked at slides, read out loud, took notes and then took our shoes off and identified the things we had learned on each other.

Page 19: Measuring & Maximizing Learner Engagement

We constructed hurricane proof houses that we tested using a fan and then a leaf blower. you were given little materials, expected to come up with your own design structure and to explain your selections to a group.

Page 20: Measuring & Maximizing Learner Engagement

Expectations

ListenWatch

Interact with Other LearnersInteract with Instructor

Interact with an ArtifactSit still

Move aroundPerform or Present

RememberThink Creatively

Think Critically

0% 20% 40% 60% 80% 100%

FunBoring

Page 21: Measuring & Maximizing Learner Engagement

Second Study

http://edweb2.net/lmf/index.php

Page 22: Measuring & Maximizing Learner Engagement

http://edweb2.net/lmf/index.php

Page 23: Measuring & Maximizing Learner Engagement
Page 24: Measuring & Maximizing Learner Engagement

http://edweb2.net/lmf/index.php

Page 25: Measuring & Maximizing Learner Engagement

Challenge

0 10 20 30 40 50 60 70 80

highmoderateeasy

# Stories

Page 26: Measuring & Maximizing Learner Engagement

Teacher Enthusiasm

Series1

0 20 40 60 80 100 120

highmediumlow

Page 27: Measuring & Maximizing Learner Engagement

Interaction with other learners

Series1

0 10 20 30 40 50 60 70 80

highmediumlow

Page 28: Measuring & Maximizing Learner Engagement

Other Common Attributes

Instructor warmth

Human interest

More concrete than abstract

Sensory rich

Hands on

Physical activity

Page 29: Measuring & Maximizing Learner Engagement

Out of 160 storiesonly 2 were about a lecture

Page 30: Measuring & Maximizing Learner Engagement

Out of 160 storiesonly 2 were about a lecture

Page 31: Measuring & Maximizing Learner Engagement

Engagement & Technology

They’re all digital natives… so all we need is more hardware, right?

Page 32: Measuring & Maximizing Learner Engagement

When I first moved to California, I was excited by the fact that I could drive for half an hour and be in a different country.

Page 33: Measuring & Maximizing Learner Engagement

I would walk into the market and be overwhelmed by the colors and smells.

Page 34: Measuring & Maximizing Learner Engagement

It all seemed complex and interesting.

I would buy things that I would never buy at home.

Page 35: Measuring & Maximizing Learner Engagement

For example, there were pictures of Jesus painted on black velvet.

There were pictures of Elvis Presley, too.

Page 36: Measuring & Maximizing Learner Engagement

Sometimes you could find a painting with both of them.

Page 37: Measuring & Maximizing Learner Engagement

Caught up in the moment, I

actually bought things

like this.

(Well, not quite this bad.)

Page 38: Measuring & Maximizing Learner Engagement

The same thing happens to people in educational technology

especially at conferences like this.

Page 39: Measuring & Maximizing Learner Engagement

Every day we hear about new tools

especially at conferences like this.

Page 40: Measuring & Maximizing Learner Engagement

Each day is like a visit to a new country

We get excited and a part of our brain shuts down.

Page 41: Measuring & Maximizing Learner Engagement

You’ve got to remember where you came from

Don’t forget what you already knew as a teacher

Page 42: Measuring & Maximizing Learner Engagement

This is from an advertisement I recently received for a 3-D projector

Page 43: Measuring & Maximizing Learner Engagement

It reminded me of this…

Page 44: Measuring & Maximizing Learner Engagement

And came with claims that make my lie detector light up.

Page 45: Measuring & Maximizing Learner Engagement

Magazines are adopting new technologies in the name of engagement and so will textbooks.

Page 46: Measuring & Maximizing Learner Engagement

Magazines are adopting new technologies in the name of engagement and so will textbooks.

Be skeptical. And excited.

Page 47: Measuring & Maximizing Learner Engagement

OK, so what IS engagement?

Page 48: Measuring & Maximizing Learner Engagement
Page 49: Measuring & Maximizing Learner Engagement

Engaged Learning

Conrad & Donaldson Engaged Learning Model

Page 50: Measuring & Maximizing Learner Engagement

Engagement Research

STROBE

Used in medical education

Cycle of observing teacher and students

Validated against self-reports

O’Malley, K. et al, (2003). Validation of an observational instrument formeasuring student engagement in health professions settings. Evaluation & the health professions, 2003, 26; 86.

Page 51: Measuring & Maximizing Learner Engagement

Observation protocol

Page 52: Measuring & Maximizing Learner Engagement

Interactions

Page 53: Measuring & Maximizing Learner Engagement

Interactions

Page 54: Measuring & Maximizing Learner Engagement

Interactions

Page 55: Measuring & Maximizing Learner Engagement

Interactions

Page 56: Measuring & Maximizing Learner Engagement

Interactions

Page 57: Measuring & Maximizing Learner Engagement

To sum it up: Engagement…

is about lots of interaction,

the interaction is about the thing you’re trying to teach,

and students are using as much of the brain as possible.

Page 58: Measuring & Maximizing Learner Engagement

To sum it up: Engagement…

is about lots of interaction,

the interaction is about the thing you’re trying to teach,

and students are using as much of the brain as possible.

Page 59: Measuring & Maximizing Learner Engagement

To sum it up: Engagement…

is about lots of interaction,

the interaction is about the thing you’re trying to teach,

and students are using as much of the brain as possible.

Page 60: Measuring & Maximizing Learner Engagement
Page 61: Measuring & Maximizing Learner Engagement

It’s not easy to get this across to novice teachers

They’ve been damaged

Page 62: Measuring & Maximizing Learner Engagement

If only we had a visual language for talking about this…

Page 63: Measuring & Maximizing Learner Engagement

SDSU Playbook

Page 64: Measuring & Maximizing Learner Engagement

Rhumba

Page 65: Measuring & Maximizing Learner Engagement

Figure Skating

Page 66: Measuring & Maximizing Learner Engagement

Teaching is at least as complicated as football

Or rhumba

Page 67: Measuring & Maximizing Learner Engagement

Interactions Thick lines = intense interaction requiring deep processing

Page 68: Measuring & Maximizing Learner Engagement

Interactions Thin lines = weak interaction requiring shallow processing

Page 69: Measuring & Maximizing Learner Engagement

http://slatest.slate.com/features/news_dots/default.htm

News Dots

Page 70: Measuring & Maximizing Learner Engagement

Interactions Teacher demonstrates the site. Learners watch

Engagement = low

Page 71: Measuring & Maximizing Learner Engagement

Interactions Teacher gives URL. Learners explore.

Engagement = low to medium

Page 72: Measuring & Maximizing Learner Engagement

InteractionsTeacher gives URL and a task: What is in the news that interests you least?

Learners explore and reflect.

Engagement = medium

Page 73: Measuring & Maximizing Learner Engagement

InteractionsTeacher gives URL and a task: Within groups, become an expert on one aspect of the news. Then work together and decide on a prediction about what the top five topics will be tomorrow.

Engagement = high

Page 74: Measuring & Maximizing Learner Engagement

The SAME tool leads to DIFFERENT engagement

It’s all about teaching, not technology

Page 75: Measuring & Maximizing Learner Engagement

http://www.360cities.net/image/sanaa-sunset

360 Cities

Page 76: Measuring & Maximizing Learner Engagement

How could you maximize engaged, powerful learning with the 360 cities

site?

Page 77: Measuring & Maximizing Learner Engagement

InteractionsWorking in groups of

three,decide how to maximize this,

this, and this.

Page 78: Measuring & Maximizing Learner Engagement

What did you come up with?

Page 79: Measuring & Maximizing Learner Engagement

So how can we measure engagement in our own teaching?

Page 80: Measuring & Maximizing Learner Engagement

EOPEngagement Observation Protocol

Page 81: Measuring & Maximizing Learner Engagement

EOP

Put a number from 1 to 10 to indicate the amount of interaction of each type.

Page 82: Measuring & Maximizing Learner Engagement

EOP

Put a number from 1 to 6 to indicate the kind of thinking required by the interaction:1 = Remembering2 = Understanding3 = Applying4 = Analyzing5 = Evaluating6 = Creating

Page 83: Measuring & Maximizing Learner Engagement

EOP

By adding up the weighted sums you can give a lesson an overall score.

Page 84: Measuring & Maximizing Learner Engagement

MEOP

Testing now in Oklahoma

Will be used in San Diego in our Qualcomm project

Quantified feedback

Immediate results

Learning by focused observation

Page 85: Measuring & Maximizing Learner Engagement

Pre-Class

Setup

Page 86: Measuring & Maximizing Learner Engagement

Random Student

Generation

Page 87: Measuring & Maximizing Learner Engagement

3-Minute Cycles

0:00 – 0:59 Observe Teacher & Class

1:00 – 1:29 Observe Student A

1:30 – 1:59 Observe Student B

2:00 – 2:29 Observe Student C

2:30 – 2:59 Observe Student D

Page 88: Measuring & Maximizing Learner Engagement

TeacherObservati

on

Page 89: Measuring & Maximizing Learner Engagement

Student Observat

ion

Page 90: Measuring & Maximizing Learner Engagement

Interactions Thick lines = intense interaction requiring deep processing

Page 91: Measuring & Maximizing Learner Engagement

The Ebb & Flow of Teaching

Student-Teacher

Student-Student

Student-Data

Student-Self

0 2010 4030 50 60

Page 92: Measuring & Maximizing Learner Engagement

Homework: Get a friend to watch you teach

And watch the interactions.

Page 93: Measuring & Maximizing Learner Engagement

Homework: Get a friend to watch you teach

And watch the interactions.Why? Because when you’re teaching you’re too busy to see

everything that‘s going on, no matter how experienced you are.

Page 94: Measuring & Maximizing Learner Engagement

Measuring and Maximizing

Learner Engagement

Bernie Dodge, PhDSan Diego State University

:

http://webquest.org/workshops/engagement8