new directions in learning: badges and peer assessment (206182541)

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 1/23

Writing in Coursera The Challenges of Peer Assessment

Elise Mueller Duke UniversityELI 2014

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 2/23

my street cred

English Composition I: Achieving Expertise (April 2013) 9/11 and Its Aftermath (Sept 2013)

History and Future of Higher Education (January 2014)

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 3/23

but what about the humanities?

http://bit.ly/1dUMyXs http://bit.ly/1aS0Mm3

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 4/23

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 5/23

Draft Final

Draft Final

Project 1 Project 2 Project 3

Draft Final

P

Draft

Week 1 Week 2Submit essay Read and evaluate

Each phase is two weeks long

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 6/23

the numbers

8 total peer assessments

3700 first draft submissions (April 1)1400 final project (June 3)2200 students a week (average)

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 7/23

how we got ready

staff numbersresources

assessment / ESL expertsvideo content

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 8/23

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 9/23

writer’s block

● difficulties using the tool for the first time● student reactions were disheartening

● rubric and assignment design isn’t enough● peer assessment isn’t culturally transparent

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 10/23

these are my peers?!

“I don't know how getting feedback from peoplwho are terrible at [writing] themselves

… could improve my project.”

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 11/23

these are my peers?!

“I think peer-assessment is beneficial and justas Prof. Comer always says "Reading others'works makes us a better writer", but I thiprofessors should grade us as well, tomake it more fair and less subjective.”

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 12/23

no feedback on my feedback

“I am upset that I got very insufficient feedbackfrom three evaluators! … I encourage theprofessor and her assitance [sic] to makeoption to evaluate peer's feedback!will help students stay motivated.”

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 13/23

english as a second language

“There seems to be so many ESL studethat can not form a basic englishsentence or have a big enough vocabulary t

do the first assignment. I admire anyone takingthis course for their desire to learn and grow,but it is very difficult to read these papers.”

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 14/23

english as a second language

“As non native English speaker, I must sthe feedback 'should improve grammaror sentence' doesn't help me at allhere willing to improve my English proficiencybut without constructive and clear feedback Iwill not be able to do so…”

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 15/23

http://bit.ly/1b0M8sw

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 16/23

learning happens everywhere

procrastinator’s corner

writing workshopsself-reflections

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 17/23

peer feedback is useful

"I got wonderful, constructive and meaningfulfeedback -- I can truly improve my writing.

Thank you to the peers who corrected mywork for Project 2."

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 18/23

giving feedback is useful

I have given peer feedback for 15 drafts andevaluated 20 final projects from anonymous

peers. That was a really good way tolearn about what works and what doesnot .

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 19/23

a writing community

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 20/23

peer assessment research

Denise Comer’s reader reliability study200 student writing portfolios

Cathy Davidson’s peer assessment research

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 21/23

recommendations

● rubrics with yes/no questions● automated forum posts for accountability● low-stakes when possible● less is more● training phase and examples

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 22/23

Thank You

Presentation available here:

http://bit.ly/1f1MfrT

8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)

http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 23/23

Image Creditscomputer: http://openclipart.org/detail/17391/computer-by-ytknick

scholar: http ://openclipart.org/detail/1214/writing-my-master%EF%B F%BDs-words-by-lif

judges: http://1.bp.blogspot.com/-Oph jvmNpxlk/TxLvQoAXTyI/AAAAAAAAADQ/kHFqPPfV1zk/s1600/jud ges-scorecard.png

writer’s blo ck: http://commons.wikimedia.org/wiki/File:Schreibblockade.JP G

keyboard: http://upload.wikimedia.org/wikipedia/com mons/f/fc/Computer_keyboard.gif