new directions in learning: badges and peer assessment (206182541)
TRANSCRIPT
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 1/23
Writing in Coursera The Challenges of Peer Assessment
Elise Mueller Duke UniversityELI 2014
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 2/23
my street cred
English Composition I: Achieving Expertise (April 2013) 9/11 and Its Aftermath (Sept 2013)
History and Future of Higher Education (January 2014)
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 3/23
but what about the humanities?
http://bit.ly/1dUMyXs http://bit.ly/1aS0Mm3
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 4/23
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 5/23
Draft Final
Draft Final
Project 1 Project 2 Project 3
Draft Final
P
Draft
Week 1 Week 2Submit essay Read and evaluate
Each phase is two weeks long
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 6/23
the numbers
8 total peer assessments
3700 first draft submissions (April 1)1400 final project (June 3)2200 students a week (average)
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 7/23
how we got ready
staff numbersresources
assessment / ESL expertsvideo content
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 8/23
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 9/23
writer’s block
● difficulties using the tool for the first time● student reactions were disheartening
● rubric and assignment design isn’t enough● peer assessment isn’t culturally transparent
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 10/23
these are my peers?!
“I don't know how getting feedback from peoplwho are terrible at [writing] themselves
… could improve my project.”
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 11/23
these are my peers?!
“I think peer-assessment is beneficial and justas Prof. Comer always says "Reading others'works makes us a better writer", but I thiprofessors should grade us as well, tomake it more fair and less subjective.”
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 12/23
no feedback on my feedback
“I am upset that I got very insufficient feedbackfrom three evaluators! … I encourage theprofessor and her assitance [sic] to makeoption to evaluate peer's feedback!will help students stay motivated.”
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 13/23
english as a second language
“There seems to be so many ESL studethat can not form a basic englishsentence or have a big enough vocabulary t
do the first assignment. I admire anyone takingthis course for their desire to learn and grow,but it is very difficult to read these papers.”
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 14/23
english as a second language
“As non native English speaker, I must sthe feedback 'should improve grammaror sentence' doesn't help me at allhere willing to improve my English proficiencybut without constructive and clear feedback Iwill not be able to do so…”
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 15/23
http://bit.ly/1b0M8sw
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 16/23
learning happens everywhere
procrastinator’s corner
writing workshopsself-reflections
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 17/23
peer feedback is useful
"I got wonderful, constructive and meaningfulfeedback -- I can truly improve my writing.
Thank you to the peers who corrected mywork for Project 2."
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 18/23
giving feedback is useful
I have given peer feedback for 15 drafts andevaluated 20 final projects from anonymous
peers. That was a really good way tolearn about what works and what doesnot .
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 19/23
a writing community
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 20/23
peer assessment research
Denise Comer’s reader reliability study200 student writing portfolios
Cathy Davidson’s peer assessment research
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 21/23
recommendations
● rubrics with yes/no questions● automated forum posts for accountability● low-stakes when possible● less is more● training phase and examples
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 22/23
Thank You
Presentation available here:
http://bit.ly/1f1MfrT
8/13/2019 New Directions in Learning: Badges and Peer Assessment (206182541)
http://slidepdf.com/reader/full/new-directions-in-learning-badges-and-peer-assessment-206182541 23/23
Image Creditscomputer: http://openclipart.org/detail/17391/computer-by-ytknick
scholar: http ://openclipart.org/detail/1214/writing-my-master%EF%B F%BDs-words-by-lif
judges: http://1.bp.blogspot.com/-Oph jvmNpxlk/TxLvQoAXTyI/AAAAAAAAADQ/kHFqPPfV1zk/s1600/jud ges-scorecard.png
writer’s blo ck: http://commons.wikimedia.org/wiki/File:Schreibblockade.JP G
keyboard: http://upload.wikimedia.org/wikipedia/com mons/f/fc/Computer_keyboard.gif