student peer review - improving feedback and enhancing learning
DESCRIPTION
Student Peer Review - Improving Feedback and Enhancing Learning. Dr Anne Jones Centre for Educational Development Dr Bjoern Elsaesser School of Planning, Architecture and Civil Engineering. Structure. Introduction to peer review Case example from MEng Civil Engineering Level 4 module - PowerPoint PPT PresentationTRANSCRIPT
Student Peer Review - Improving Feedback and Enhancing Learning
Dr Anne JonesCentre for Educational Development
Dr Bjoern ElsaesserSchool of Planning, Architecture and Civil Engineering
Structure
• Introduction to peer review• Case example from MEng Civil Engineering
Level 4 module• Some software to support peer review
Peer assessment or peer review?
• Peer assessment – where students award marks and may also give feedback
• Peer review – students provide feedback to each other – develops students’ ability to construct feedback
• Peer learning
Peer feedback can …
• Add to the amount and variety of feedback students already receive without adding to staff workload
• Address timeliness while it matters and with the opportunity to act on it
• Provide feedback in a language understood by the students
• Provide multiple sources of feedback – more realistic of the real world – develops ability to reconcile different viewpoints
• Engage students in constructing feedback
Engage students in constructing feedback
• Active learners – high level activity that is cognitively demanding
• Active engagement with criteria and standards• Often there is an element of reciprocity – feedback
provided on the same piece of work• Disciplinary expertise – writing feedback
commentaries deepens understanding• Learning communities • Self-assessment skills and professional life
Staff concerns
• Students do not have the knowledge or skill to comment on another’s work
• Too critical and harsh in their comments• Compromise academic integrity• Too time consuming
Student concerns
• ‘This is your job’ • ‘We don’t know how to do this’• ‘I wouldn’t trust the comments of another
student’• ‘What if I get a weaker student or someone I
don’t trust reviewing my work?’
Implementing peer review• Use exemplars to introduce students to the
process• Ask students to suggest something which
could be improved upon or is not included which could be relevant
• Ask students to review more than one piece of work so that the author of the work has comments to compare – and self-assess
• Tutor provides assessment on the quality of the feedback – ensures students engage
TESTA project• Poor quality lab reports• Students worked in groups to produce their lab
report as a poster• Students asked to write comments on all the posters• → increased learning gains in lab reporting and exams• Encouraged time and effort on challenging tasks• Opportunity to use the feedback• Creates learning communities
Hammer, Kell and Spence (2007)• Peer review and feedback on essay in English
with 80 students• Used electronic software Aropä which manages
the anonymous distribution – cf PeerMark• Assessment rubric provided by staff• Marks for participation NOT quality • Set up so that student did not review their own
topic
• Students asked to provide a response to the following: – What issue is the essay addressing?– What is the main argument? Or suggest an
argument– What support does the author offer for the
argument? Suggest a counter-argument– Identify a characteristic sentence in the draft and
suggest how it might be improved
• Student views:– Positive– Doing the review and using the assessment
criteria gave them an insight into how their work was assessed
– Providing feedback would help them become more able to self-assess
– Identified ‘blind spots’ in their own writing and learned from the writing styles of others
DR BJOERN ELSAESSERSCHOOL OF PLANNING, ARCHITECTURE & CIVIL ENGINEERING
USING PEER REVIEW IN HYDRAULICS 4 CIV4026
Content
• Introduction to the topic• Overview of module
• Issues with students’ learning• Student peer review process
• Example reviews• The lecturer’s experience
• Pros & cons• Wider issues with module
• Conclusion
Hydraulics 4 MEng/MSc Civil Eng ½ module in 2nd semester of level 4
35 -20 students-> introduce students to the principles and practice of
advanced fluid mechanics in engineering-> emphasis on environmental problems and
renewable energy systems
12 weeks split into two parts:– ~5 weeks for research of topic and report / lecture
2 weeks peer assessment of above
– 5 weeks applied analysis to engineering problemReporting and presentation
Hydraulics 4 MEng/MSc Civil Eng Topics taught:Hydropower & Tidal power • Turbo machinery in hydropower, types, typical features,
characteristics, key design specifications• Free stream rotors, types, blade element momentum theory,• Design of spillways and overflow structures, • Aspects of hydrodynamic forces on structures in rivers, coasts
and offshoreTransient & two phase flow problems • Transient pipe flows / Surge chambers and overflows,• Sediment transport processes,Hydrodynamics theory• Navier Stokes equation & its application
Deficit of students at level 4
• Reports had been very superficial• Very little evidence based description of topics• Limited number of equations and factual
design guidance• Limited evidence of acquired transferable
knowledge• Heavily criticised by colleagues as “easy”
subject (reflected by student numbers)
AssessmentGroup report / lecture note
Peer review Project / Analysis Presentation
Groups of 2-4 students
One topic
45%
Individual
All other topics
10%
Group as previous
Topic different to previous
35%
Group
On project / analysis
10%
Ongoing consultation with lecturer
Lecturer edited peer feedback
Ongoing consultation with lecturer
Verbal feedback
Feedback
Setting out the peer review
• Students informed at introduction about the peer review process
• Review does not replace tutor’s marking, review forms part of indiv. assessment
• Students are given marking sheet and criteriaTotal marks set out for each criteria
• At review stage process is explained again• Students are asked to review as individual (not in
groups)
Example reviews
The lecturer’s experience• Has worked well and not increased workload• Can provide strong evidence for “freeloaders”• Vehicle to providing feedback to students• Review provide an excellent assessment
matrix• Widened the gap between good and less
adept students?
Assessment matrixName Total number of words in
the assessment Difference between top and lowest score
Student A ~ 2700 words 14.5 marks Student B ~ 2300 words 14 marks Student C ~ 600 words 9.5 marks Student D ~ 600 words 5 marks Student E ~ 450 words 7 marks
peer review – the issues
Pros• Widens knowledge from
one topic to several• Individual mark for
individual students• Good students clearly
identify deficits and apply to their own work
• Quick feedback
Cons• Low grade students left
behind?– Own assessment– Ability to judge good work
from poor– Skim only surface of topic
• Assessment of peer review is summative, no chance to improve
Wider issues in Hydraulics 4
• Varying student number• Varying quality of reports produced• Staff effort• Evidence of enhanced knowledge &
understanding• Widening gap between different grades of
students
Using technology to support peer review
• PeerMark• PeerWise
PeerMark• Part of the Turnitin suite• Students upload work• System can be set up to distribute the papers
randomly and anonymously if required• Includes option for self-review• Can include a rating if peer assessment is wanted• Tutor can see all reviews• Ability to make all reviews available to the group
following the exercise
PeerWise• University of Auckland
http://peerwise.cs.auckland.ac.nz/ • Free – open source• Staff set up the class• Students asked to register and select nom de plume - • Students write MCQs with appropriate feedback• Students answer and review the questions of their
peers• High level cognitive activity
References
• Hamer, J., Kell, C. and Spence, F. (2007) Peer assessment suing Aropä, Australian Computing Society, available at: http://www.cs.auckland.ac.nz/~j-hamer/peer-assessment-using-Aropa.pdf
• Nicol, D (2010) From monologue to dialogue: improving written feedback in mass higher Education Assessment and Evaluation in Higher Education, 35:5, 501-517
• TESTA project http://www.testa.ac.uk/resources/videos