familiarity breeds content peer wise
DESCRIPTION
Showcasing the PeerWise online environment, to illustrate to participants how it can be used by students to generate their own original assessment content in the form of multiple choice questions.TRANSCRIPT
![Page 1: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/1.jpg)
Physics Education ResearchThe University of Edinburgh
1
Familiarity Breeds Content:
Student generated content for
enhanced engagement and learning
Simon Bates, Judy Hardy, Ross Galloway and Karon McBride
http://bit.ly/SGC4L
![Page 2: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/2.jpg)
Physics Education ResearchThe University of Edinburgh
The University of Edinburgh
Edinburgh, Scotland
5th July, 2010
Paul Denny
PeerWisebridging the gap between online learning
and social media
Department of Computer Science
The University of Auckland
New Zealand http://peerwise.cs.auckland.ac.nz/
![Page 3: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/3.jpg)
Physics Education ResearchThe University of Edinburgh
Intro and overview of PeerWise
(Elluminate room)
Hands-on!
http://peerwise.cs.auckland.ac.nz/
Results of pilot implementation at Edinburgh
2010 and 2011 and Q&A
3
![Page 4: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/4.jpg)
Physics Education ResearchThe University of Edinburgh
overview
4
![Page 5: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/5.jpg)
Physics Education ResearchThe University of Edinburgh
Student
familiarity with
Web 2.0
The energy and
creativity of a
large class
Student
requests for
more problems
![Page 6: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/6.jpg)
Physics Education ResearchThe University of Edinburgh
• Web-based MCQ repository built by
students
• Students:
– develop new questions with
associated explanations
– answer existing questions and
rate them for quality and difficulty
– take part in discussions
– can follow other authors
![Page 7: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/7.jpg)
Physics Education ResearchThe University of Edinburgh
• 2007-Summer 2010
– 45 institutions
– 260 courses
– 20661 students have contributed
– 57324 questions have been written
– 1527574 answers have been submitted
![Page 8: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/8.jpg)
Physics Education ResearchThe University of Edinburgh
• To date
– 140 institutions
– 879 courses
– 47719 students have contributed
– 164503 questions have been written
– 3879994 answers have been submitted
![Page 9: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/9.jpg)
Physics Education ResearchThe University of Edinburgh
What we did in our course(s)
9
![Page 10: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/10.jpg)
Physics Education ResearchThe University of Edinburgh
2010 - PeerWise was introduced in
workshop sessions in S1 Week 5
Students worked through
structured introductory activities
Grunge Prowkers test available from www.uwe.ac.uk/elearning/examples/mcq.pdf
10
![Page 11: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/11.jpg)
Physics Education ResearchThe University of Edinburgh
PeerWise was introduced in workshop
sessions in Week 5
Students worked through
structured example task
and devised own Qs
in groups.
11
![Page 12: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/12.jpg)
Physics Education ResearchThe University of Edinburgh
12
![Page 13: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/13.jpg)
Physics Education ResearchThe University of Edinburgh
In S1, an assessment was set for the end
of Week 6:
Minimum requirements:
• Write one question
• Answer 5
• Comment on & rate 3
Contributed ~3% to course assessment13
![Page 14: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/14.jpg)
Physics Education ResearchThe University of Edinburgh
14
![Page 15: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/15.jpg)
Physics Education ResearchThe University of Edinburgh
We were deliberately
hands off.
• No moderation
• No corrections
• No interventions at all
But we did observe…..
15
![Page 16: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/16.jpg)
Physics Education ResearchThe University of Edinburgh
Your turn!
http://peerwise.cs.auckland.ac.nz/
• Click on ‘Get started’ top right
• Course code 5808
• Pick a username (user001-user100)
• Create some general knowledge Qs
16
![Page 17: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/17.jpg)
Physics Education ResearchThe University of Edinburgh
What we found
engagement, examples, effects
17
![Page 18: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/18.jpg)
Physics Education ResearchThe University of Edinburgh
18
It’s just a
gimmick…..
![Page 19: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/19.jpg)
Physics Education ResearchThe University of Edinburgh
Uptake for in-
course assessment
(class size of
~200)
350 questions
in total
~3500 answers
~2000 comments
19
Workshop
training
Live Due
![Page 20: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/20.jpg)
Physics Education ResearchThe University of Edinburgh
20
They’ll put in
nonsense &
irrelevant
questions….
![Page 21: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/21.jpg)
Physics Education ResearchThe University of Edinburgh
21
![Page 22: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/22.jpg)
Physics Education ResearchThe University of Edinburgh
Quality of submissions:
• Average quality was very good
• Few trivial questions / nonsense distracters
• ‘Community moderation’ discouraged sub-par questions
22
![Page 23: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/23.jpg)
Physics Education ResearchThe University of Edinburgh
23
The questions will
be poor quality… rote learning, factual recall
blah blah blah…..
![Page 24: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/24.jpg)
Physics Education ResearchThe University of Edinburgh
24
![Page 25: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/25.jpg)
Physics Education ResearchThe University of Edinburgh
![Page 26: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/26.jpg)
Physics Education ResearchThe University of Edinburgh
26
The science
will be all
wrong……
![Page 27: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/27.jpg)
Physics Education ResearchThe University of Edinburgh
27
![Page 28: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/28.jpg)
Physics Education ResearchThe University of Edinburgh
Perceptions
We sought student feedback both in
‘wash-up’ sessions after the
assessment and in the end of course
questionnaire
28
![Page 29: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/29.jpg)
Physics Education ResearchThe University of Edinburgh
Positives
29
![Page 30: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/30.jpg)
Physics Education ResearchThe University of Edinburgh
Positives
30
![Page 31: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/31.jpg)
Physics Education ResearchThe University of Edinburgh
Negatives
31
![Page 32: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/32.jpg)
Physics Education ResearchThe University of Edinburgh
32
… but they’ll
lose interest
after a while….
![Page 33: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/33.jpg)
Physics Education ResearchThe University of Edinburgh
Mid-semester
deadline
![Page 34: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/34.jpg)
Physics Education ResearchThe University of Edinburgh
End-of-semester
deadline
![Page 35: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/35.jpg)
Physics Education ResearchThe University of Edinburgh
35
… but you can’t
prove that
greater use
correlates with
performance….
![Page 36: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/36.jpg)
Physics Education ResearchThe University of Edinburgh
Low PeerWise
Activity
High PeerWise
Activity
![Page 37: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/37.jpg)
Physics Education ResearchThe University of Edinburgh
Matched Pairs: Scottish, male, non-majors
1 2 3 4 5 6
PW
activityX MPA X MPA LPA LPA
No
auth
PW
markX 23 X 23 14 14
CW 70 71 48 50 62 67
Exam 56 69 49 54 40 34
Grade B A D C D Fail
![Page 38: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/38.jpg)
Physics Education ResearchThe University of Edinburgh
38
Take-homes:
• Provide orientation task
• Set the quality bar very high
• Force yourself to be hands-off
• Set an assessment task
• Leave the deadline as late as you can
• Assessment is quality-based but light-load (no
direct marking required)
• Unleash the creativity of your students!
![Page 39: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/39.jpg)
Physics Education ResearchThe University of Edinburgh
Now under way:
JISC Assessment and Feedback research project:
Student Generated Content for Learning
(SGC4L)
http://bit.ly/SGC4L
![Page 40: Familiarity breeds content peer wise](https://reader033.vdocuments.us/reader033/viewer/2022052910/559b26e21a28ab4a488b47d6/html5/thumbnails/40.jpg)
Physics Education ResearchThe University of Edinburgh
http://bit.ly/EdPER
Acknowledgements:We gratefully acknowledge funding from
• JISC
• Higher Education Academy UK Physical
Sciences Centre.