e-assessment and the independent learner
DESCRIPTION
Presentation delivered by Phil Butcher (OU) at eAssessment Scotland 2010TRANSCRIPT
![Page 1: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/1.jpg)
E-assessment and the independent learner
Phil ButcherOU E-assessment adviser
September 2010
![Page 2: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/2.jpg)
Student views
“Interactive assessment (is) a particularly good
learning tool, if you are getting the answer wrong it
doesn’t give you the answer right away but gently
coaches you till you get it right yourself.”
“You don't always appreciate what you’re reading
and its significance, until you try and apply it.”
![Page 3: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/3.jpg)
E-assessment for learningThe Open University’s starting position• Our students study independently• …at home• …with a variety of work and study patterns• …they may be in different time zones
• We have sufficiently large student numbers• …to invest in computing and network infrastructure• …to invest in writing e-assessments• …with feedback
• We have lots of reference material online and in print.
![Page 4: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/4.jpg)
E-assessment for learningThe Open University seeks to use technology that is
in the home
• …1987 personal computers at home
• …1998 interactive multimedia on CD
• …2002 first use of e-assessment
• …2005 current version of OpenMark
adopted Moodle as the institutional VLE
![Page 5: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/5.jpg)
Conditions in which assessment supports learning (Gibbs and Simpson 2004)
1. Assessed tasks capture sufficient study time and effort. 2. These tasks distribute student effort evenly across topics and weeks. 3. These tasks engage students in productive learning activity.
4. Assessment communicates clear and high expectations to students.
5. Sufficient feedback is provided, both often enough and in enough detail.
6. The feedback is provided quickly enough to be useful to students.
7. Feedback focuses on learning rather than on marks or students themselves. 8. Feedback is linked to the purpose of the assignment and to criteria.
9. Feedback is understandable to students, given their sophistication.
10.Feedback is received by students and attended to. 11.Feedback is acted upon by students to improve their
work or learning.
![Page 6: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/6.jpg)
E-assessment for learningFour guiding principles behind OpenMark
• The emphasis placed on feedback.
• Allowing multiple attempts.
• The breadth of interactions supported.
• The design for anywhere, anytime use.
![Page 7: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/7.jpg)
The emphasis placed on feedback
![Page 8: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/8.jpg)
Before we go any further
1. Feedback is harder to write than the question or the correct answer.
2. How many students will need it?
3. So how much effort do you put into it?
![Page 9: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/9.jpg)
The emphasis placed on feedback
• S104 – iCMA49 – Question 4 - 2009
![Page 10: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/10.jpg)
The emphasis placed on feedback and marks!• S104 – iCMA49 – Question 4 - 2009
![Page 11: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/11.jpg)
The emphasis placed on feedback and marks!The proportions of students who score 0, 1, 2 or 3 marks per question for several S104 iCMAs.
![Page 12: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/12.jpg)
The emphasis placed on feedback and marks!
Distribution of scores based on first attempt, first two attempts and all attempts for a typical S104 iCMA.
![Page 13: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/13.jpg)
Pertinence to distance learning
• Instant and personalised feedback
…which leads to future learning
…randomization allows re-use
• Economies of scale
• Available 24/7
• Controlled marking and feedback quality
• Linkage via ‘reports’ and a ‘gradebook’ to targetted support (self and teacher monitoring)
![Page 14: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/14.jpg)
OU e-assessment usage
![Page 15: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/15.jpg)
OU impact on Moodle Quiz
• OU Moodle has had full feedback, multiple attempts and better navigation since 2008
• OpenMark integration since 2009
• These features are being added to Moodle 2.1 and will be widely available from 2011
• Moodle Gradebook and Quiz Reports re-writes were also OU sponsored
![Page 16: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/16.jpg)
Phil [email protected]
More interactive examples with feedback
http://www.open.ac.uk/colmsct/projects/icma
http://www.open.ac.uk/openmarkexamples
Where we have reached with Moodle
http://labspace.open.ac.uk/course/view.php?id=3484
![Page 17: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/17.jpg)
A showcase of projects supported in OpenMarkFor interactive demonstrations please visit the websites on the previous slide.
The presentation at eAssessment Scotland used live demonstrations. The following slides are provided for any reader of this Powerpoint presentation.
![Page 18: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/18.jpg)
Showcase
![Page 19: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/19.jpg)
Showcase
![Page 20: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/20.jpg)
Showcase
![Page 21: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/21.jpg)
Showcase
![Page 22: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/22.jpg)
Showcase
![Page 23: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/23.jpg)
Showcase
![Page 24: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/24.jpg)
Showcase
![Page 25: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/25.jpg)
Showcase
![Page 26: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/26.jpg)
Showcase
![Page 27: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/27.jpg)
Showcase
![Page 28: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/28.jpg)
Showcase
![Page 29: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/29.jpg)
Showcase
![Page 30: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/30.jpg)
Showcase
![Page 31: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/31.jpg)
Showcase
![Page 32: e-Assessment and the Independent Learner](https://reader034.vdocuments.us/reader034/viewer/2022051514/548258d8b4af9f910d8b4739/html5/thumbnails/32.jpg)
Showcase