computer-aided assessment (caa) although my talk was a ‘live’ demonstration of my questions,...
Post on 21-Dec-2015
215 views
TRANSCRIPT
![Page 1: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/1.jpg)
Computer-aided assessment (CAA)
• Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and the main issues involved, plus bits I forgot/didn’t have time to say. If you have questions email me at: [email protected]
![Page 2: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/2.jpg)
Computer-aided assessment
Random market shares and number of companies
Font colours and sizes can be chosen by the user
![Page 3: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/3.jpg)
(Accurate) SVG graph draw at runtime (NOT a graphic and
will resize according to chosen font size)
Mal-rules in action here test the meaning of inequalities
In a LP question, each of the 3 possible option points is
‘reverse engineered’ to have integer coordinates.
![Page 4: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/4.jpg)
Feedback
Randoms carried through to the feedback
Related material button triggers additional web links
![Page 5: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/5.jpg)
Randoms are all the numbers in the supply and demand
equations and the currency chosen ($ in this case)
![Page 6: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/6.jpg)
Part of the extensive feedback given; this has proven to be
useful to students who spend a lot of time studying it
![Page 7: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/7.jpg)
Feedback continued: SVG graph plotted according to the
question randoms
![Page 8: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/8.jpg)
Going beyond maths … Synonyms
![Page 9: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/9.jpg)
Skeleton sentence with a) random number of errors
b) Look-up array of likely errors e.g. effect/affect etc
![Page 10: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/10.jpg)
Statement =Subject + Property
![Page 11: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/11.jpg)
Results of calculus trials
• Error taxonomyError Type Classification
Assumption Students assume certain things that are not true, for example, in projectile
questions, that vertical velocity is equal to initial velocity.
Calculation Method correct but calculation errors are made.
Copying Copying values incorrectly.
Definition Not knowing the definition of terms given in question text, e.g. magnitude.
Formulas Incorrectly stating/recalling formulas.
Incorrect Values
Used
Using incorrect values in method, for example, when substituting values
into formulas.
Knowledge Knowledge students are lacking that would enable them to answer
questions.
Methodology Students attempt to use an incorrect method to answer a question.
Modelling Generic definition, e.g. ignoring forces, such as gravity, acting on particles.
Procedural
Method student attempts to use is correct but can only do initial/certain
stages of the method. They stop halfway through when they do not know
the stages that follow or when they are unable to interpret initial results.
Reading Reading the question text incorrectly and confusing the value of variables.
Trigonometry Basic definitions of cosine, sine and tan incorrect. This is most apparent in
questions where students are required to resolve forces.
![Page 12: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/12.jpg)
Efficacy of feedback: what do students say about it
• Quantity and timing of the feedback
![Page 13: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/13.jpg)
Efficacy of feedback: what do students say about it
• Quality of the feedback
![Page 14: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/14.jpg)
Efficacy of feedback: how long do students retain it
![Page 15: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/15.jpg)
Efficacy of feedback: Indicators for understanding exam scripts
New Lecturer
New Lecturer
Lab sessions integrated in module
CAA available but lab sessions not integrated into
module
![Page 16: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/16.jpg)
Efficacy of feedback: Analysis of marks
Topics for which CAA was provided (beams, static equilibrium, structures, vectors)
Topics for which CAA was not provided (centre of mass, Hookes Law, kinematics, projectiles)
1999/2000 – 2003/4
2004/5 – 2005/6
CAA provided
Chapter 1 Ke
y
Test 1a
Test 1b
Test 2b
Test 2a
Academic Years
![Page 17: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/17.jpg)
Conclusions
• Mal-rules apply in other areas of maths.
• Error taxonomy applies in other areas of maths.
• CAA is a popular resource to use.
• CAA is effective, if skills are tested and full feedback is given.
• CAA can be effectively applied beyond mathematics.
![Page 18: Computer-aided assessment (CAA) Although my talk was a ‘live’ demonstration of my questions, these slides will give you a flavour of what was said and](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d5d5503460f94a3c0c9/html5/thumbnails/18.jpg)
Two other (unrelated) things
• See my Study Skills for Maths Students at: http://people.brunel.ac.uk/~mastmmg/ssguide/sshome.htm
• I have been playing with a Smartpen which looks very useful for maths solutions where one can record a synchronous commentary. See: http://www.livescribe.com/