tlc2016 - taking assessments and examinations to the next level: alephq

Taking assessments and examinations to the next level

Integration of BlackBoard & AlephQ

University of Antwerp – E-Campus

2

IntroductionE-Campus

3

Introduction: E-Campus

• University of Antwerp

• E-Campus: Educational Technologists and Bb support

• Developers AlephQ:

– Christine Lippens: • Part-time teaching assistant Dep. Accounting & Finance• Part-time E-Campus

– Raoul Deuss: E-Campus

4

Motivational EducationImproving effectiveness

5

Accountancy Ba1 - Challenge

• 750 Students

• 1 Lecturer: 10% availability

• 1 Assistant: 40% availability

Challenge = Activated and Efficient education within this HR constraint

Solution = AlephQ in combination with BlackBoard

6

AlephQRich and Flexible examination software

AlephQ – Innovation in examination

• Flexible

• Accurate

• Fast

• Reliable

• User friendly

More details: further on in this presentation

Integration of AlephQ and BlackBoard

Exam file in AlephQ software (local)

Distribution through BlackBoard

9

AlephQRedesign the course set-up

Course – Annual Planning – Before AlephQ

• 12 Lessons

• 2 Exams

Workload examination: 4 weeks x 2 = 8 weeks (1 FTE)

Course – Annual Planning – With AlephQ

• 12 Lessons

• 4 Assignments

• 2 Exams

Workload examination: 1 week x 2Workload assignments: 2 days x 4

3 weeks (1 FTE)

Lesson - Structure

• Lecture

• Exercise session

• Self-study package

• Video

• Forum or Blog

• Wiki

Assignments – AlephQ within BlackBoard

• Compulsory

• Enforced throughmalus system

• Questions: blog or wiki

• Explanation: video

• Personal feedback

• Remediation

Assignments – Communication through BlackBoard

Assignments – Questions in Wiki

Conclusions

Questions

Assignments – Feedback - AlephQ in Content Collection

Building

Block

A+

17

AlephQIn the Electronic Learning Environment

AlephQ in the Electronic Learning Environment

Blog

Fora

Itembank

Calender

VideoSlides

Wiki

Announce ments

Take home

Test

Communication

Collaboration

BLACKBOARD

Docs

CourseMaterial

Evaluation

Examination at Antwerp University

January 2016: 10,300 individual exam papers

20

Why spend time developing something like AlephQ ?

“off the shelf”-solutions do not meet all requirements:

• Exam presentation is exactly like the paper original

• Accurate and differentiated marking

• Detailed personal feedback for students

• Minimise fraud

21

Exam Presentation

Allowable question format constraints

• Adapt the question format to the platform

• Partially give away the answer

• Forced to split questions that really belong in a single exam topic

Exam presentation often degrades course intentions or course level

22

Accurate and Differentiated Marking

Marking algorithm is insufficiently versatile to replace manual marking. The lecturers can:

• Give full marks to correct alternativeanswers

• Give partial marks for partially correct calculations or deductions

• Insist on giving intermediatesteps

• Be assisted by open questions(which cannot be fully automated)

Alternatives

Marking

Formulae

23

Lack of Standardisation across academic disciplines

Specialised toolkits do exist for

• Languages, Maths, Physics, Chemistry, …

Lack of standardisationaffects the workload of:

• Educational technologists

• Lecturers

• Students

ExamsBlackBoardOrtho

didacte

Pearson

Sofia

24

Why Standardisation is essential ?

Universities need

• a stable solution(exams are mission critical)

• technological independence(ad hoc support, control over systems)

• to minimise fraud(disable internet access)

MapleSofia

Mc Graw-

Hill

Pearson

25

Feedback

Desirable in a Motivational Learning Environment …

• Personal

• Detailed

• Efficient (e.g. next day as opposed to 3 weeks later)

• Maintaining security (in high volume and high turnover individualised feedback sessions)

26

AlephQOur Solution

27

AlephQ – Our Solution

Respects the lecturer’s intended question line

• Purpose

• Presentation format

• Marking methodology

New Functionalities

• Atypical question format

(Combining open fields, essay fields, numerical fields, calculations and formulae, with matching marking rules)

28

AlephQPractical Examples

29

AlephQ – Lecturer’s Software

View ChooseClick

30

AlephQ – Students’ Software

31

AlephQ – Students’ Software

32

AlephQ – Personal Feedback

33


34

AlephQ – Results

Total Results – Colors

35

AlephQ – Results

Results by Question – Psychometrics

36

AlephQ – Results

Results by Field– Psychometrics

37

Exam Presentation

Interchangeable

38

Accurate and Differentiated Marking - Accountancy

Alternative answers

39

Accurate and Differentiated Marking - Chemistry

Dependency

40


Formula EditorClick to edit

41


Partial Marks

42


43


Alternatives - Partial Marks

Collected answers

44


Margins

Collected answers

45


Formulae - Partial Marks

Formulae – Edit by Clicking

46

Accurate and Differentiated Marking - Spanish

Quick creation

47

Accurate and Differentiated Marking - Spanish

Automatic implementation

Lecturer marks the alternatives

48

Accurate and Differentiated Marking – Maritime English

Interchangeable & Open

49

Accurate and Differentiated Marking – Maritime English

Lecturer marks the alternatives

50

Accurate and Differentiated Marking – Belgian Family Law


51

Accurate and Differentiated Marking – Belgian Family Law


52

Accurate and Differentiated Marking – Essays

Personal and/or general feedback on essay questions

53

AlephQ – Other functionalities

• Multiple choice

• Multiple answers

• Images

• Images as answers in essays

• Incorporation of attachments

• …

54

AlephQ – Minimise Fraud

Protection on AlephQ files:

• Blocked by ownership after login

• Date restriction

• IP-range restriction

Protection - Exam papers

55


Building BlockAlephQ – Feedback Report

“Rapporteren”

56

Thank you for your interestQuestions ?