online assessments through moodle quiz · moodle quiz access rule plugin starts node js server...

19
Online Assessments through Moodle Quiz Problem statement and Solution proposal

Upload: others

Post on 29-May-2020

24 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Online Assessments through Moodle QuizProblem statement and Solution proposal

Page 2: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Assessment tests

● Entrance / Admission

● Internal / Semester

● Placements

(Recruitment)

Online Assessments in Education

Potential Exams

2

Page 3: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

● 800+ universities

● ~40,000 colleges

● ~10,00,000 schools

Online Assessments Platforms

● Each seem to handle about

20 clients in education

3

Page 4: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

● Controller of Exams

may wish to have “full

control” of the platform

Open source and Scalable Platforms?

Potential Exams

4

Page 5: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

What Moodle Can?

● User enrolment

● Question authoring

● Variety of Types

● Question Bank

● Randomisation

● Response Analysis

5

Available capabilities

Page 6: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

What Moodle Needs?

A Wishlist of Standard Practices

● Room management● Time loss

accounting● Rich psychometrics ● Q & A Security

6

Page 7: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

User Stories

As a Test Administrator, I would like to

● Restrict a candidate to a

specific location● Automatically grant extra

time for lost-time due to

hardware/network failures

● Manage configurations of

multiple similar examinations

● Isolate authoring and

delivery of questions (across

servers/LANs)

7

Page 8: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Make moodle easily manageable by Controller of Examinations

8

Page 9: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Contributions from FOSSEE ProjectIIT Bombay

9

Page 10: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Scenario 01

Setting up exam in a classroom

10

Page 11: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

User-IP Mapping

● manage a given seating

arrangement

● map users to a given

terminal (IP address)

● pre-assign locations and

announce to users

● commonly done for

pen-paper exams

User : fooIP : 10.1.7.32

User : jklIP : 10.102.7.35

User : defIP : 10.102.7.33

User : booIP : 10.1.7.34

User : farIP : 10.1.7.35

User : barIP : 10.1.7.33

01

11

Page 12: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Scenario 02

Factoring Hardware and Network Failures

12

Page 13: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Auto increment quiz time limit

● Loss of time due to

system failures

● User overrides need not

be created manually

02

x1 | User starts quiz

3 | Quiz time extended automatically

2 | Time lost due to network problem

No need to create user-overrides 13

Page 14: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Heartbeat PluginImplementation

Socket programming

● Moodle Quiz Access Rule Plugin○ starts Node JS server○ provides client.js ○ live monitoring of dead/alive○ create user overrides

● User’s Browser client.js○ Connects websockets○ Maintains ping/pong○ New socket for every quiz

page● Node JS server

○ Creates a “RoomID” for every user-quiz-attempt

○ Calculates lost time between disconnect and connect

14

Page 15: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

IIT Bombay Tests

Production Data

● PhD Recruitment

2018

● Placements 2018

● Job recruitments

15

Page 16: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Caveats? ● Socket testing with

JMeter not realistic

● Code Refactoring

16

Page 17: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

FOSSEE Moodle Team

17

Kashmira Nagwekar

Amrata Ramchandani

Page 18: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Provide Moodle Services to Exam Bodies● Server Setup & Maintenance● Training● Contribute to Building a Robust

Exam Code & Plugins

18

Page 19: Online Assessments through Moodle Quiz · Moodle Quiz Access Rule Plugin starts Node JS server provides client.js live monitoring of dead/alive create user overrides User’s Browser

Thank You

19