Moodle and Analytics

Past, present and future

So many users… So much data! But where are the analytics?

What is it that we actually

mean when we say

‘analytics’?

Wikipedia has a nice definition:

"exploring the unique types of data that come

from educational settings, and using those methods to better understand students"

- Wikipedia entry for Educational Data Mining

Or another way to look at it...

Looking at behaviours in the

past

In order to predict the future.

Such a broad definition...

Right now: we’re less interested in telling

people what learning analytics are...

...more interested in understanding some of the dimensions which make up people's

perceptions.

Learning analytics: Dimensions

The level of automation

The consumer

The target

The scope

1. Level of automation

Manual inference

Raw data shown, users draw their own conclusions.

Automated inference

System uses predefined rules to predict behaviour.

2. The consumer

Personal

Student

Academic

Organisation

System

Systemic

3. The target

Personal

Student

Unit

Faculty

Organisation

Systemic

4. The scope

Isolated Data sourced solely

from within the LMS.

Integrated Data extracted from

the LMS and combined with other

sources.

Which data drive Moodle's analytics?

Moodle logs:

Capture in real time most actions a user performs within the system.

Question: can we draw

more sophisticated

inferences?

Extension Example:

Engagement Analytics

Courtesy of a joint project between Phillip Dawson of Monash University

and NetSpot, supported by the NetSpot Innovation Fund.

Engagement 'trigger' settings

Set with 'sensible' defaults, but can be modified at the course level.

Engagement Block

Engagement report

Dimensions for these analytics?

Automation: Mostly no,

a little yes.

Consumer: Mainly

Lecturer focused.

Target: Subject focused.

Scope: Isolated.

Where to from here?

A few paths of attack:

1. More Moodle plugins

2. Third-party tools with integration points

3.  Integrated Data Stores

Moodle plugins

1. Moodle Progress Bar

2. Configurable reports

3. Analytics & Recommendations block

4. Totara reports (under investigation)

5. Course Dedication block

6. Probably others...

Dimensions for these analytics?

Automation: A mixture

of both.

Consumer: Mainly

Lecturer focused.

Target: Subject or

individual focused.

Scope: Isolated.

Third-party products

1. Blackboard Analytics

2. Starfish EARLY ALERT

3. Probably others...

Dimensions for these analytics?

Automation: Mostly

automated.

Consumer: More

focused at decision-

makers.

Target: Various.

Scope: Integrated.

Integrated Data Stores

Moodle

SIS

Lecture Capture

Virtual Rooms

Library System

e- Portfolio

Data Warehouse +

Analytics

Data Warehouses:

Probably the right way of doing learning analytics 'properly'...

... and also the hardest.

Numerous NetSpot clients already undertaking DW projects with data sourced from Moodle.

Dimensions for these analytics?

Automation: Various.

Consumer: More

focused at decision-

makers.

Target: Various.

Scope: Integrated.

Challenges for analytics:

Where do we focus our efforts in 2013?

Small, simple, isolated plugins?

A larger, cross-platform framework?

Relationship with groups like http://www.solaresearch.org/ ?

Thanks!