Download - Global experiences with e-learning and data
![Page 1: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/1.jpg)
Global experiences with e-learning and data
Smart learning conference3rd of May 2016, Copenhagen
@DrBartRientiesReader in Learning Analytics
![Page 2: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/2.jpg)
Innovating Pedagogy Reports
Explores new forms of teaching, learning and assessment for a digital world
To guide teachers and policy makers in productive innovation
www.open.ac.uk/innovating
![Page 3: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/3.jpg)
![Page 4: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/4.jpg)
Mobile phones in 1999?
4
![Page 5: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/5.jpg)
So what kinds of emotions did you experience while watching this video?
5
![Page 6: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/6.jpg)
So what kinds of emotions did the participants experience?
6
![Page 7: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/7.jpg)
7
![Page 8: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/8.jpg)
8
![Page 9: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/9.jpg)
9
![Page 10: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/10.jpg)
Technology to measure emotions is in your hands
10
![Page 11: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/11.jpg)
Technology to measure emotions is in your hands
11
![Page 12: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/12.jpg)
12
Rantakari, J., Inget, V., Colley, A., & Hakkila, J. (2016). Charting Design Preferences on Wellness Wearables. Paper presented at the Proceedings of the 7th Augmented Human International Conference 2016, Geneva, Switzerland.
![Page 13: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/13.jpg)
Tremendous opportunities for improving education
13
Understand why students “get lost”Allow students to reach their full potentialAutomatic feedback to students and teachers
![Page 14: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/14.jpg)
What are the largest challenges?Ethical implications of continuously measuring emotions on smart phones, tablets, laptops, fitbits, wearables?How to deal with individual differences (e.g., expressiveness, moods)?How to deal with cultural differences?
14
![Page 15: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/15.jpg)
![Page 16: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/16.jpg)
![Page 17: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/17.jpg)
![Page 18: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/18.jpg)
![Page 19: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/19.jpg)
![Page 20: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/20.jpg)
![Page 21: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/21.jpg)
![Page 22: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/22.jpg)
![Page 23: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/23.jpg)
![Page 24: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/24.jpg)
Assimilative Finding and handling information
Communication
Productive Experiential Interactive/
Adaptive
Assessment
Type of activity
Attending to information
Searching for and processing information
Discussing module related content with at least one other person (student or tutor)
Actively constructing an artefact
Applying learning in a real-world setting
Applying learning in a simulated setting
All forms of assessment, whether continuous, end of module, or formative (assessment for learning)
Examples of activity
Read, Watch, Listen, Think about, Access, Observe, Review, Study
List, Analyse, Collate, Plot, Find, Discover, Access, Use, Gather, Order, Classify, Select, Assess, Manipulate
Communicate, Debate, Discuss, Argue, Share, Report, Collaborate, Present, Describe, Question
Create, Build, Make, Design, Construct, Contribute, Complete, Produce, Write, Draw, Refine, Compose, Synthesise, Remix
Practice, Apply, Mimic, Experience, Explore, Investigate, Perform, Engage
Explore, Experiment, Trial, Improve, Model, Simulate
Write, Present, Report, Demonstrate, Critique
![Page 25: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/25.jpg)
![Page 26: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/26.jpg)
Method – data sets• Combination of four different data sets:
• learning design data (189 modules mapped, 276 module implementations included)
• student feedback data (140)• VLE data (141 modules)• Academic Performance (151)
• Data sets merged and cleaned• 111,256 students undertook these modules
![Page 27: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/27.jpg)
Toetenel, L. & Rienties, B. (2016). Analysing 157 Learning Designs using Learning Analytic approaches as a means to evaluate the impact of pedagogical decision-making. British Journal of Educational Technology.
![Page 28: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/28.jpg)
Constructivist Learning Design
Assessment Learning Design
Productive Learning Design
Socio-construct. Learning Design
VLE Engagement
Student Satisfaction
Student retention
Learning Design151 modules
Week 1 Week 2 Week30+
Disciplines LevelsSize module
Rienties, B., Toetenel, L., (2016). The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across 151 modules. Computers in Human Behavior, 60 (2016), 333-341
![Page 29: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/29.jpg)
Average time spent per week in VLE
![Page 30: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/30.jpg)
Cluster 1 Constructive (n=73)
![Page 31: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/31.jpg)
Cluster 2 Assessment (n=10)
![Page 32: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/32.jpg)
Cluster 3 Productive (n=38)
![Page 33: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/33.jpg)
Cluster 4 Social Constructivist (n=20)
![Page 34: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/34.jpg)
Week Assim Find Com. Prod Exp Inter Asses Total
-2 -.03 .02 -.02 -.09 .20* -.03 .01 .35** -1 -.17* .14 .14 -.01 .30** -.02 -.05 .38**
0 -.21* .14 .37** -.07 .13 .08 .02 .48**
1 -.26** .25** .47** -.02 .28** .01 -.1 .48**
2 -.33** .41** .59** -.02 .25** .05 -.13 .42**
3 -.30** .33** .53** -.02 .34** .02 -.15 .51**
4 -.27** .41** .49** -.01 .23** -.02 -.15 .35**
5 -.31** .46** .52** .05 .16 -.05 -.13 .28**
6 -.27** .44** .47** -.04 .18* -.09 -.08 .28**
7 -.30** .41** .49** -.02 .22** -.05 -.08 .33**
8 -.25** .33** .42** -.06 .29** -.02 -.1 .32**
9 -.28** .34** .44** -.01 .32** .01 -.14 .36**
10 -.34** .35** .53** .06 .27** .00 -.13 .35**
![Page 35: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/35.jpg)
Model 1 Model 2 Model 3
Level0 -.279** -.291** -.116
Level1 -.341* -.352* -.067
Level2 .221* .229* .275**
Level3 .128 .130 .139
Year of implementation .048 .049 .090
Faculty 1 -.205* -.211* -.196*
Faculty 2 -.022 -.020 -.228**
Faculty 3 -.206* -.210* -.308**
Faculty other .216 .214 .024
Size of module .210* .209* .242**
Learner satisfaction (SEAM) -.040 .103
Finding information .147
Communication .393**
Productive .135
Experiential .353**
Interactive -.081
Assessment .076
R-sq adj 18% 18% 40%
n = 140, * p < .05, ** p < .01 Table 3 Regression model of LMS engagement predicted by institutional, satisfaction and learning design analytics
• Level of study predict VLE engagement
• Faculties have different VLE engagement
• Learning design (communication & experiential) predict VLE engagement (with 22% unique variance explained)
![Page 36: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/36.jpg)
Model 1 Model 2 Model 3
Level0 .284** .304** .351**
Level1 .259 .243 .265
Level2 -.211 -.197 -.212
Level3 -.035 -.029 -.018 Year of implementation .028 -.071 -.059
Faculty 1 .149 .188 .213*
Faculty 2 -.039 .029 .045
Faculty 3 .090 .188 .236* Faculty other .046 .077 .051
Size of module .016 -.049 -.071 Finding information -.270** -.294**
Communication .005 .050
Productive -.243** -.274** Experiential -.111 -.105
Interactive .173* .221* Assessment -.208* -.221*
LMS engagement .117
R-sq adj 20% 30% 31%
n = 150 (Model 1-2), 140 (Model 3), * p < .05, ** p < .01 Table 4 Regression model of learner satisfaction predicted by institutional and learning design analytics
• Level of study predict satisfaction
• Learning design (finding info, productive, assessment) negatively predict satisfaction
• Interactive learning design positively predicts satisfaction
• VLE engagement and satisfaction unrelated
![Page 37: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/37.jpg)
Model 1 Model 2 Model 3
Level0 -.142 -.147 .005
Level1 -.227 -.236 .017
Level2 -.134 -.170 -.004
Level3 .059 -.059 .215
Year of implementation -.191** -.152* -.151*
Faculty 1 .355** .374** .360**
Faculty 2 -.033 -.032 -.189*
Faculty 3 .095 .113 .069
Faculty other .129 .156 .034
Size of module -.298** -.285** -.239**
Learner satisfaction (SEAM) -.082 -.058
LMS Engagement -.070 -.190*
Finding information -.154
Communication .500**
Productive .133
Experiential .008
Interactive -.049
Assessment .063
R-sq adj 30% 30% 36%
n = 150 (Model 1-2), 140 (Model 3), * p < .05, ** p < .01
Table 5 Regression model of learning performance predicted by institutional, satisfaction and learning design analytics
• Size of module and discipline predict completion
• Satisfaction unrelated to completion
• Learning design (communication) predicts completion
![Page 38: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/38.jpg)
Constructivist Learning Design
Assessment Learning Design
Productive Learning Design
Socio-construct. Learning Design
VLE Engagement
Student Satisfaction
Student retention
150+ modules
Week 1 Week 2 Week30+
Rienties, B., Toetenel, L., (2016). The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across 151 modules. Computers in Human Behavior, 60 (2016), 333-341
Communication
![Page 39: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/39.jpg)
Global experiences with e-learning and data
Smart learning conference3rd of May 2016, Copenhagen
@DrBartRientiesReader in Learning Analytics
![Page 40: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/40.jpg)
![Page 41: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/41.jpg)
![Page 42: Global experiences with e-learning and data](https://reader035.vdocuments.us/reader035/viewer/2022062822/587b02471a28ab93488b6acd/html5/thumbnails/42.jpg)
Toetenel, L., Rienties, B. (2016) Learning Design – creative design to visualise learning activities. Open Learning.