interactive learning technologies · teaching machines 3 1924, sidney l. pressey. page ......

Interactive Learning Technologies

Dr. Jan Schneider

Teaching Machines

1924, Sidney L. Pressey

Teaching Machines 1950s

https://www.youtube.com/watch?v=jTH3ob1IRFo

Intelligent Tutoring System

ANDERSON, I. R., & REISER, B. I. (1985). THE LISP TUTOR.

How do we learn?

Sensors in Learning

• What are sensors?

• A device which detects or measures a physical property and records, indicates,

or otherwise responds to it. (Oxford Dictionaries, 2018)

• Examples of sensors:

Sensors in Learning

• What type of sensors?

Sensors in Learning

• Do specific sensors matter?

Sensors in Learning

13Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2015). Augmenting the senses: a review on sensor-based learning support. Sensors, 15(2), 4097-4133.

Cognitive Domain

• Contextual information

14Ternier, S., Klemke, R., Kalz, M., Van Ulzen, P., & Specht, M. (2012). ARLearn: Augmented Reality Meets Augmented Virtuality. J.

UCS, 18(15), 2143-2164.

Cognitive Domain

15Kanjo, E. (2010). Noisespy: A real-time mobile phone platform for urban noise monitoring and mapping. Mobile Networks and

Applications, 15(4), 562-574.

Sensor Data for analysis

Affective Domain

16Carroll, E. A., Czerwinski, M., Roseway, A., Kapoor, A., Johns, P., Rowan, K., & Schraefel, M. C. (2013, September). Food and mood: Just-in-time support for emotional eating. In Affective Computing and Intelligent Interaction (ACII), 2013 Humaine

Association Conference on (pp. 252-257). IEEE.

Psychomotor Domain

17Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2015). Augmenting the senses: a review on sensor-based learning support. Sensors, 15(2), 4097-4133.

Limitations of Sensors

Sensor data is difficult to interpret

1 source might not be enough to interpret some task

Multimodality

• What instrument is being played in the picture?

• What is the instrument being played in the sound clip?

Multimodality

• What are the instruments being played in this sound clip?

Multimodality

• Why do we need multimodality? (Example 1)

• https://www.youtube.com/watch?v=Kmft674XPC0

Multimodality

• Change of interpretation

• https://www.youtube.com/watch?v=rn9V0cN4NWs24

Multimodality

Multimodality for human computer

interaction (1979)

Bolt, R. A. (1980). “Put-that-there”: Voice and gesture at the graphics interface (Vol. 14, No. 3, pp. 262-270). ACM.ISO 690

https://www.youtube.com/watch?v=RyBEUyEtxQo

They encode

messages

Todays multimodality for

computers

e.g. 3D visualisations in AR

They decode

sensor inputs

e.g modern AR

headsets like

Hololenes

Examples of Interactive Multimodal Learning

technologies

„During the course lessons, arousal was positively and highly correlated (r = .66)

with achievement as measured by the students' grades.“

Pijeira-díaz, H. J., Drachsler, H., Kirschner, P. A. & Järvelä, S. (2018). Profiling sympathetic arousal in a physics course: how active are students? Journal of Computer Assisted Learning, SI on Multimodal

Learning Analytics. pre-print:

Making Predictions

Understanding Learning Process

The distance between learners' hands and faces is a strong predictor of students' artefact quality,

which can indicate the value of student collaboration.

Spikol, D., Ruffaldi, E., Dabisias, G., & Cukurova, M. (2018). Supervised machine learning in multimodal learning analytics for estimating success in project-based learning. Journal of

Computer Assisted Learning, 34(4), 366-377.

Mimicking Expert Performance

http://wekit.eu/

https://www.youtube.com/watch?v=RkGXdpSB_AM

Presentation trainer

Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2016). Can you help me with my

pitch? Studying a tool for real-time automated feedback. IEEE Transactions on Learning

Technologies, 9(4), 318-327.

Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2015). Stand tall and raise your voice!

a study on the presentation trainer. In Design for teaching and learning in a networked world (pp.

311-324). Springer, Cham.

(Real-time Feedback)

Dashboard interface

Is not useful!

Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2015). Stand tall and raise your voice!

a study on the presentation trainer. In Design for teaching and learning in a networked world (pp.

311-324). Springer, Cham.

PageSchneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2016). Can you help me with my

1 2 3 4 5 6

Treatment Group

Control Group

Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2016). Can you help me with my

Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2016, September). Enhancing public

speaking skills-an evaluation of the Presentation Trainer in the wild. In European Conference on

Technology Enhanced Learning (pp. 263-276). Springer, Cham.

Confid

Clarit

Pi tch 1

Pitch 2

• 1 feedback instruction that

does not go away until the

learner corrects the mistake

works.

• For good and for bad, there

is no emotion between PT’s

feedback and the learner.

PageSchneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2017, June). Do You Know What Your

Nonverbal Behavior Communicates?–Studying a Self-reflection Module for the Presentation

Trainer. In International Conference on Immersive Learning (pp. 93-106). Springer, Cham.

(Self-reflection)

PageSchneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2017, June). Do You Know What Your

Nonverbal Behavior Communicates?–Studying a Self-reflection Module for the Presentation

Trainer. In International Conference on Immersive Learning (pp. 93-106). Springer, Cham.

(Self-reflection)

Does it work?

• Inconclusive evidence

• Learners identify problems but do not know what to do about them.

• It seems that learners change behavior for a few seconds and then go back to old habits.

Schneider, J., Börner, D., van Rosmalen, P., & Specht, M. (2018). Do you Want to be a

Superhero? Boosting Emotional States with the Booth. Journal of Universal Computer

Science, 24(2), 85-107.

The Booth

Science, 24(2), 85-107.

The Booth

Science, 24(2), 85-107.

The Booth

Does it work?

Science, 24(2), 85-107.

The Booth

Does it work?

Limitations

Customizable MultimodalLearning Solution

Hardware costs

Software costs

MMLA Examples

Schneider, J., Di Mitri, D., Limbu, B., & Drachsler, H. (2018, September). Multimodal learning

hub: A tool for capturing customizable multimodal learning experiences. In European Conference

on Technology Enhanced Learning (pp. 45-58). Springer, Cham.

Di Mitri, D., Schneider, J., Klemke, R., Specht, M., & Drachsler, H. (2019, March). Read Between

the Lines: An Annotation Tool for Multimodal Data for Learning. In Proceedings of the 9th

International Conference on Learning Analytics & Knowledge(pp. 51-60). ACM.

MMLA Examples

Multimodal Tutor Builder Kit. In: Proceedings of International Conference on Learning Analytics

and Knowledge, Arizona, US, March 7–9, 2019 (LAK '19) .

Calligraphy tutor Virtual Reality Presentation Trainer

Conclusions

interactive learning technologies · teaching machines 3 1924, sidney l. pressey. page ......

Documents

sidney maurer brochure

sidney lewis

sir philip sidney

sidney kiosk

sidney, oh

sidney tarrow

sidney samuels

for sidney bechet

the sidney herald (sidney, mont.), 1955-11-17, [p 20]

ppt pressey

334 - unusual sidney

sidney bechet discography

sidney centennial history

sidney crosby

eleanor hamilton edu 697capstone: a project approach dr....

internet and distance education delivery verdan st. aimie...

sidney opera

president: sidney widmark

sidney pdf

sonnet xxxi,sidney