TELL ME project - Technology Enhanced Learning Living Lab for Manufacturing Environments

Fridolin Wild1), Alan Fletcher1), Jaakko Karjalainen2), Ambjoern Naeve3)

1) The Open University, 2) VTT, 3) KTH

Learning by DoingJTEL summer school, 26.4.-3.5. 2014, Malta

“Complexity is free”

Luana IorioTechnology Leader –

Manufacturing Technologies at GE Global Research

3

Experience is not.

Probability of Computerisation

4

Manufacturing

(Frey & Osborne, 2013, p.37)

5

The skills gap

(Dobbs et al., 2012, p.15)

rapid exploration: designed for situations of ill-defined learning needs

… including advanced motoric, artistic, and technical skills

Individual AND team creativity

Manage switching between focus-mode and serendipity-mode

• ICT skills (!)• Self-management and self-

regulation skills

High skills: 21st century skills

6

Build and sustain professional social network, develop Social Capital; communication skills

Allow rigorous ‘testing’ of work-in-progress using ‘preview audiences’.

(Wild et al., 2013, p. 12)

( )

( )

BLUE COLLAR WORKER EXPERIENCE

Enquire

Mix

Match

Optimise

?

Traces

Need, Problem

ActivityXML incl.

Constraints

Report, Analytics

Suggestion, Recommendation

Classifiable? Known? Unknown?

• Navigational positioning in taxonomy

• Discovery support

• Selection of existing mixes with ranked search

• Authoring of new or modified mixes

• Personalised suggestions for improvement of mix / experience

tracking

Constraints:• e.g. returned tool 15• e.g. watched video A• e.g. 14/15 in PT session• e.g. 0 FOD problems• e.g. energy < daily limit

activities:• e.g. job cards• e.g. tasks• e.g. learning paths

• Queries• (Reasoning)

Learning by Experience

(Wild et al., to appear; Wild et al., 2013)

Problem

Summer /Winter cycle

Functional fabrics

Set up of the weaving mill.Each topic may hav.)

Prevent potential defects before they happen.

Failed step: waste of resources.

SB: Improve manufacturing process with attribute changes

The situation: as-is

PROFESSIONAL QUALIFICATION(e.g. courses, titles)

MATERIALS (e.g. yarn 76/2 710)

MACHINE

to-be: do-torial (1)

Each topic may have several alternative learning contents attached (objects, actions, choices...)

DornierMTV38

Yarn76/2 710

Machine parts Materials

OCCUPATIONAL HEALTH AND SAFETY

3D MODEL

Schlagbaum

SET UP PARAMETERS

PAINT GUN USE

PROFESSIONAL QUALIFICATION(e.g. courses, titles)

FURNITURE MODEL, 3D MODEL

MATERIALS (e.g. Pinewood)

to-be: do-torial (2)

SOLVENTS, CATALYSTS & VARNISHES

PAINTS

Each topic may have several alternative learning contents attached (objects, actions, choices...)

Tinting and Varnishing (all spraying benefit from same technology)

OCCUPATIONAL HEALTH AND SAFETY

LOCATION

12

Basic UI Model

TELL ME project8 Apr 2023

‘Traditional’ AR layero markerso 3D objectso Tied to object

13

DEMO video

TELL ME project8 Apr 2023

14

Link to EMEMO

TELL ME project8 Apr 2023

Persona-

lisation

Tracking

Feedback

Spacifi-

cation

Contextu-

alisation

15TELL ME project8 Apr 2023

Player

workplace XML activity XML

16

Authoring<activity id="fodw109” name="do-torial: learn about preventing FOD while changing a rotor blade in AW-109” start="SprayGun” viewport="actions”> <action id="SprayGun” viewport="actions" type="findtool” location="SprayBooth"> <tool id="SprayGun" /> <message type="invoke" channel="rpc">user %u% searches for tool spraygun</message> <summons type="onClick" removeSelf="true"> <summon viewport="actions" type="action">video15</summon> <summon viewport="objects" type="object">SprayGun</summon> <message type="exit" channel="rpc">user %u% found object spraygun</message> </summons> <constraint channel="rpc">user %u% found object spraygun</constraint> <instruction><![CDATA[<h1>Find the Spray Gun</h1><p>bla…</p>]]></instruction> </action>

<action id="video15" viewport="actions” type="widget” location="SprayBooth"> <widget type="smartplayer" id="15” /> <message type="invoke" channel="rpc">user %u% accesses video 15</message> <summons type="onClick" removeSelf="true"> <summon viewport="actions" type="action">microass1</summon> <message type="exit" channel="rpc">user %u% watched video 15</message> </summons> <constraint channel="rpc">user %u% performed action video15</constraint> <instruction><![CDATA[<h1>Well done!</h1><p>…!</p> ]]></instruction> </action></activity>

17

Workplace: Unified Reference Model<?xml version="1.0" encoding="utf-8"?><Workplace xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"><Tangibles>

<Tangible Name="SprayBooth" Category="Place" MarkerID="007"> <YesNoOverlay IsEnabled="true” X_Offset="0” Y_Offset="0” Z_Offset="0” /> <Labels IsEnabled="false">

<Label Name="Name“ X_Offset="0” Y_Offset="0” Z_Offset="0” /> </Labels> </Tangible>

<Tangible Name="SprayGun" Category="Tool" MarkerID="011" Thumbnail="data/tangibles/pistol-blue-small.png">

<YesNoOverlay IsEnabled="true” X_Offset="0” Y_Offset="0” Z_Offset="0” /><Labels IsEnabled="false">

<Label Name="Name“ X_Offset="0” Y_Offset="0” Z_Offset="0” /></Labels>

</Tangible>

<Tangible Name="Jake" Category="Person" MarkerID="012"><YesNoOverlay IsEnabled="true” X_Offset="0” Y_Offset="0” Z_Offset="0” /><Labels IsEnabled="false">

<Label Name="Name“ X_Offset="0” Y_Offset="0” Z_Offset="0” /></Labels>

</Tangible> </Tangibles></Workplace>

TELL ME project8 Apr 2023